[fixed] Netgate SG-4860 started crashing with no apparent cause



  • We have been using our 4860 for over a year with no issues.  We lost access to the internet and when I checked the firewall it was unresponsive to pings, ssh and web access.  I decided to reset it so I pulled the power for a few seconds and plugged it back in.  Internet access was restored for a few minutes and then it happened again.  This time when I brought it back online I managed to get the crash report before it went down again.  We had not made any changes to the config in several days and had not made any software updates for several weeks.

    Not sure how to parse the crash report, is there anything here that indicates what the problem is?

    					Crash report begins.  Anonymous machine information:
    
    amd64
    10.3-RELEASE-p19
    FreeBSD 10.3-RELEASE-p19 #1 76a12c4e6(RELENG_2_3_4): Thu Jun  1 09:22:27 CDT 2017     root@factory23-amd64-builder:/builder/factory-234/tmp/obj/builder/factory-234/tmp/FreeBSD-src/sys/pfSense
    
    Crash report details:
    
    No PHP errors found.
    
    Filename: /var/crash/bounds
    1
    
    Filename: /var/crash/info.0
    Dump header from device /dev/label/swap0
      Architecture: amd64
      Architecture Version: 1
      Dump Length: 105472B (0 MB)
      Blocksize: 512
      Dumptime: Tue Oct 10 13:01:32 2017
      Hostname: scandia.adventium.net
      Magic: FreeBSD Text Dump
      Version String: FreeBSD 10.3-RELEASE-p19 #1 76a12c4e6(RELENG_2_3_4): Thu Jun  1 09:22:27 CDT 2017
        root@factory23-amd64-builder:/builder/factory-234/tmp/obj/builder/factory-234/tmp/FreeBSD-src/sys/pfSense  Panic String: 
      Dump Parity: 4227133717
      Bounds: 0
      Dump Status: good
    
    Filename: /var/crash/info.last
    Dump header from device /dev/label/swap0
      Architecture: amd64
      Architecture Version: 1
      Dump Length: 105472B (0 MB)
      Blocksize: 512
      Dumptime: Tue Oct 10 13:01:32 2017
      Hostname: scandia.adventium.net
      Magic: FreeBSD Text Dump
      Version String: FreeBSD 10.3-RELEASE-p19 #1 76a12c4e6(RELENG_2_3_4): Thu Jun  1 09:22:27 CDT 2017
        root@factory23-amd64-builder:/builder/factory-234/tmp/obj/builder/factory-234/tmp/FreeBSD-src/sys/pfSense  Panic String: 
      Dump Parity: 4227133717
      Bounds: 0
      Dump Status: good
    
    Filename: /var/crash/minfree
    2048
    
    Filename: /var/crash/textdump.tar.0
    ddb.txt���������������������������������������������������������������������������������������������0600����0�������0�������140000������13167205374�  7102� �����������������������������������������������������������������������������������������������������ustar���root����������������������������wheel������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������db:0:kdb.enter.default>  run lockinfo
    db:1:lockinfo> show locks
    No such command
    db:1:locks>  show alllocks
    No such command
    db:1:alllocks>  show lockedvnods
    Locked vnodes
    db:0:kdb.enter.default>  show pcpu
    cpuid        = 3
    dynamic pcpu = 0xfffffe026b8c7000
    curthread    = 0xfffff800054734b0: pid 12 "irq260: igb1:que 1"
    curpcb       = 0xfffffe01ef6f4cc0
    fpcurthread  = none
    idlethread   = 0xfffff80005240000: tid 100006 "idle: cpu3"
    curpmap      = 0xffffffff820f8aa0
    tssp         = 0xffffffff82113ac8
    commontssp   = 0xffffffff82113ac8
    rsp0         = 0xfffffe01ef6f4cc0
    gs32p        = 0xffffffff82115520
    ldt          = 0xffffffff82115560
    tss          = 0xffffffff82115550
    db:0:kdb.enter.default>  bt
    Tracing pid 12 tid 100041 td 0xfffff800054734b0
    sbappendaddr_locked_internal() at sbappendaddr_locked_internal+0x103/frame 0xfffffe01ef6f4670
    sbappendaddr_locked() at sbappendaddr_locked+0x90/frame 0xfffffe01ef6f46b0
    rip_append() at rip_append+0xfa/frame 0xfffffe01ef6f4700
    rip_input() at rip_input+0x2e2/frame 0xfffffe01ef6f4780
    icmp_input() at icmp_input+0x735/frame 0xfffffe01ef6f4860
    ip_input() at ip_input+0x10f/frame 0xfffffe01ef6f48b0
    netisr_dispatch_src() at netisr_dispatch_src+0x62/frame 0xfffffe01ef6f4920
    ether_demux() at ether_demux+0x116/frame 0xfffffe01ef6f4950
    ether_nh_input() at ether_nh_input+0x347/frame 0xfffffe01ef6f49b0
    netisr_dispatch_src() at netisr_dispatch_src+0x62/frame 0xfffffe01ef6f4a20
    igb_rxeof() at igb_rxeof+0x658/frame 0xfffffe01ef6f4ad0
    igb_msix_que() at igb_msix_que+0x16d/frame 0xfffffe01ef6f4b20
    intr_event_execute_handlers() at intr_event_execute_handlers+0xab/frame 0xfffffe01ef6f4b60
    ithread_loop() at ithread_loop+0x96/frame 0xfffffe01ef6f4bb0
    fork_exit() at fork_exit+0x9a/frame 0xfffffe01ef6f4bf0
    fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01ef6f4bf0
    --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
    db:0:kdb.enter.default>  ps
      pid  ppid  pgrp   uid   state   wmesg         wchan        cmd
     9542 58349   284     0  R       CPU 1                       pfctl
     8185 45477    21     0  S       nanslp   0xffffffff82001670 sleep
    74691 88806   284     0  S       nanslp   0xffffffff82001671 sleep
    65027   284   284     0  S       accept   0xfffff8000c25c066 php-fpm
    58349   284   284     0  S       piperd   0xfffff8000c0eeba0 php-fpm
    18297 17478 18297     0  Ts      (threaded)                  php
    100839                   D       bo_wwait 0xfffff8023e084e48 php
    100507                   s                                   php
    17478 31606 31606     0  S       wait     0xfffff801755134f0 cron
    38335 25758 25255   100  S       sbwait   0xfffff8017566e6b4 squidGuard
    38311 25758 25255   100  S       sbwait   0xfffff8017566f96c squidGuard
    38064 25758 25255   100  S       sbwait   0xfffff80175882c24 squidGuard
    38035 25758 25255   100  S       sbwait   0xfffff8016df6a3fc squidGuard
    37839 25758 25255   100  S       sbwait   0xfffff8016df09c24 pinger
    25810 25758 25255   100  S       select   0xfffff8000bbf4940 pinger
    47262 25758 25255   100  S       sbwait   0xfffff8016df08c24 pinger
    79877 25758 25255   100  S       sbwait   0xfffff8007d5193fc pinger
    70662     1 70662     0  Ss      (threaded)                  snort
    100864                   S       nanslp   0xffffffff82001671 snort
    101253                   S       bpf      0xfffff8011e60fa00 snort
    70267     1 70267     0  Rs      (threaded)                  snort
    100863                   S       nanslp   0xffffffff82001670 snort
    101287                   RunQ                                snort
    98167 25758 25255   100  S       sbwait   0xfffff80175238144 pinger
     8238 25758 25255   100  S       select   0xfffff8007b93abc0 pinger
    58411 25758 25255   100  S       sbwait   0xfffff802243efc24 pinger
     7935 25758 25255   100  S       sbwait   0xfffff802243ee3fc pinger
    29806 25758 25255   100  S       sbwait   0xfffff8010a34d96c pinger
    72099 25758 25255   100  S       sbwait   0xfffff8017590b3fc pinger
    65638 25758 25255   100  S       select   0xfffff8023e1794c0 pinger
     5280 25758 25255   100  S       select   0xfffff8016d893640 pinger
     2054 25758 25255   100  S       sbwait   0xfffff8016deb996c pinger
    86411 25758 25255   100  S       select   0xfffff8016d208f40 pinger
    99595 25758 25255   100  S       sbwait   0xfffff8010add496c pinger
    34352 25758 25255   100  S       select   0xfffff8011e2c8140 pinger
    17011 25758 25255   100  S       select   0xfffff8000c6562c0 pinger
    99886 25758 25255   100  S       select   0xfffff8016d1f12c0 pinger
    29749 25758 25255   100  S       sbwait   0xfffff8020e40b144 pinger
    80384 25758 25255   100  S       sbwait   0xfffff8016df433fc pinger
    43188 25758 25255   100  S       sbwait   0xfffff801758f6c24 pinger
    14203 25758 25255   100  S       select   0xfffff8023e67cf40 pinger
    88360 25758 25255   100  S       select   0xfffff8016d266dc0 pinger
    24044 25758 25255   100  S       select   0xfffff8007b7444c0 pinger
    59458 25758 25255   100  S       select   0xfffff8016d2633c0 pinger
    16265 25758 25255   100  S       sbwait   0xfffff8007d4746b4 pinger
     7611 25758 25255   100  S       select   0xfffff8007d264bc0 pinger
    29175 25758 25255   100  S       sbwait   0xfffff8023ee80144 pinger
    94924 25758 25255   100  S       sbwait   0xfffff8023ee8096c pinger
    82597 25758 25255   100  S       sbwait   0xfffff8017590ac24 pinger
    35243 25758 25255   100  S       select   0xfffff8020e3d1640 pinger
    67212 25758 25255   100  S       sbwait   0xfffff801752016b4 pinger
    91711 25758 25255   100  S       sbwait   0xfffff8007d4f696c pinger
    90223 25758 25255   100  S       sbwait   0xfffff8010add296c ssl_crtd
    89984 25758 25255   100  S       sbwait   0xfffff8000c2a4144 ssl_crtd
    89658 25758 25255   100  S       sbwait   0xfffff8023ee816b4 ssl_crtd
    89568 25758 25255   100  S       sbwait   0xfffff8000c38ec24 ssl_crtd
    89538 25758 25255   100  S       sbwait   0xfffff801759883fc ssl_crtd
    88806     1   284     0  S       wait     0xfffff8010a8e7000 sh
    98284 25758 25255   100  S       sbwait   0xfffff8017566e96c pinger
    84508 25758 25255   100  S       sbwait   0xfffff8016df6b96c pinger
    75166 25758 25255   100  S       select   0xfffff8020e3d13c0 pinger
     1127 25758 25255   100  S       select   0xfffff8000c209ac0 pinger
    44930 25758 25255   100  S       sbwait   0xfffff801754da3fc pinger
    83985 25758 25255   100  S       sbwait   0xfffff8016df0996c pinger
    94763 25758 25255   100  S       select   0xfffff8011e2542c0 pinger
    57505 25758 25255   100  S       select   0xfffff8007d411040 pinger
     4291 25758 25255   100  S       sbwait   0xfffff8017590a96c pinger
    56520 25758 25255   100  S       select   0xfffff8007b7a8cc0 pinger
    41940 25758 25255   100  S       select   0xfffff8007b744540 pinger
    56632 25758 25255   100  S       select   0xfffff8016d6519c0 pinger
    58327 25758 25255   100  S       select   0xfffff8007d3ee6c0 pinger
    32441 25758 25255   100  S       select   0xfffff8010a4028c0 pinger
    32337 25758 25255   100  S       piperd   0xfffff8010af38000 unlinkd
    25758 25255 25255   100  S       kqread   0xfffff8016db9c100 squid
    25255     1 25255   100  Ss      wait     0xfffff801755b2000 squid
      632     1   284     0  S       nanslp   0xffffffff82001670 php
    18095 17756 18095     0  S+      ttyin    0xfffff8000b03b0a8 sh
    17756 17447 17756     0  S+      wait     0xfffff8010a3274f0 sh
    17703 75699 17703     0  Ss      (threaded)                  sshlockout_pf
    100187                   S       nanslp   0xffffffff82001670 sshlockout_pf
    100174                   S       piperd   0xfffff8000c12eba0 sshlockout_pf
    17447     1 17447     0  Ss+     wait     0xfffff8000bbae000 login
    17365     1     1     0  S       nanslp   0xffffffff82001670 getty
     2305  2019  2019     0  S       nanslp   0xffffffff82001672 minicron
     2019     1  2019     0  Ss      wait     0xfffff8010a33e9e0 minicron
     1728  1623  1623     0  S       nanslp   0xffffffff82001672 minicron
     1623     1  1623     0  Ss      wait     0xfffff8010a3334f0 minicron
     1422   737   737     0  S       nanslp   0xffffffff82001673 minicron
      737     1   737     0  Ss      wait     0xfffff8010a327000 minicron
    75699     1 75699     0  Ss      select   0xfffff8007d3bc040 syslogd
    45477     1    21     0  S+      wait     0xfffff8000c4b1000 sh
    37331     1 37331  1002  Ss      select   0xfffff8007b7a76c0 dhcpd
    31993     1 31993     0  Ss      select   0xfffff8007d3bc2c0 ntpd
    31606     1 31606     0  Ss      nanslp   0xffffffff82001670 cron
    31322 30764 30764     0  S       kqread   0xfffff8007d3d0900 nginx
    31036 30764 30764     0  S       kqread   0xfffff8000c116300 nginx
    30764     1 30764     0  Ss      pause    0xfffff8007d3dd598 nginx
    21214     1 21214     0  Rs      (threaded)                  dpinger
    100149                   S       accept   0xfffff8000c25a31e dpinger
    100148                   S       nanslp   0xffffffff82001670 dpinger
    100147                   CanRun                              dpinger
    100146                   S       sbwait   0xfffff8000c25a6b4 dpinger
    100135                   S       uwait    0xfffff8000bbf4a80 dpinger
    20715     1 20715     0  Ss      (threaded)                  dpinger
    100145                   S       accept   0xfffff8000c25ab46 dpinger
    100144                   S       nanslp   0xffffffff82001670 dpinger
    100143                   S       nanslp   0xffffffff82001671 dpinger
    100142                   S       sbwait   0xfffff8000c25b144 dpinger
    100117                   S       uwait    0xfffff8000bbd5d00 dpinger
    17423     1 17423     0  Ss      bpf      0xfffff8007b710a00 filterlog
     7563     1  7563     0  Ss      (threaded)                  sshlockout_pf
    100140                   S       nanslp   0xffffffff82001670 sshlockout_pf
    100124                   S       uwait    0xfffff8000c01b480 sshlockout_pf
     7537     1  7537     0  Ss      select   0xfffff8000bbd6440 sshd
      337     1   337     0  Ss      select   0xfffff8000c2097c0 devd
      325   323   323     0  S       kqread   0xfffff8000c0b4a00 check_reload_status
      323     1   323     0  Ss      kqread   0xfffff8000bb96d00 check_reload_status
      284     1   284     0  Ss      kqread   0xfffff8000bbf9400 php-fpm
       50     0     0     0  DL      mdwait   0xfffff8000b02d800 [md0]
       20     0     0     0  DL      syncer   0xffffffff82052608 [syncer]
       19     0     0     0  DL      vlruwt   0xfffff8000bbae9e0 [vnlru]
       18     0     0     0  DL      (threaded)                  [bufdaemon]
    100110                   D       sdflush  0xfffff8000c1144e8 [/ worker]
    100100                   D       psleep   0xffffffff82051804 [bufdaemon]
       17     0     0     0  DL      pgzero   0xffffffff8206293c [pagezero]
        9     0     0     0  DL      pollid   0xffffffff81ffff90 [idlepoll]
        8     0     0     0  DL      psleep   0xffffffff82061cc0 [vmdaemon]
        7     0     0     0  DL      (threaded)                  [pagedaemon]
    100106                   D       umarcl   0xffffffff82061640 [uma]
    100096                   D       psleep   0xffffffff82112d04 [pagedaemon]
        6     0     0     0  DL      waiting_ 0xffffffff821037c0 [sctp_iterator]
        5     0     0     0  DL      pftm     0xffffffff80d5dc30 [pf purge]
       16     0     0     0  DL      (threaded)                  [usb]
    100085                   D       -        0xfffffe0000c56e70 [usbus0]
    100084                   D       -        0xfffffe0000c56e18 [usbus0]
    100083                   D       -        0xfffffe0000c56dc0 [usbus0]
    100082                   D       -        0xfffffe0000c56d68 [usbus0]
    100081                   D       -        0xfffffe0000c56d10 [usbus0]
        4     0     0     0  RL      (threaded)                  [cam]
    100095                   D       -        0xffffffff81f361c8 [scanner]
    100025                   Run     CPU 0                       [doneq0]
       15     0     0     0  DL      -        0xffffffff81f57ac0 [rand_harvestq]
        3     0     0     0  DL      crypto_r 0xffffffff82060198 [crypto returns]
        2     0     0     0  DL      crypto_w 0xffffffff82060040 [crypto]
       14     0     0     0  DL      (threaded)                  [geom]
    100019                   D       -        0xffffffff820f7ee8 [g_down]
    100018                   D       -        0xffffffff820f7ee0 [g_up]
    100017                   D       -        0xffffffff820f7ed8 [g_event]
       13     0     0     0  DL      (threaded)                  [ng_queue]
    100016                   D       sleep    0xffffffff81ef4818 [ng_queue3]
    100015                   D       sleep    0xffffffff81ef4818 [ng_queue2]
    100014                   D       sleep    0xffffffff81ef4818 [ng_queue1]
    100013                   D       sleep    0xffffffff81ef4818 [ng_queue0]
       12     0     0     0  RL      (threaded)                  [intr]
    100105                   I                                   [swi1: netisr 3]
    100104                   Run     CPU 2                       [swi1: netisr 2]
    100103                   I                                   [swi1: netisr 1]
    100093                   I                                   [swi1: pfsync]
    100091                   I                                   [swi1: pf send]
    100088                   I                                   [swi0: uart uart]
    100087                   I                                   [irq283: ahci1]
    100086                   I                                   [irq282: ahci0]
    100080                   I                                   [irq22: ehci0]
    100079                   I                                   [irq281: igb5:link]
    100077                   I                                   [irq280: igb5:que 3]
    100075                   I                                   [irq279: igb5:que 2]
    100073                   I                                   [irq278: igb5:que 1]
    100071                   I                                   [irq277: igb5:que 0]
    100070                   I                                   [irq276: igb4:link]
    100068                   I                                   [irq275: igb4:que 3]
    100066                   I                                   [irq274: igb4:que 2]
    100064                   I                                   [irq273: igb4:que 1]
    100062                   I                                   [irq272: igb4:que 0]
    100061                   I                                   [irq271: igb3:link]
    100059                   RunQ                                [irq270: igb3:que 3]
    100057                   I                                   [irq269: igb3:que 2]
    100055                   I                                   [irq268: igb3:que 1]
    100053                   I                                   [irq267: igb3:que 0]
    100052                   I                                   [irq266: igb2:link]
    100050                   RunQ                                [irq265: igb2:que 3]
    100048                   I                                   [irq264: igb2:que 2]
    100046                   I                                   [irq263: igb2:que 1]
    100044                   I                                   [irq262: igb2:que 0]
    100043                   I                                   [irq261: igb1:link]
    100041                   Run     CPU 3                       [irq260: igb1:que 1]
    100039                   I                                   [irq259: igb1:que 0]
    100038                   I                                   [irq258: igb0:link]
    100036                   I                                   [irq257: igb0:que 1]
    100034                   I                                   [irq256: igb0:que 0]
    100033                   I                                   [swi5: fast taskq]
    100031                   I                                   [swi6: Giant taskq]
    100029                   I                                   [swi6: task queue]
    100012                   I                                   [swi4: clock]
    100011                   I                                   [swi4: clock]
    100010                   I                                   [swi4: clock]
    100009                   I                                   [swi4: clock]
    100008                   I                                   [swi1: netisr 0]
    100007                   I                                   [swi3: vm]
       11     0     0     0  RL      (threaded)                  [idle]
    100006                   CanRun                              [idle: cpu3]
    100005                   CanRun                              [idle: cpu2]
    100004                   CanRun                              [idle: cpu1]
    100003                   CanRun                              [idle: cpu0]
        1     0     1     0  SLs     wait     0xfffff8000523e4f0 [init]
       10     0     0     0  DL      audit_wo 0xffffffff8210a260 [audit]
        0     0     0     0  DLs     (threaded)                  [kernel]
    100094                   D       -        0xfffff80005260900 [CAM taskq]
    100089                   D       -        0xfffff8000b04b800 [mca taskq]
    100078                   D       -        0xfffff800054c8200 [igb5 que]
    100076                   D       -        0xfffff800054c8500 [igb5 que]
    100074                   D       -        0xfffff800054c8800 [igb5 que]
    100072                   D       -        0xfffff800054c8b00 [igb5 que]
    100069                   D       -        0xfffff800054caa00 [igb4 que]
    100067                   D       -        0xfffff800054cad00 [igb4 que]
    100065                   D       -        0xfffff800054cb100 [igb4 que]
    100063                   D       -        0xfffff800054cb400 [igb4 que]
    100060                   D       -        0xfffff800054a6100 [igb3 que]
    100058                   D       -        0xfffff800054a6400 [igb3 que]
    100056                   D       -        0xfffff800054a6700 [igb3 que]
    100054                   D       -        0xfffff800054a6a00 [igb3 que]
    100051                   D       -        0xfffff8000543d700 [igb2 que]
    100049                   D       -        0xfffff8000543da00 [igb2 que]
    100047                   D       -        0xfffff8000543dd00 [igb2 que]
    100045                   D       -        0xfffff80005480100 [igb2 que]
    100042                   D       -        0xfffff80005482000 [igb1 que]
    100040                   D       -        0xfffff80005482300 [igb1 que]
    100037                   D       -        0xfffff80005262600 [igb0 que]
    100035                   D       -        0xfffff80005262900 [igb0 que]
    100032                   D       -        0xfffff8000525f800 [thread]
    100030                   D       -        0xfffff8000525fd00 [ffs_trim taskq]
    100028                   D       -        0xfffff80005260500 [acpi_task_2]
    100027                   D       -        0xfffff80005260500 [acpi_task_1]
    100026                   D       -        0xfffff80005260500 [acpi_task_0]
    100024                   D       -        0xfffff80005260b00 [kqueue taskq]
    100020                   D       -        0xfffff80005230100 [firmware taskq]
    100000                   D       swapin   0xffffffff820f7fe8 [swapper]
    db:0:kdb.enter.default>  alltrace
    
    Tracing command pfctl pid 9542 tid 101256 td 0xfffff8023df41000
    cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe01ed7eacf0
    ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe01ed7ead10
    trap() at trap+0x3a/frame 0xfffffe01ed7eaf20
    nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe01ed7eaf20
    --- trap 0x13, rip = 0xffffffff80b17960, rsp = 0xfffffe0237c63870, rbp = 0xfffffe0237c63920 ---
    sysctl_sysctl_name2oid() at sysctl_sysctl_name2oid+0x120/frame 0xfffffe0237c63920
    sysctl_root() at sysctl_root+0x231/frame 0xfffffe0237c63970
    userland_sysctl() at userland_sysctl+0x1d8/frame 0xfffffe0237c63a20
    sys___sysctl() at sys___sysctl+0x74/frame 0xfffffe0237c63ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c63bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c63bf0
    --- syscall (202, FreeBSD ELF64, sys___sysctl), rip = 0x800dcee4a, rsp = 0x7fffffffb628, rbp = 0x7fffffffb660 ---
    
    Tracing command sleep pid 8185 tid 100152 td 0xfffff8000c42e960
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237a4f8c0
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237a4f900
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237a4f980
    sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe0237a4f9b0
    _sleep() at _sleep+0x238/frame 0xfffffe0237a4fa30
    kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe0237a4fa90
    sys_nanosleep() at sys_nanosleep+0x51/frame 0xfffffe0237a4fad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237a4fbf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237a4fbf0
    --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8008f1f7a, rsp = 0x7fffffffec68, rbp = 0x7fffffffeca0 ---
    
    Tracing command sleep pid 74691 tid 100477 td 0xfffff8010af43000
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237b948c0
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237b94900
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237b94980
    sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe0237b949b0
    _sleep() at _sleep+0x238/frame 0xfffffe0237b94a30
    kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe0237b94a90
    sys_nanosleep() at sys_nanosleep+0x51/frame 0xfffffe0237b94ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237b94bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237b94bf0
    --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8008f1f7a, rsp = 0x7fffffffec78, rbp = 0x7fffffffecb0 ---
    
    Tracing command php-fpm pid 65027 tid 100491 td 0xfffff8020e432960
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237bda850
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237bda890
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237bda910
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237bda940
    _sleep() at _sleep+0x27d/frame 0xfffffe0237bda9c0
    kern_accept4() at kern_accept4+0x1b1/frame 0xfffffe0237bdaa70
    accept1() at accept1+0x63/frame 0xfffffe0237bdaad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237bdabf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237bdabf0
    --- syscall (30, FreeBSD ELF64, sys_accept), rip = 0x801d8001a, rsp = 0x7ffffffec6e8, rbp = 0x7ffffffec720 ---
    
    Tracing command php-fpm pid 58349 tid 100168 td 0xfffff8007d4d54b0
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237a9f810
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237a9f850
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237a9f8d0
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237a9f900
    _sleep() at _sleep+0x27d/frame 0xfffffe0237a9f980
    pipe_read() at pipe_read+0x2aa/frame 0xfffffe0237a9f9e0
    dofileread() at dofileread+0x95/frame 0xfffffe0237a9fa30
    kern_readv() at kern_readv+0x68/frame 0xfffffe0237a9fa80
    sys_read() at sys_read+0x63/frame 0xfffffe0237a9fad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237a9fbf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237a9fbf0
    --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x801de26ca, rsp = 0x7fffffffa138, rbp = 0x7fffffffa170 ---
    
    Tracing command php pid 18297 tid 100839 td 0xfffff801753804b0
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237ca3f50
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237ca3f90
    sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe0237ca3fc0
    _sleep() at _sleep+0x287/frame 0xfffffe0237ca4040
    bufobj_wwait() at bufobj_wwait+0x69/frame 0xfffffe0237ca4080
    ffs_syncvnode() at ffs_syncvnode+0x360/frame 0xfffffe0237ca4110
    ffs_truncate() at ffs_truncate+0x683/frame 0xfffffe0237ca4280
    ffs_write() at ffs_write+0x516/frame 0xfffffe0237ca4320
    VOP_WRITE_APV() at VOP_WRITE_APV+0x149/frame 0xfffffe0237ca4430
    vn_io_fault_doio() at vn_io_fault_doio+0x60/frame 0xfffffe0237ca4470
    vn_io_fault1() at vn_io_fault1+0x1ac/frame 0xfffffe0237ca45d0
    vn_rdwr() at vn_rdwr+0x21f/frame 0xfffffe0237ca46b0
    vn_rdwr_inchunks() at vn_rdwr_inchunks+0xa7/frame 0xfffffe0237ca4730
    elf64_coredump() at elf64_coredump+0xa13/frame 0xfffffe0237ca4830
    sigexit() at sigexit+0xb6c/frame 0xfffffe0237ca4af0
    postsig() at postsig+0x286/frame 0xfffffe0237ca4bb0
    ast() at ast+0x417/frame 0xfffffe0237ca4bf0
    doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcf40
    
    Tracing command php pid 18297 tid 100507 td 0xfffff8017598d4b0
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c18b20
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c18b60
    thread_suspend_check() at thread_suspend_check+0x337/frame 0xfffffe0237c18bb0
    ast() at ast+0x4e5/frame 0xfffffe0237c18bf0
    doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffea20
    
    Tracing command cron pid 17478 tid 100500 td 0xfffff8020e274000
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237bf36a0
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237bf36e0
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237bf3760
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237bf3790
    _sleep() at _sleep+0x27d/frame 0xfffffe0237bf3810
    kern_wait6() at kern_wait6+0x5de/frame 0xfffffe0237bf38e0
    sys_wait4() at sys_wait4+0x72/frame 0xfffffe0237bf3ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237bf3bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237bf3bf0
    --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d19dba, rsp = 0x7fffffffe448, rbp = 0x7fffffffea30 ---
    
    Tracing command squidGuard pid 38335 tid 100157 td 0xfffff8000c5b6000
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237a68780
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237a687c0
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237a68840
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237a68870
    _sleep() at _sleep+0x27d/frame 0xfffffe0237a688f0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237a68910
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237a689e0
    dofileread() at dofileread+0x95/frame 0xfffffe0237a68a30
    kern_readv() at kern_readv+0x68/frame 0xfffffe0237a68a80
    sys_read() at sys_read+0x63/frame 0xfffffe0237a68ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237a68bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237a68bf0
    --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80116b6ca, rsp = 0x7ffffffdab18, rbp = 0x7ffffffdab30 ---
    
    Tracing command squidGuard pid 38311 tid 101252 td 0xfffff80175bf3960
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c4f780
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c4f7c0
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237c4f840
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237c4f870
    _sleep() at _sleep+0x27d/frame 0xfffffe0237c4f8f0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237c4f910
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237c4f9e0
    dofileread() at dofileread+0x95/frame 0xfffffe0237c4fa30
    kern_readv() at kern_readv+0x68/frame 0xfffffe0237c4fa80
    sys_read() at sys_read+0x63/frame 0xfffffe0237c4fad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c4fbf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c4fbf0
    --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80116b6ca, rsp = 0x7ffffffdab18, rbp = 0x7ffffffdab30 ---
    
    Tracing command squidGuard pid 38064 tid 101254 td 0xfffff801758c1000
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c59780
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c597c0
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237c59840
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237c59870
    _sleep() at _sleep+0x27d/frame 0xfffffe0237c598f0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237c59910
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237c599e0
    dofileread() at dofileread+0x95/frame 0xfffffe0237c59a30
    kern_readv() at kern_readv+0x68/frame 0xfffffe0237c59a80
    sys_read() at sys_read+0x63/frame 0xfffffe0237c59ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c59bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c59bf0
    --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80116b6ca, rsp = 0x7ffffffdab18, rbp = 0x7ffffffdab30 ---
    
    Tracing command squidGuard pid 38035 tid 101291 td 0xfffff8007d4fe4b0
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c95780
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c957c0
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237c95840
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237c95870
    _sleep() at _sleep+0x27d/frame 0xfffffe0237c958f0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237c95910
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237c959e0
    dofileread() at dofileread+0x95/frame 0xfffffe0237c95a30
    kern_readv() at kern_readv+0x68/frame 0xfffffe0237c95a80
    sys_read() at sys_read+0x63/frame 0xfffffe0237c95ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c95bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c95bf0
    --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80116b6ca, rsp = 0x7ffffffdab18, rbp = 0x7ffffffdab30 ---
    
    Tracing command pinger pid 37839 tid 100204 td 0xfffff8020e2754b0
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237b53740
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237b53780
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237b53800
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237b53830
    _sleep() at _sleep+0x27d/frame 0xfffffe0237b538b0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237b538d0
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237b539a0
    kern_recvit() at kern_recvit+0x1f2/frame 0xfffffe0237b53a60
    sys_recvfrom() at sys_recvfrom+0x86/frame 0xfffffe0237b53ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237b53bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237b53bf0
    --- syscall (29, FreeBSD ELF64, sys_recvfrom), rip = 0x80197091a, rsp = 0x7fffffffdb08, rbp = 0x7fffffffdb50 ---
    
    Tracing command pinger pid 25810 tid 100171 td 0xfffff8007d399000
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237aae700
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237aae740
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237aae7c0
    sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe0237aae7f0
    _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19e/frame 0xfffffe0237aae850
    seltdwait() at seltdwait+0xa4/frame 0xfffffe0237aae890
    kern_select() at kern_select+0x8fa/frame 0xfffffe0237aaea90
    sys_select() at sys_select+0x54/frame 0xfffffe0237aaead0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237aaebf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237aaebf0
    --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8019c86aa, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdc00 ---
    
    Tracing command pinger pid 47262 tid 101258 td 0xfffff8023e54f960
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c6d740
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c6d780
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237c6d800
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237c6d830
    _sleep() at _sleep+0x27d/frame 0xfffffe0237c6d8b0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237c6d8d0
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237c6d9a0
    kern_recvit() at kern_recvit+0x1f2/frame 0xfffffe0237c6da60
    sys_recvfrom() at sys_recvfrom+0x86/frame 0xfffffe0237c6dad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c6dbf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c6dbf0
    --- syscall (29, FreeBSD ELF64, sys_recvfrom), rip = 0x80197091a, rsp = 0x7fffffffdb08, rbp = 0x7fffffffdb50 ---
    
    Tracing command pinger pid 79877 tid 100506 td 0xfffff8017598d960
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c13740
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c13780
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237c13800
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237c13830
    _sleep() at _sleep+0x27d/frame 0xfffffe0237c138b0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237c138d0
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237c139a0
    kern_recvit() at kern_recvit+0x1f2/frame 0xfffffe0237c13a60
    sys_recvfrom() at sys_recvfrom+0x86/frame 0xfffffe0237c13ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c13bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c13bf0
    --- syscall (29, FreeBSD ELF64, sys_recvfrom), rip = 0x80197091a, rsp = 0x7fffffffdb08, rbp = 0x7fffffffdb50 ---
    
    Tracing command snort pid 70662 tid 100864 td 0xfffff80175380960
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237af98c0
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237af9900
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237af9980
    sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe0237af99b0
    _sleep() at _sleep+0x238/frame 0xfffffe0237af9a30
    kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe0237af9a90
    sys_nanosleep() at sys_nanosleep+0x51/frame 0xfffffe0237af9ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237af9bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237af9bf0
    --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x801fcaf7a, rsp = 0x7fffdfffdeb8, rbp = 0x7fffdfffdee0 ---
    
    Tracing command snort pid 70662 tid 101253 td 0xfffff8020e448960
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c547c0
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c54800
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237c54880
    sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe0237c548b0
    _sleep() at _sleep+0x238/frame 0xfffffe0237c54930
    bpfread() at bpfread+0x1c7/frame 0xfffffe0237c54980
    devfs_read_f() at devfs_read_f+0xd8/frame 0xfffffe0237c549e0
    dofileread() at dofileread+0x95/frame 0xfffffe0237c54a30
    kern_readv() at kern_readv+0x68/frame 0xfffffe0237c54a80
    sys_read() at sys_read+0x63/frame 0xfffffe0237c54ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c54bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c54bf0
    --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80202d6ca, rsp = 0x7fffffffe868, rbp = 0x7fffffffe8a0 ---
    
    Tracing command snort pid 70267 tid 100863 td 0xfffff8023e2864b0
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237b038c0
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237b03900
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237b03980
    sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe0237b039b0
    _sleep() at _sleep+0x238/frame 0xfffffe0237b03a30
    kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe0237b03a90
    sys_nanosleep() at sys_nanosleep+0x51/frame 0xfffffe0237b03ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237b03bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237b03bf0
    --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x801fcaf7a, rsp = 0x7fffdfffdeb8, rbp = 0x7fffdfffdee0 ---
    
    Tracing command snort pid 70267 tid 101287 td 0xfffff8023e329960
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c81860
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c818a0
    kern_yield() at kern_yield+0xd9/frame 0xfffffe0237c818e0
    uiomove_faultflag() at uiomove_faultflag+0xab/frame 0xfffffe0237c81930
    bpfread() at bpfread+0x2fc/frame 0xfffffe0237c81980
    devfs_read_f() at devfs_read_f+0xd8/frame 0xfffffe0237c819e0
    dofileread() at dofileread+0x95/frame 0xfffffe0237c81a30
    kern_readv() at kern_readv+0x68/frame 0xfffffe0237c81a80
    sys_read() at sys_read+0x63/frame 0xfffffe0237c81ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c81bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c81bf0
    --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80202d6ca, rsp = 0x7fffffffe868, rbp = 0x7fffffffe8a0 ---
    
    Tracing command pinger pid 98167 tid 100195 td 0xfffff8010a6a84b0
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237b26740
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237b26780
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237b26800
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237b26830
    _sleep() at _sleep+0x27d/frame 0xfffffe0237b268b0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237b268d0
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237b269a0
    kern_recvit() at kern_recvit+0x1f2/frame 0xfffffe0237b26a60
    sys_recvfrom() at sys_recvfrom+0x86/frame 0xfffffe0237b26ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237b26bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237b26bf0
    --- syscall (29, FreeBSD ELF64, sys_recvfrom), rip = 0x80197091a, rsp = 0x7fffffffdb08, rbp = 0x7fffffffdb50 ---
    
    Tracing command pinger pid 8238 tid 100136 td 0xfffff8000c4c04b0
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe02379fb700
    mi_switch() at mi_switch+0xe1/frame 0xfffffe02379fb740
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe02379fb7c0
    sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe02379fb7f0
    _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19e/frame 0xfffffe02379fb850
    seltdwait() at seltdwait+0xa4/frame 0xfffffe02379fb890
    kern_select() at kern_select+0x8fa/frame 0xfffffe02379fba90
    sys_select() at sys_select+0x54/frame 0xfffffe02379fbad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe02379fbbf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe02379fbbf0
    --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8019c86aa, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdc00 ---
    
    Tracing command pinger pid 58411 tid 101257 td 0xfffff80239032000
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe0237c68740
    mi_switch() at mi_switch+0xe1/frame 0xfffffe0237c68780
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0237c68800
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0237c68830
    _sleep() at _sleep+0x27d/frame 0xfffffe0237c688b0
    sbwait() at sbwait+0x4f/frame 0xfffffe0237c688d0
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe0237c689a0
    kern_recvit() at kern_recvit+0x1f2/frame 0xfffffe0237c68a60
    sys_recvfrom() at sys_recvfrom+0x86/frame 0xfffffe0237c68ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe0237c68bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0237c68bf0
    --- syscall (29, FreeBSD ELF64, sys_recvfrom), rip = 0x80197091a, rsp = 0x7fffffffdb08, rbp = 0x7fffffffdb50 ---
    
    Tracing command pinger pid 7935 tid 100132 td 0xfffff8000bba5000
    sched_switch() at sched_switch+0x2b3/frame 0xfffffe02379e7740
    mi_switch() at mi_switch+0xe1/frame 0xfffffe02379e7780
    sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe02379e7800
    sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe02379e7830
    _sleep() at _sleep+0x27d/frame 0xfffffe02379e78b0
    sbwait() at sbwait+0x4f/frame 0xfffffe02379e78d0
    soreceive_generic() at soreceive_generic+0x26c/frame 0xfffffe02379e79a0
    kern_recvit() at kern_recvit+0x1f2/frame 0xfffffe02379e7a60
    sys_recvfrom() at sys_recvfrom+0x86/frame 0xfffffe02379e7ad0
    amd64_syscall() at amd64_syscall+0x40f/frame 0xfffffe02379e7bf0
    Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe02379e7bf0
    --- syscall (29, FreeBSD ELF64, sys_recvfrom), rip = 0x80197091a, rsp = 0x7fffffffdb[[/thread]
    

  • Rebel Alliance Developer Netgate

    Upgrade to 2.4, that looks like a bug that was fixed in FreeBSD 11.1 (which 2.4 is based on)



  • Seems to have worked, I installed the new version this morning and no crashes.  Of course I hadn't had any crashes before the issue started last week either so I will keep an eye on it.

    Thanks!


  • Rebel Alliance Global Moderator

    You seem to have forgotten the close code bracket or it got cut off – your post is really really long ;)

    I see the start code bracket so if the end bracket was there code would of been in a smaller scrollable window..  I do believe.

    You might want to edit the post so future readers will not have to scroll down pages and pages to read the thread ;)

    Other option with such long amount of info would of been to attach txt file..