Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Crash dump help needed on 2.8. Multiple random occurrences

    Scheduled Pinned Locked Moved General pfSense Questions
    3 Posts 2 Posters 96 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      cryptonym
      last edited by stephenw10

      I am out of my league on comprehending this BSD crash dumps. Hoping someone can make sense of this a bit. Background. Prior version had ran without issue for a couple months. I updated to 2.8 a couple weeks or so back, and have had 3 dumps since then. This is on a Protectli mini PC with 4 ports. Port 1 is the main trunk. Port 2 is management, Ports 3&4 are redundant ISP links. I run it on top of Proxmox, but right now, pfSense is the only VM on it.

      Had to grab only first portion of the log here, but tar attached hopefully.textdump.tar.0

      Any help is greatly appreciated.

      Crash report begins. Anonymous machine information:

      amd64
      15.0-CURRENT
      FreeBSD 15.0-CURRENT #1 RELENG_2_8_0-n256081-401ec5f685b9: Wed May 21 23:53:51 UTC 2025 root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_8_0-main/obj/amd64/0q9vjGjc/var/jenkins/workspace/pfSense-CE-snapshots-2_8_0-main/sources/FreeBSD-src-RE

      Crash report details:

      No PHP errors found.

      Filename: /var/crash/info.0
      Dump header from device: /dev/gpt/swap1
      Architecture: amd64
      Architecture Version: 4
      Dump Length: 138752
      Blocksize: 512
      Compression: none
      Dumptime: 2025-07-09 22:47:44 -0400
      Hostname: pfSense.brownhouse.us
      Magic: FreeBSD Text Dump
      Version String: FreeBSD 15.0-CURRENT #1 RELENG_2_8_0-n256081-401ec5f685b9: Wed May 21 23:53:51 UTC 2025
      root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_8_0-main/obj/amd64/0q9vjGjc/var/jenkins
      Panic String: general protection fault
      Dump Parity: 2969912944
      Bounds: 0
      Dump Status: good

      Filename: /var/crash/textdump.tar.0
      ddb.txt���������������������������������������������������������������������������������������������0600����0�������0�������140000������15033624720� 7074� �����������������������������������������������������������������������������������������������������ustar���root����������������������������wheel������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������db:0:kdb.enter.default>

      run pfs
      db:1:pfs> bt
      Tracing pid 11 tid 100004 td 0xfffff801027e7000
      kdb_enter() at kdb_enter+0x33/frame 0xfffffe002018d660
      panic() at panic+0x43/frame 0xfffffe002018d6c0
      trap_fatal() at trap_fatal+0x40b/frame 0xfffffe002018d720
      calltrap() at calltrap+0x8/frame 0xfffffe002018d720
      --- trap 0x9, rip = 0xffffffff812c1240, rsp = 0xfffffe002018d7f0, rbp = 0xfffffe00d8242d70 ---
      Xprot() at Xprot/frame 0xfffffe00d8242d70
      acpi_cpu_idle() at acpi_cpu_idle+0x2cd/frame 0xfffffe00d8242db0
      cpu_idle_acpi() at cpu_idle_acpi+0x46/frame 0xfffffe00d8242dd0
      cpu_idle() at cpu_idle+0x9d/frame 0xfffffe00d8242df0
      sched_idletd() at sched_idletd+0x546/frame 0xfffffe00d8242ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8242f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8242f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      db:1:pfs>  show registers
      cs                        0x20
      ds                        0x3b
      es                        0x3b
      fs                        0x13
      gs                        0x1b
      ss                        0x28
      rax                       0x12
      rcx         0x8fa326b164538ea3
      rdx                       0x19
      rbx                      0x100
      rsp         0xfffffe002018d538
      rbp         0xfffffe002018d660
      rsi         0xfffffe002018d3f0
      rdi         0xffffffff82740878  vt_conswindow+0x10
      r8                           0
      r9                           0
      r10                          0
      r11         0xfffffe002018d180
      r12                          0
      r13                          0
      r14         0xffffffff8145d99f
      r15         0xfffff801027e7000
      rip         0xffffffff80d457b3  kdb_enter+0x33
      rflags                    0x82
      kdb_enter+0x33: movq    $0,0x1d76cd2(%rip)
      db:1:pfs>  show pcpu
      cpuid        = 1
      dynamic pcpu = 0xfffffe009db675c0
      curthread    = 0xfffff801027e7000: pid 11 tid 100004 critnest 2 "idle: cpu1"
      curpcb       = 0xfffff801027e7520
      fpcurthread  = none
      idlethread   = 0xfffff801027e7000: tid 100004 "idle: cpu1"
      self         = 0xffffffff83a11000
      curpmap      = 0xffffffff82a60710
      tssp         = 0xffffffff83a11384
      rsp0         = 0xfffffe00d8243000
      kcr3         = 0xffffffffffffffff
      ucr3         = 0xffffffffffffffff
      scr3         = 0x0
      gs32p        = 0xffffffff83a11404
      ldt          = 0xffffffff83a11444
      tss          = 0xffffffff83a11434
      curvnet      = 0
      db:1:pfs>  run lockinfo
      db:2:lockinfo> show locks
      No such command; use "help" to list available commands
      db:2:lockinfo>  show alllocks
      No such command; use "help" to list available commands
      db:2:lockinfo>  show lockedvnods
      Locked vnodes
      db:1:pfs>  acttrace
      
      Tracing command idle pid 11 tid 100004 td 0xfffff801027e7000 (CPU 1)
      kdb_enter() at kdb_enter+0x33/frame 0xfffffe002018d660
      panic() at panic+0x43/frame 0xfffffe002018d6c0
      trap_fatal() at trap_fatal+0x40b/frame 0xfffffe002018d720
      calltrap() at calltrap+0x8/frame 0xfffffe002018d720
      --- trap 0x9, rip = 0xffffffff812c1240, rsp = 0xfffffe002018d7f0, rbp = 0xfffffe00d8242d70 ---
      Xprot() at Xprot/frame 0xfffffe00d8242d70
      acpi_cpu_idle() at acpi_cpu_idle+0x2cd/frame 0xfffffe00d8242db0
      cpu_idle_acpi() at cpu_idle_acpi+0x46/frame 0xfffffe00d8242dd0
      cpu_idle() at cpu_idle+0x9d/frame 0xfffffe00d8242df0
      sched_idletd() at sched_idletd+0x546/frame 0xfffffe00d8242ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8242f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8242f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command haproxy pid 6119 tid 167231 td 0xfffff80070e17740 (CPU 0)
      cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff82b28070
      ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff82b28080
      nmi_handle_intr() at nmi_handle_intr+0x12/frame 0xffffffff82b280b0
      nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff82b280b0
      --- trap 0x13, rip = 0x58de81, rsp = 0x8213913c0, rbp = 0x821391410 ---
      db:1:pfs>  ps
        pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
      42626 47546    22     0  S       nanslp  0xffffffff82aa39e1  sleep
      17477     1 17477    59  Ss      (threaded)                  unbound
      100463                   S       kqread  0xfffff8040de4d700  unbound
      275874                   S       kqread  0xfffff80289848200  unbound
       6119     1  6119    80  Rs      CPU 0                       haproxy
      21633     1 21633   136  Ss      select  0xfffff800070278c0  dhcpd
      63650 63111 63650     0  S+      ttyin   0xfffff8000b99f0b0  sh
      63111 63087 63111     0  S+      wait    0xfffffe00c72c65a0  sh
      63087     1 63087     0  Ss+     wait    0xfffffe00c720a040  login
      80616   438   438     0  S       accept  0xfffff8000bba1610  php-fpm
      69713   438   438     0  S       (threaded)                  php-fpm
      100235                   S       accept  0xfffff8000bba1610  php-fpm
      27781     1 27781     0  Ss+     ttyin   0xfffff8000b92d8b0  getty
      27650     1 27650     0  Ss+     ttyin   0xfffff8000b92c0b0  getty
      27424     1 27424     0  Ss+     ttyin   0xfffff8000b92c8b0  getty
      27086     1 27086     0  Ss+     ttyin   0xfffff8000b92b0b0  getty
      27045     1 27045     0  Ss+     ttyin   0xfffff8000b92b8b0  getty
      26940     1 26940     0  Ss+     ttyin   0xfffff8000b92a0b0  getty
      26753     1 26753     0  Ss+     ttyin   0xfffff8000b92a8b0  getty
       2963     1   438     0  S       select  0xfffff8000b811840  tail_pfb
       1933     1   438     0  S       piperd  0xfffffe00e308dcc0  php_pfb
       1616     1   438     0  S       kqread  0xfffff80007f02900  tail_pfb
      90701     1 90461     0  S       kqread  0xfffff8026c7b4700  lighttpd_pfb
      82033 81280 80939   122  S       select  0xfffff8000701d240  zabbix_agentd
      81864 81280 80939   122  S       select  0xfffff80007034cc0  zabbix_agentd
      81741 81280 80939   122  S       select  0xfffff8000b8e7e40  zabbix_agentd
      81496 81280 80939   122  S       nanslp  0xffffffff82aa39e1  zabbix_agentd
      81280     1 80939   122  S       wait    0xfffffe00c72d0000  zabbix_agentd
      30085     1 29767   558  S       select  0xfffff8000700f840  avahi-daemon
      29236     1   438     0  S       select  0xfffff8000701f440  udpbroadcastrelay
      28773     1   438     0  S       select  0xfffff80007020f40  udpbroadcastrelay
      92565 92250 92250     0  S       nanslp  0xffffffff82aa39e0  minicron
      92250     1 92250     0  Ss      wait    0xfffffe00c72bc560  minicron
      92091 91912 91912     0  S       nanslp  0xffffffff82aa39e1  minicron
      91912     1 91912     0  Ss      wait    0xfffffe00c72c1020  minicron
      91712 91208 91208     0  S       nanslp  0xffffffff82aa39e0  minicron
      91208     1 91208     0  Ss      wait    0xfffffe00c72b3ae0  minicron
      91094 91035 91035     0  S       nanslp  0xffffffff82aa39e1  minicron
      91035     1 91035     0  Ss      wait    0xfffffe00c72aeac0  minicron
      13092     1 13092     0  Ss      select  0xfffff8000b811040  sshg-parser
      11944     1  8547     0  S       select  0xfffff8000b8110c0  tail
      10518  9385  8547     0  S       piperd  0xfffffe00e31a7cc0  sh
      10416     1 10416     0  Ss      select  0xfffff800070177c0  sshg-blocker
       9385  8816  8547     0  S       wait    0xfffffe00c7204000  sh
       9149  8816  8547     0  S       (threaded)                  sshg-blocker
      100202                   S       piperd  0xfffffe00e31a7700  sshg-blocker
      100430                   S       nanslp  0xffffffff82aa39e0  sshg-blocker
       9017  8816  8547     0  S       piperd  0xfffffe00e2b762e0  sshg-parser
       9016  8816  8547     0  S       kqread  0xfffff8000b798300  tail
       8816  8547  8547     0  S       wait    0xfffffe00c72bf5c0  sh
       8547     1  8547     0  Ss      kqread  0xfffff8000b7ace00  daemon
       7514     1  7514     0  Ss      select  0xfffff800071d8040  syslogd
       7491     1  7155     0  S       select  0xfffff800071d95c0  syslogd
       7155     1  7155     0  Rs                                  syslogd
      47546     1    22     0  S+      wait    0xfffffe00c72bf060  sh
      31136     1 31136     0  Ss      select  0xfffff800071f08c0  bsnmpd
      79391 78945 78945     0  S       kqread  0xfffff8000b7b7000  nginx
      79167 78945 78945     0  S       kqread  0xfffff8026c2bb400  nginx
      78945     1 78945     0  Ss      pause   0xfffffe00c72c0610  nginx
      56953     1 56953     0  Ss      (threaded)                  ntpd
      100226                   S       select  0xfffff8000701f640  ntpd
      60728     1 60728     0  Ss      nanslp  0xffffffff82aa39e1  cron
      49206     1 49206     0  Ss      (threaded)                  dpinger
      100361                   S       uwait   0xfffff80007008c00  dpinger
      100378                   S       sbwait  0xfffff800071fc60c  dpinger
      100379                   S       nanslp  0xffffffff82aa39e0  dpinger
      100380                   S       nanslp  0xffffffff82aa39e1  dpinger
      100381                   S       accept  0xfffff8000b5dae10  dpinger
      48563     1 48563     0  Ss      (threaded)                  dpinger
      100316                   S       uwait   0xfffff800071f0e00  dpinger
      100374                   S       sbwait  0xfffff8000b5fea0c  dpinger
      100375                   S       nanslp  0xffffffff82aa39e1  dpinger
      100376                   S       nanslp  0xffffffff82aa39e1  dpinger
      100377                   S       accept  0xfffff8000b9f8a10  dpinger
      91406     1 91406     0  Ss      select  0xfffff80007039dc0  sshd
      51347   438   438     0  S       (threaded)                  php-fpm
      100221                   S       accept  0xfffff8000bba1610  php-fpm
      64580     1 64580     0  Ss      bpf     0xfffff8000ba6da00  filterlog
      59210     1 59210    65  Ss      select  0xfffff80007026440  dhclient
      48953     1 48953     0  Ss      select  0xfffff800070266c0  dhclient
      47690     1 47690     0  Ss      select  0xfffff80007026540  dhclient
      46426     1 46426    65  Ss      select  0xfffff8000701d9c0  dhclient
      37743     1 37743     0  Ss      select  0xfffff8000701f8c0  dhclient
      36503     1 36503     0  Ss      select  0xfffff80007016340  dhclient
       6196     1  6196     0  Ss      (threaded)                  qemu-ga
      100206                   S       select  0xfffff8000b817a40  qemu-ga
      100210                   S       uwait   0xfffff800071f5c00  qemu-ga
        728     1   728     0  Ss      select  0xfffff800070555c0  devd
        513   511   511     0  S       kqread  0xfffff800071c9e00  check_reload_status
        511     1   511     0  Ss      kqread  0xfffff8000b7b2d00  check_reload_status
        440   438   438     0  S       (threaded)                  php-fpm
      100198                   S       accept  0xfffff8000bba1610  php-fpm
        439   438   438     0  S       accept  0xfffff8000bba1610  php-fpm
        438     1   438     0  Ss      kqread  0xfffff8000b7aa500  php-fpm
         21     0     0     0  DL      aldslp  0xffffffff82a609b8  [ALQ Daemon]
         20     0     0     0  DL      syncer  0xffffffff82add868  [syncer]
         19     0     0     0  DL      vlruwt  0xfffffe00c720b060  [vnlru]
         18     0     0     0  DL      (threaded)                  [bufdaemon]
      100167                   D       psleep  0xffffffff82adc888  [bufdaemon]
      100173                   D       -       0xffffffff82602100  [bufspacedaemon-0]
      100174                   D       -       0xffffffff82602380  [bufspacedaemon-1]
      100175                   D       -       0xffffffff82602600  [bufspacedaemon-2]
      100176                   D       -       0xffffffff82602880  [bufspacedaemon-3]
      100177                   D       -       0xffffffff82602b00  [bufspacedaemon-4]
      100178                   D       -       0xffffffff82602d80  [bufspacedaemon-5]
      100179                   D       -       0xffffffff82603000  [bufspacedaemon-6]
      100184                   D       sdflush 0xfffff800045a68e8  [/ worker]
         17     0     0     0  DL      psleep  0xffffffff82b145f8  [vmdaemon]
          9     0     0     0  DL      (threaded)                  [pagedaemon]
      100165                   D       psleep  0xffffffff82afab38  [dom0]
      100171                   D       launds  0xffffffff82afab44  [laundry: dom0]
      100172                   D       umarcl  0xffffffff81174e70  [uma]
          8     0     0     0  DL      -       0xffffffff828a4730  [rand_harvestq]
          7     0     0     0  DL      pftm    0xffffffff80fcbee0  [pf purge]
          5     0     0     0  DL      -       0xffffffff827f57b0  [busdma]
         16     0     0     0  DL      (threaded)                  [usb]
      100050                   D       -       0xfffffe0020599dc8  [usbus0]
      100051                   D       -       0xfffffe0020599e20  [usbus0]
      100052                   D       -       0xfffffe0020599e78  [usbus0]
      100053                   D       -       0xfffffe0020599ed0  [usbus0]
      100054                   D       -       0xfffffe0020599f28  [usbus0]
      100056                   D       -       0xfffffe00d8d3fdc8  [usbus1]
      100057                   D       -       0xfffffe00d8d3fe20  [usbus1]
      100058                   D       -       0xfffffe00d8d3fe78  [usbus1]
      100059                   D       -       0xfffffe00d8d3fed0  [usbus1]
      100060                   D       -       0xfffffe00d8d3ff28  [usbus1]
      100062                   D       -       0xfffffe00d8ed5dc8  [usbus2]
      100063                   D       -       0xfffffe00d8ed5e20  [usbus2]
      100064                   D       -       0xfffffe00d8ed5e78  [usbus2]
      100065                   D       -       0xfffffe00d8ed5ed0  [usbus2]
      100066                   D       -       0xfffffe00d8ed5f28  [usbus2]
      100068                   D       -       0xfffffe00d906bcf0  [usbus3]
      100069                   D       -       0xfffffe00d906bd48  [usbus3]
      100070                   D       -       0xfffffe00d906bda0  [usbus3]
      100071                   D       -       0xfffffe00d906bdf8  [usbus3]
      100072                   D       -       0xfffffe00d906be50  [usbus3]
      100074                   D       -       0xfffffe00d91fedc8  [usbus4]
      100075                   D       -       0xfffffe00d91fee20  [usbus4]
      100076                   D       -       0xfffffe00d91fee78  [usbus4]
      100077                   D       -       0xfffffe00d91feed0  [usbus4]
      100078                   D       -       0xfffffe00d91fef28  [usbus4]
      100079                   D       -       0xfffffe00d939edc8  [usbus5]
      100080                   D       -       0xfffffe00d939ee20  [usbus5]
      100081                   D       -       0xfffffe00d939ee78  [usbus5]
      100082                   D       -       0xfffffe00d939eed0  [usbus5]
      100083                   D       -       0xfffffe00d939ef28  [usbus5]
      100084                   D       -       0xfffffe00c7534dc8  [usbus6]
      100085                   D       -       0xfffffe00c7534e20  [usbus6]
      100086                   D       -       0xfffffe00c7534e78  [usbus6]
      100087                   D       -       0xfffffe00c7534ed0  [usbus6]
      100088                   D       -       0xfffffe00c7534f28  [usbus6]
      100089                   D       -       0xfffffe00c76cacf0  [usbus7]
      100090                   D       -       0xfffffe00c76cad48  [usbus7]
      100091                   D       -       0xfffffe00c76cada0  [usbus7]
      100092                   D       -       0xfffffe00c76cadf8  [usbus7]
      100093                   D       -       0xfffffe00c76cae50  [usbus7]
          4     0     0     0  DL      (threaded)                  [cam]
      100047                   D       -       0xffffffff82855240  [doneq0]
      100048                   D       -       0xffffffff828551c0  [async]
      100162                   D       -       0xffffffff82855090  [scanner]
          3     0     0     0  DL      (threaded)                  [crypto]
      100044                   D       crypto_ 0xffffffff82af8140  [crypto]
      100045                   D       crypto_ 0xfffff80004581c30  [crypto returns 0]
      100046                   D       crypto_ 0xfffff80004581c80  [crypto returns 1]
         15     0     0     0  DL      seqstat 0xfffff8000457e488  [sequencer 00]
         14     0     0     0  DL      (threaded)                  [geom]
      100037                   D       -       0xffffffff82a5f3c8  [g_event]
      100038                   D       -       0xffffffff82a5f3d0  [g_up]
      100039                   D       -       0xffffffff82a5f3d8  [g_down]
         13     0     0     0  DL      (threaded)                  [ng_queue]
      100034                   D       sleep   0xffffffff8279db50  [ng_queue0]
      100035                   D       sleep   0xffffffff8279db50  [ng_queue1]
          2     0     0     0  WL      (threaded)                  [clock]
      100030                   I                                   [clock (0)]
      100031                   I                                   [clock (1)]
         12     0     0     0  WL      (threaded)                  [intr]
      100012                   I                                   [swi6: task queue]
      100013                   I                                   [swi6: Giant taskq]
      100015                   I                                   [swi5: fast taskq]
      100032                   I                                   [swi1: netisr 0]
      100033                   I                                   [swi1: netisr 1]
      100049                   I                                   [irq16: uhci0 uhci3+]
      100055                   I                                   [irq17: uhci1 uhci4]
      100061                   I                                   [irq18: uhci2 uhci5]
      100067                   I                                   [irq19: ehci0 ehci1]
      100073                   I                                   [irq24: hdac0]
      100094                   I                                   [irq25: virtio_pci0]
      100095                   I                                   [irq26: virtio_pci0]
      100096                   I                                   [irq27: virtio_pci1]
      100097                   I                                   [irq28: virtio_pci1]
      100098                   I                                   [irq29: virtio_pci2]
      100099                   I                                   [irq30: virtio_pci2]
      100100                   I                                   [irq31: virtio_pci2]
      100103                   I                                   [irq32: virtio_pci3]
      100104                   I                                   [irq33: virtio_pci3]
      100105                   I                                   [irq34: virtio_pci3]
      100108                   I                                   [irq35: virtio_pci4]
      100109                   I                                   [irq36: virtio_pci4]
      100110                   I                                   [irq37: virtio_pci4]
      100113                   I                                   [irq38: virtio_pci5]
      100114                   I                                   [irq39: virtio_pci5]
      100115                   I                                   [irq40: virtio_pci5]
      100118                   I                                   [irq41: ahci0]
      100120                   I                                   [irq1: atkbd0]
      100121                   I                                   [irq12: psm0]
      100154                   I                                   [swi1: pf send]
      100155                   I                                   [swi1: pfsync]
         11     0     0     0  RL      (threaded)                  [idle]
      100003                   CanRun                              [idle: cpu0]
      100004                   Run     CPU 1                       [idle: cpu1]
          1     0     1     0  SLs     wait    0xfffffe00c7202040  [init]
         10     0     0     0  DL      audit_w 0xffffffff82af8630  [audit]
          0     0     0     0  DLs     (threaded)                  [kernel]
      100000                   D       parked  0xffffffff8388aff0  [swapper]
      100005                   D       -       0xfffff800041cd200  [softirq_0]
      100006                   D       -       0xfffff800041cd000  [softirq_1]
      100007                   D       -       0xfffff800041ccd00  [if_io_tqg_0]
      100008                   D       -       0xfffff800041ccb00  [if_io_tqg_1]
      100009                   D       -       0xfffff800041cc900  [if_config_tqg_0]
      100010                   D       -       0xfffff800041cc700  [pci_hp taskq]
      100011                   D       -       0xfffff800041cc500  [kqueue_ctx taskq]
      100014                   D       -       0xfffff80004344100  [thread taskq]
      100016                   D       -       0xfffff80004345b00  [aiod_kick taskq]
      100017                   D       -       0xfffff80004345900  [deferred_unmount ta]
      100018                   D       -       0xfffff80004345700  [inm_free taskq]
      100019                   D       -       0xfffff80004345500  [in6m_free taskq]
      100020                   D       -       0xfffff80004345300  [linuxkpi_irq_wq]
      100021                   D       -       0xfffff80004345100  [linuxkpi_short_wq_0]
      100022                   D       -       0xfffff80004345100  [linuxkpi_short_wq_1]
      100023                   D       -       0xfffff80004345100  [linuxkpi_short_wq_2]
      100024                   D       -       0xfffff80004345100  [linuxkpi_short_wq_3]
      100025                   D       -       0xfffff80004346b00  [linuxkpi_long_wq_0]
      100026                   D       -       0xfffff80004346b00  [linuxkpi_long_wq_1]
      100027                   D       -       0xfffff80004346b00  [linuxkpi_long_wq_2]
      100028                   D       -       0xfffff80004346b00  [linuxkpi_long_wq_3]
      100036                   D       -       0xfffff80004347a00  [firmware taskq]
      100040                   D       -       0xfffff800041d0300  [t4_rst_thr]
      100042                   D       -       0xfffff80004580100  [crypto_0]
      100043                   D       -       0xfffff80004580100  [crypto_1]
      100101                   D       -       0xfffff800043f9c00  [vtnet0 rxq 0]
      100102                   D       -       0xfffff800043f9b00  [vtnet0 txq 0]
      100106                   D       -       0xfffff800043fad00  [vtnet1 rxq 0]
      100107                   D       -       0xfffff800043fac00  [vtnet1 txq 0]
      100111                   D       -       0xfffff80004460e00  [vtnet2 rxq 0]
      100112                   D       -       0xfffff80004460d00  [vtnet2 txq 0]
      100116                   D       -       0xfffff80004850400  [vtnet3 rxq 0]
      100117                   D       -       0xfffff80004850300  [vtnet3 txq 0]
      100152                   D       -       0xfffff800071ca600  [ip_mroute_tskq task]
      100156                   D       -       0xfffff8000b936100  [acpi_task_0]
      100157                   D       -       0xfffff8000b936100  [acpi_task_1]
      100158                   D       -       0xfffff8000b936100  [acpi_task_2]
      100160                   D       -       0xfffff800041cf400  [mca taskq]
      100161                   D       -       0xfffff80004581200  [CAM taskq]
      100163                   D       -       0xfffff800071c8c00  [mlx4]
      100164                   D       -       0xfffff800071c8800  [ipsec_offload]
      100260                   D       -       0xfffff80007de0000  [dummynet]
      100406                   D       -       0xfffff8028a616100  [netlink_socket (PID]
      db:1:pfs>  alltrace
      
      Tracing command kernel pid 0 tid 100000 td 0xffffffff82a5fec0
      sched_switch() at sched_switch+0x829/frame 0xffffffff8388af00
      mi_switch() at mi_switch+0xbc/frame 0xffffffff8388af20
      _sleep() at _sleep+0x19e/frame 0xffffffff8388afa0
      mi_startup() at mi_startup+0x253/frame 0xffffffff8388aff0
      
      Tracing command kernel pid 0 tid 100005 td 0xfffff801027e6740
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d823de50
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d823de70
      msleep_spin_sbt() at msleep_spin_sbt+0x18e/frame 0xfffffe00d823dec0
      gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00d823def0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d823df30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d823df30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100006 td 0xfffff801027e6000
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8238e50
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8238e70
      msleep_spin_sbt() at msleep_spin_sbt+0x18e/frame 0xfffffe00d8238ec0
      gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00d8238ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8238f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8238f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100007 td 0xfffff801027e5740
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8233e50
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8233e70
      msleep_spin_sbt() at msleep_spin_sbt+0x18e/frame 0xfffffe00d8233ec0
      gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00d8233ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8233f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8233f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100008 td 0xfffff801027e5000
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d822ee50
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d822ee70
      msleep_spin_sbt() at msleep_spin_sbt+0x18e/frame 0xfffffe00d822eec0
      gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00d822eef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d822ef30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d822ef30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100009 td 0xfffff801027f8740
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8229e50
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8229e70
      msleep_spin_sbt() at msleep_spin_sbt+0x18e/frame 0xfffffe00d8229ec0
      gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00d8229ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8229f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8229f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100010 td 0xfffff801027f8000
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8224e20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8224e40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d8224ec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d8224ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8224f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8224f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100011 td 0xfffff801027f7740
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d821fe20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d821fe40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d821fec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d821fef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d821ff30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d821ff30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100014 td 0xfffff801027f6000
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8210e20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8210e40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d8210ec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d8210ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8210f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8210f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100016 td 0xfffff801027f5000
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8206e20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8206e40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d8206ec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d8206ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8206f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8206f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100017 td 0xfffff801027fc740
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d82a1e20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d82a1e40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d82a1ec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d82a1ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d82a1f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d82a1f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100018 td 0xfffff801027fc000
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d829ce20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d829ce40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d829cec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d829cef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d829cf30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d829cf30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100019 td 0xfffff801027fb740
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8297e20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8297e40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d8297ec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d8297ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8297f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8297f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100020 td 0xfffff801027fb000
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8292e50
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8292e70
      msleep_spin_sbt() at msleep_spin_sbt+0x18e/frame 0xfffffe00d8292ec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00d8292ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8292f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8292f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100021 td 0xfffff801027fa740
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d828de20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d828de40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d828dec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d828def0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d828df30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d828df30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      Tracing command kernel pid 0 tid 100022 td 0xfffff801027fa000
      sched_switch() at sched_switch+0x829/frame 0xfffffe00d8288e20
      mi_switch() at mi_switch+0xbc/frame 0xfffffe00d8288e40
      _sleep() at _sleep+0x19e/frame 0xfffffe00d8288ec0
      taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d8288ef0
      fork_exit() at fork_exit+0x7b/frame 0xfffffe00d8288f30
      fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d8288f30
      --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
      
      1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by

        Do you have the other crash reports? Do they all show identical backtraces?

        That one doesn't really show anything very specific.

        C 1 Reply Last reply Reply Quote 0
        • C
          cryptonym @stephenw10
          last edited by

          @stephenw10 unfortunately I had not saved those off but to me as I recall they were same.

          In the mean time I built a new instance with 2.8 instead of upgrading old and built it on the OMV UEFI instead of bios. Fingers crossed.

          If it dumps again I will use both logs next post.

          Thanks.

          1 Reply Last reply Reply Quote 1
          • First post
            Last post
          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.