Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    APU1C Kernel Panic

    Scheduled Pinned Locked Moved Hardware
    16 Posts 5 Posters 5.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • S
      Stewart
      last edited by

      It's the only thing that's custom and not some form of stock, but they are just netstat commands from what I recall but I'll post more tomorrow once I have a chance to check the script.

      1 Reply Last reply Reply Quote 0
      • C
        cmb
        last edited by

        It'd probably be the changing of the LEDs rather than anything to do with obtaining the NIC status (as anything you could do there would be widely touched by our code, so unlikely there is anything there that's touchy), though I guess either/or is possible.

        1 Reply Last reply Reply Quote 0
        • ?
          Guest
          last edited by

          it might be a FreeBSD 10 compatibility thing.

          Did you install the latest BIOS file on the APU1C?
          There are 4 different versions available!

          I've searched and haven't found any mention of this anywhere else

          It might be sounding a little bit strange to you, but it is not meant in this way, if
          the APU1C has only a so short live time and was be set then to the status of EoL (End of Live)
          please be sure there was "anything" that was not matching well.

          so I'm hoping someone could help out.

          What is about a full install on a mSATA without using the SD card slot or putting a empty 4 GB
          SD card inside of the APU1C.

          Any idea where to start?

          I would prefer to do a fresh install and start from scratch.

          • BIOS update
          • full install on mSATA
          • SD card slot empty or with a empty 4 GB model
          1 Reply Last reply Reply Quote 0
          • S
            Stewart
            last edited by

            @cmb:

            It'd probably be the changing of the LEDs rather than anything to do with obtaining the NIC status (as anything you could do there would be widely touched by our code, so unlikely there is anything there that's touchy), though I guess either/or is possible.

            So here's the code.  Let me know if you see anything that would cause a problem.

            #Set device IDs
            set wan=re1
            set lan=re2
            set led="/dev/gpioapu"
            
            #Set starting conditions
            set wanStart=`netstat -I ${wan} -nWb -f link | tail -1 | awk '{print $8}'`
            set lanStart=`netstat -I ${lan} -nWb -f link | tail -1 | awk '{print $8}'`
            set wanCurrent=0
            set lanCurrent=0
            
            #Initialize LED status
            set powerStatus=1
            set wanStatus=1
            set lanStatus=1
            
            #start loop
            while ( 1 )
            sleep 5
                    #poll and test WAN
                    if ( `ifconfig ${wan} | grep status | awk '{print $2}'` == "no") then
                            set wanStatus=0
                    else
                            set wanCurrent=`netstat -I ${wan} -nWb -f link | tail -1 | awk '{print $8}'`
                            if ( $wanCurrent != $wanStart ) then
                                    set wanStatus=0
                                    #echo "WAN Update: $wanStatus"
                                    echo "$powerStatus$wanStatus$lanStatus" > "$led"
                                    sleep .2
                                    set wanStatus=1
                            endif
                            echo "$powerStatus$wanStatus$lanStatus" > "$led"
                            set wanStart=${wanCurrent}
                    endif
            
                    #poll and test LAN
                    if ( `ifconfig ${lan} | grep status | awk '{print $2}'` == "no") then
                            set lanStatus=0
                    else
                            set lanCurrent=`netstat -I ${lan} -nWb -f link | tail -1 | awk '{print $8}'`
                            if ( $lanCurrent != $lanStart ) then
                                    set lanStatus=0
                                    #echo "LAN Update: $lanStatus"
                                    echo "$powerStatus$wanStatus$lanStatus" > "$led"
                                    sleep .2
                                    set lanStatus=1
                            endif
                            echo "$powerStatus$wanStatus$lanStatus" > "$led"
                            set lanStart=${lanCurrent}
                    endif
            end
            
            
            1 Reply Last reply Reply Quote 0
            • S
              Stewart
              last edited by

              @BlueKobold:

              Did you install the latest BIOS file on the APU1C?
              There are 4 different versions available!

              I have not.  I can if I need to and I've been communicating with the vendor.  The BIOS I have is current, but not the latest.

              @BlueKobold:

              It might be sounding a little bit strange to you, but it is not meant in this way, if
              the APU1C has only a so short live time and was be set then to the status of EoL (End of Live)
              please be sure there was "anything" that was not matching well.

              The APU1C was replaced by the APU1D which is essentially the same thing.  If you look at the 2 boards, you can't even tell a difference.  They even use the same BIOS.

              @BlueKobold:

              What is about a full install on a mSATA without using the SD card slot or putting a empty 4 GB
              SD card inside of the APU1C.

              We are looking to upgrade a bunch of devices.  They are designed around the SD card so I'd like to keep it that way.

              @BlueKobold:

              I would prefer to do a fresh install and start from scratch.

              • BIOS update
              • full install on mSATA
              • SD card slot empty or with a empty 4 GB model

              All viable, but I was hoping to know what the error was so I could avoid the problem.  I'm willing to do a reinstall but since this appears to be a panic, I was hoping to know what was crashing the boxes.

              1 Reply Last reply Reply Quote 0
              • D
                doktornotor Banned
                last edited by

                Why don't use just STOP messing with the LEDs since that's already been suggested - and see how it goes? I mean, it absolutely is NOT needed for anything and takes about half minute to set up.

                1 Reply Last reply Reply Quote 0
                • S
                  Stewart
                  last edited by

                  @doktornotor:

                  Why don't use just STOP messing with the LEDs since that's already been suggested - and see how it goes? I mean, it absolutely is NOT needed for anything and takes about half minute to set up.

                  Thanks so much for the insight!  I have disabled that script and I'll follow up if I find out more, but if running netstat or outputting to the LEDs can randomly cause the OS to Panic under FreeBSD10 when it didn't under FreeBSD8 then wouldn't that be a useful thing to know?  I've put up the script so that others can look and maybe find the cause.  If not, maybe this crops up later for someone else under different circumstances and it helps them diagnose their problem.  CMB suggested maybe it was my script, a valid suggestion, so I said I would post the script for review.  I believe that's a valid response.  We are, after all, a community with some give and take.

                  Let me know if you come up with anything else.  Really appreciate the help.

                  1 Reply Last reply Reply Quote 0
                  • D
                    doktornotor Banned
                    last edited by

                    Yes of course it would be useful to fix that if that's the case; but – to test that, you still need to stop filling with those and see if it makes the issue go away. If it doesn't, we've been chasing ghosts there and can move to something else.

                    1 Reply Last reply Reply Quote 0
                    • C
                      cmb
                      last edited by

                      It'll be useful to know regardless of the end result as there's clearly a FreeBSD bug there somewhere, just need you to narrow down where it is. Removing that script completely and seeing what happens is the best place to start. Then if that doesn't crash, put the script back, but remove the part that changes the LEDs.

                      1 Reply Last reply Reply Quote 0
                      • S
                        Stewart
                        last edited by

                        @cmb:

                        It'll be useful to know regardless of the end result as there's clearly a FreeBSD bug there somewhere, just need you to narrow down where it is. Removing that script completely and seeing what happens is the best place to start. Then if that doesn't crash, put the script back, but remove the part that changes the LEDs.

                        Since the problem seems so intermittent, there may be long gaps in my responses here but I'll let you know when I have more info.

                        1 Reply Last reply Reply Quote 0
                        • S
                          Stewart
                          last edited by

                          It happened again without the blinkLED script running.  I had the serial cable in when I issued a reboot.  Here's more of the code.  It only seemed to flow for a couple of minutes so I'm not sure if it's a kernel panic or not or exactly what it is.  It normally doesn't happen but it just seems off…

                          
                          100190                   S       uwait    0xfffff8000b024200 c-icap
                          100189                   S       uwait    0xfffff8000b01fd00 c-icap
                          100188                   S       uwait    0xfffff8000a487100 c-icap
                          100187                   S       uwait    0xfffff8000b137000 c-icap
                          100186                   S       uwait    0xfffff8000a380900 c-icap
                          100184                   S       uwait    0xfffff8000a380b80 c-icap
                          100182                   S       uwait    0xfffff8000a380500 c-icap
                          100178                   S       uwait    0xfffff8000a380800 c-icap
                          100084                   S       select   0xfffff8000a316340 c-icap
                          54725 54229 54229     0  RL      (threaded)                  c-icap
                          100185                   RunQ                                c-icap
                          100183                   S       uwait    0xfffff8000b012e00 c-icap
                          100181                   S       uwait    0xfffff8000b012880 c-icap
                          100180                   S       uwait    0xfffff8000b012680 c-icap
                          100179                   S       uwait    0xfffff8000b134e80 c-icap
                          100177                   S       uwait    0xfffff8000a380b00 c-icap
                          100176                   S       uwait    0xfffff8000b135a80 c-icap
                          100175                   S       uwait    0xfffff8000b135980 c-icap
                          100174                   S       uwait    0xfffff8000b135880 c-icap
                          100173                   S       uwait    0xfffff8000b135780 c-icap
                          100172                   S       uwait    0xfffff8000b135680 c-icap
                          100122                   S       select   0xfffff8000a315140 c-icap
                          54557 54229 54229     0  S       (threaded)                  c-icap
                          100203                   S       uwait    0xfffff8000b012c80 c-icap
                          100202                   S       uwait    0xfffff8000b012b80 c-icap
                          100201                   S       uwait    0xfffff8000a37fc00 c-icap
                          100200                   S       uwait    0xfffff8000a42bf00 c-icap
                          100199                   S       uwait    0xfffff8000b135080 c-icap
                          100198                   S       uwait    0xfffff8000b013500 c-icap
                          100197                   S       uwait    0xfffff8000b134f00 c-icap
                          100196                   S       uwait    0xfffff8000a382180 c-icap
                          100195                   S       uwait    0xfffff8000b134c00 c-icap
                          100194                   S       uwait    0xfffff8000b134980 c-icap
                          100109                   S       select   0xfffff8000a4871c0 c-icap
                          54229     1 54229     0  Ss      nanslp   0xffffffff81f6e070 c-icap
                          47926     1 47926     0  REs     CPU 0                       ntpd
                          34603 34295   277     0  LL     *vm objec 0xfffff8000a3bed80 bandwidthd
                          34398 34295   277     0  RL                                  bandwidthd
                          34361 34295   277     0  RL                                  bandwidthd
                          34295     1   277     0  RL      CPU 1                       bandwidthd
                          33901 33508   277     0  RL                                  bandwidthd
                          33885 33508   277     0  RL                                  bandwidthd
                          33555 33508   277     0  RL                                  bandwidthd
                          33508     1   277     0  RL                                  bandwidthd
                          19003     1 19003     0  REs                                 syslogd
                           4779     1  4779     0  REs                                 powerd
                          97873 70713 70404    62  RE                                  pinger
                          75510 70713 70404    62  RE                                  squidGuard
                          75080 70713 70404    62  RE                                  squidGuard
                          74600 70713 70404    62  RE                                  squidGuard
                          74520 70713 70404    62  RE                                  squidGuard
                          74068 70713 70404    62  RE                                  squidGuard
                          73166 70713 70404    62  LE     *vm objec 0xfffff8000a3bed80 squidGuard
                          72471 70713 70404    62  RE                                  squidGuard
                          70713 70404 70404    62  RL                                  squid
                          70404     1 70404    62  REs                                 squid
                          61673     1 61673     0  RLs                                 bsnmpd
                          56265     1 56265  1002  REs                                 dhcpd
                          49671     1 49671    59  RLs     (threaded)                  unbound
                          100123                   S       kqread   0xfffff8000a378000 unbound
                          100102                   RunQ                                unbound
                          47535     1 47535     0  REs                                 cron
                          46912     1 46885     0  RL                                  lighttpd
                          40113 40092 40092     0  RE                                  rrdtool
                          40092     1 40092     0  Rs                                  apinger
                          37353     1 37353     0  REs                                 inetd
                          35562     1 35562     0  REs                                 filterlog
                          34993     1 34857     0  D       ufs      0xfffff8000a422418 radvd
                          24012     1 24012    65  REs                                 dhclient
                          17973     1 17973     0  REs                                 dhclient
                          16751     1 16751     0  LEs    *vm page  0xfffff8000b94cb40 sshlockout_pf
                          16395     1 16395     0  RLs                                 sshd
                            294   292   292     0  S       kqread   0xfffff80024fe7900 check_reload_status
                            292     1   292     0  Ss      kqread   0xfffff8000a36ce00 check_reload_status
                            277     1   277     0  Ss      kqread   0xfffff8000a378b00 php-fpm
                             52     0     0     0  DL      mdwait   0xfffff8000a2fe000 [md1]
                             47     0     0     0  DL      mdwait   0xfffff8000a2fe800 [md0]
                             20     0     0     0  DL      syncer   0xffffffff81fbf008 [syncer]
                             19     0     0     0  DL      vlruwt   0xfffff8000a30b980 [vnlru]
                             18     0     0     0  DL      psleep   0xffffffff81fbe204 [bufdaemon]
                             17     0     0     0  DL      pgzero   0xffffffff82110f8c [pagezero]
                              9     0     0     0  DL      pollid   0xffffffff81f6c9f0 [idlepoll]
                              8     0     0     0  DL      psleep   0xffffffff821106c0 [vmdaemon]
                              7     0     0     0  DL      psleep   0xffffffff8219c504 [pagedaemon]
                              6     0     0     0  DL      waiting_ 0xffffffff8218cf70 [sctp_iterator]
                              5     0     0     0  DL      pftm     0xffffffff80d0ab90 [pf purge]
                             16     0     0     0  DL      (threaded)                  [usb]
                          100061                   D       -        0xfffffe000097ae18 [usbus6]
                          100060                   D       -        0xfffffe000097adc0 [usbus6]
                          100059                   D       -        0xfffffe000097ad68 [usbus6]
                          100058                   D       -        0xfffffe000097ad10 [usbus6]
                          100057                   D       -        0xfffffe0000985460 [usbus5]
                          100056                   D       -        0xfffffe0000985408 [usbus5]
                          100055                   D       -        0xfffffe00009853b0 [usbus5]
                          100054                   D       -        0xfffffe0000985358 [usbus5]
                          100053                   D       -        0xfffffe0000971460 [usbus4]
                          100052                   D       -        0xfffffe0000971408 [usbus4]
                          100051                   D       -        0xfffffe00009713b0 [usbus4]
                          100050                   D       -        0xfffffe0000971358 [usbus4]
                          100049                   D       -        0xfffffe0000966e18 [usbus3]
                          100048                   D       -        0xfffffe0000966dc0 [usbus3]
                          100047                   D       -        0xfffffe0000966d68 [usbus3]
                          100046                   D       -        0xfffffe0000966d10 [usbus3]
                          100045                   D       -        0xfffffe000095d460 [usbus2]
                          100044                   D       -        0xfffffe000095d408 [usbus2]
                          100043                   D       -        0xfffffe000095d3b0 [usbus2]
                          100042                   D       -        0xfffffe000095d358 [usbus2]
                          100041                   D       -        0xfffffe000092ce18 [usbus1]
                          100040                   D       -        0xfffffe000092cdc0 [usbus1]
                          100039                   D       -        0xfffffe000092cd68 [usbus1]
                          100038                   D       -        0xfffffe000092cd10 [usbus1]
                          100036                   D       -        0xfffffe000091b460 [usbus0]
                          100035                   D       -        0xfffffe000091b408 [usbus0]
                          100034                   D       -        0xfffffe000091b3b0 [usbus0]
                          100033                   D       -        0xfffffe000091b358 [usbus0]
                              4     0     0     0  DL      (threaded)                  [cam]
                          100069                   D       -        0xffffffff81ea6bc0 [scanner]
                          100027                   D       -        0xffffffff81ea6d80 [doneq0]
                              3     0     0     0  DL      crypto_r 0xffffffff8210eb90 [crypto returns]
                              2     0     0     0  DL      crypto_w 0xffffffff8210ea38 [crypto]
                             15     0     0     0  DL      -        0xffffffff81ec4280 [rand_harvestq]
                             14     0     0     0  DL      (threaded)                  [geom]
                          100013                   D       -        0xffffffff82181670 [g_down]
                          100012                   D       -        0xffffffff82181668 [g_up]
                          100011                   D       -        0xffffffff82181660 [g_event]
                             13     0     0     0  DL      (threaded)                  [ng_queue]
                          100010                   D       sleep    0xffffffff81e650b8 [ng_queue1]
                          100009                   D       sleep    0xffffffff81e650b8 [ng_queue0]
                             12     0     0     0  WL      (threaded)                  [intr]
                          100077                   I                                   [swi1: netisr 1]
                          100067                   I                                   [swi1: pfsync]
                          100065                   I                                   [swi1: pf send]
                          100062                   I                                   [swi0: uart uart]
                          100037                   I                                   [irq17: ehci0 ehci1+]
                          100032                   I                                   [irq18: ohci0 ohci1*]
                          100031                   I                                   [irq19: ahci0]
                          100030                   I                                   [irq261: re2]
                          100029                   I                                   [irq260: re1]
                          100028                   I                                   [irq259: re0]
                          100025                   I                                   [swi5: fast taskq]
                          100023                   I                                   [swi6: Giant taskq]
                          100021                   I                                   [swi6: task queue]
                          100008                   I                                   [swi3: vm]
                          100007                   I                                   [swi4: clock]
                          100006                   I                                   [swi4: clock]
                          100005                   I                                   [swi1: netisr 0]
                             11     0     0     0  RL      (threaded)                  [idle]
                          100004                   CanRun                              [idle: cpu1]
                          100003                   CanRun                              [idle: cpu0]
                              1     0     1     0  RLs                                 [init]
                             10     0     0     0  DL      audit_wo 0xffffffff82193af0 [audit]
                              0     0     0     0  DLs     (threaded)                  [kernel]
                          100113                   D       -        0xfffff8000a2ee700 [dummynet]
                          100068                   D       -        0xfffff800032b3000 [CAM taskq]
                          100063                   D       -        0xfffff8000a050e00 [mca taskq]
                          100026                   D       -        0xfffff800032b3200 [kqueue taskq]
                          100024                   D       -        0xfffff800032b3700 [thread]
                          100022                   D       -        0xfffff800032b3c00 [ffs_trim taskq]
                          100020                   D       -        0xfffff800032b4400 [acpi_task_2]
                          100019                   D       -        0xfffff800032b4400 [acpi_task_1]
                          100018                   D       -        0xfffff800032b4400 [acpi_task_0]
                          100014                   D       -        0xfffff800031fa500 [firmware taskq]
                          100000                   D       swapin   0xffffffff82181768 [swapper]
                          95668     1     1     0  Z                                   getty
                            313     1   313     0  Z                                   devd
                          75263 70713 70404    62  Z                                   squidGuard
                           1664     1    21     0  Z+                                  sh
                          60024     1    21     0  Z                                   sleep
                          26064 33508   277     0  Z                                   bandwidthd
                          26121 34295   277     0  Z                                   bandwidthd
                          db:0:kdb.enter.default>  alltrace
                          
                          Tracing command intr pid 12 tid 100005 td 0xfffff8000320c490
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a36db20
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a36db60
                          ithread_loop() at ithread_loop+0x190/frame 0xfffffe001a36dbb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a36dbf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a36dbf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a36dcb0, rbp = 0 ---
                          
                          Tracing command idle pid 11 tid 100004 td 0xfffff8000320c920
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a368ac0
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a368b00
                          sched_idletd() at sched_idletd+0xc9/frame 0xfffffe001a368bb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a368bf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a368bf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a368cb0, rbp = 0 ---
                          
                          Tracing command idle pid 11 tid 100003 td 0xfffff8000320d000
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a363ac0
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a363b00
                          sched_idletd() at sched_idletd+0x3a7/frame 0xfffffe001a363bb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a363bf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a363bf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a363cb0, rbp = 0 ---
                          
                          Tracing command init pid 1 tid 100002 td 0xfffff8000320d490
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001abfb6d0
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001abfb710
                          sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe001abfb790
                          sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe001abfb7c0
                          _sleep() at _sleep+0x27d/frame 0xfffffe001abfb840
                          kern_wait6() at kern_wait6+0x5f4/frame 0xfffffe001abfb8f0
                          sys_wait4() at sys_wait4+0x72/frame 0xfffffe001abfbae0
                          amd64_syscall() at amd64_syscall+0x351/frame 0xfffffe001abfbbf0
                          Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe001abfbbf0
                          --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41397a, rsp = 0x7fffffffe748, rbp = 0x7fffffffe7d0 ---
                          
                          Tracing command audit pid 10 tid 100001 td 0xfffff8000320d920
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001abf6a80
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001abf6ac0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001abf6af0
                          _cv_wait() at _cv_wait+0x16d/frame 0xfffffe001abf6b40
                          audit_worker() at audit_worker+0xa3/frame 0xfffffe001abf6bb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001abf6bf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001abf6bf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001abf6cb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100110 td 0xfffff8000aab6920
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe003609aab0
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe003609aaf0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe003609ab20
                          msleep_spin_sbt() at msleep_spin_sbt+0x1a3/frame 0xfffffe003609ab80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xfd/frame 0xfffffe003609abb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe003609abf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003609abf0
                          --- trap 0, rip = 0, rsp = 0xfffffe003609acb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100068 td 0xfffff8000a295490
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe0035fc7a90
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe0035fc7ad0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe0035fc7b00
                          _sleep() at _sleep+0x287/frame 0xfffffe0035fc7b80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xd5/frame 0xfffffe0035fc7bb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe0035fc7bf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0035fc7bf0
                          --- trap 0, rip = 0, rsp = 0xfffffe0035fc7cb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100063 td 0xfffff8000a037000
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe0035fadab0
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe0035fadaf0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe0035fadb20
                          msleep_spin_sbt() at msleep_spin_sbt+0x1a3/frame 0xfffffe0035fadb80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xfd/frame 0xfffffe0035fadbb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe0035fadbf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0035fadbf0
                          --- trap 0, rip = 0, rsp = 0xfffffe0035fadcb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100026 td 0xfffff800033de490
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a3d6a90
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a3d6ad0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a3d6b00
                          _sleep() at _sleep+0x287/frame 0xfffffe001a3d6b80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xd5/frame 0xfffffe001a3d6bb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a3d6bf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a3d6bf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a3d6cb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100024 td 0xfffff800033df000
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a3cca90
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a3ccad0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a3ccb00
                          _sleep() at _sleep+0x287/frame 0xfffffe001a3ccb80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xd5/frame 0xfffffe001a3ccbb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a3ccbf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a3ccbf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a3cccb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100022 td 0xfffff800033df920
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a3c2a90
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a3c2ad0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a3c2b00
                          _sleep() at _sleep+0x287/frame 0xfffffe001a3c2b80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xd5/frame 0xfffffe001a3c2bb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a3c2bf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a3c2bf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a3c2cb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100020 td 0xfffff800033e0490
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a3b8ab0
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a3b8af0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a3b8b20
                          msleep_spin_sbt() at msleep_spin_sbt+0x1a3/frame 0xfffffe001a3b8b80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xfd/frame 0xfffffe001a3b8bb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a3b8bf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a3b8bf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a3b8cb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100019 td 0xfffff800033e0920
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a3b3ab0
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a3b3af0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a3b3b20
                          msleep_spin_sbt() at msleep_spin_sbt+0x1a3/frame 0xfffffe001a3b3b80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xfd/frame 0xfffffe001a3b3bb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a3b3bf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a3b3bf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a3b3cb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100018 td 0xfffff80003224000
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a3aeab0
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a3aeaf0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a3aeb20
                          msleep_spin_sbt() at msleep_spin_sbt+0x1a3/frame 0xfffffe001a3aeb80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xfd/frame 0xfffffe001a3aebb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a3aebf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a3aebf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a3aecb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100014 td 0xfffff80003225490
                          sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a39aa90
                          mi_switch() at mi_switch+0xe1/frame 0xfffffe001a39aad0
                          sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a39ab00
                          _sleep() at _sleep+0x287/frame 0xfffffe001a39ab80
                          taskqueue_thread_loop() at taskqueue_thread_loop+0xd5/frame 0xfffffe001a39abb0
                          fork_exit() at fork_exit+0x9a/frame 0xfffffe001a39abf0
                          fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a39abf0
                          --- trap 0, rip = 0, rsp = 0xfffffe001a39acb0, rbp = 0 ---
                          
                          Tracing command kernel pid 0 tid 100000 td 0xffffffff82181c30
                          sched_switch() at sched_switch+0x2b3/frame 0xffffffff824deb70
                          mi_switch() at mi_switch+0xe1/frame 0xffffffff824debb0
                          sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xffffffff824debe0
                          _sleep() at _sleep+0x26e/frame 0xffffffff824dec60
                          swapper() at swapper+0x28f/frame 0xffffffff824decb0
                          btext() at btext+0x2c
                          db:0:kdb.enter.default>  capture off
                          db:0:kdb.enter.default>  call doadump
                          = 0x6
                          db:0:kdb.enter.default>  reset
                          PC Engines APU BIOS build date: Apr  5 2014
                          Reading data from file [bootorder]
                          SeaBIOS (version ?-20140405_120742-frink)
                          SeaBIOS (version ?-20140405_120742-frink)
                          Found coreboot cbmem console @ 7e150400
                          Found mainboard PC Engines APU
                          Relocating init from 0x000e8e71 to 0x7e1065e0 (size 39259)
                          Found CBFS header at 0xfffffb90
                          found file "bootorder" in cbmem
                          CPU Mhz=1000
                          Found 27 PCI devices (max PCI bus is 05)
                          Copying PIR from 0x7e160400 to 0x000f27a0
                          Copying MPTABLE from 0x7e161400/7e161410 to 0x000f25b0 with length 1ec
                          Copying ACPI RSDP from 0x7e162400 to 0x000f2590
                          Copying SMBIOS entry point from 0x7e16d800 to 0x000f2570
                          Using pmtimer, ioport 0x808
                          Scan for VGA option rom
                          EHCI init on dev 00:12.2 (regs=0xf7f04420)
                          Found 1 lpt ports
                          Found 2 serial ports
                          AHCI controller at 11.0, iobase f7f04000, irq 11
                          EHCI init on dev 00:13.2 (regs=0xf7f04520)
                          EHCI init on dev 00:16.2 (regs=0xf7f04620)
                          Searching bootorder for: /rom@img/setup
                          Searching bootorder for: /rom@img/memtest
                          OHCI init on dev 00:12.0 (regs=0xf7f00000)
                          OHCI init on dev 00:13.0 (regs=0xf7f01000)
                          OHCI init on dev 00:14.5 (regs=0xf7f02000)
                          OHCI init on dev 00:16.0 (regs=0xf7f03000)
                          Searching bootorder for: /pci@i0cf8/usb@16,2/storage@1/*@0/*@0,0
                          Searching bootorder for: /pci@i0cf8/usb@16,2/usb-*@1
                          USB MSC vendor='Multiple' product='Card  Reader' rev='1.00' type=0 removable=1
                          USB MSC blksize=512 sectors=15523840
                          All threads complete.
                          Scan for option roms
                          Running option rom at c000:0003
                          
                          iPXE (http://ipxe.org) 00:00.0 C000 PCI2.10 PnP PMMpmm call arg1=1
                          pmm call arg1=0
                          +7E0DA5C0pmm call arg1=1
                          pmm call arg1=0
                          +7E03A5C0 C000
                          
                          Searching bootorder for: /rom@genroms/pxeboot.rom
                          
                          Build date: Apr  5 2014
                          System memory size: 2017 MB
                          
                          Press F12 for boot menu.
                          
                          Searching bootorder for: HALT
                          drive 0x000f2520: PCHS=0/0/0 translation=lba LCHS=966/255/63 s=15523840
                          Space available for UMB: c1000-ee800, f0000-f2520
                          Returned 245760 bytes of ZoneHigh
                          e820 map has 6 items:
                            0: 0000000000000000 - 000000000009fc00 = 1 RAM
                            1: 000000000009fc00 - 00000000000a0000 = 2 RESERVED
                            2: 00000000000f0000 - 0000000000100000 = 2 RESERVED
                            3: 0000000000100000 - 000000007e14c000 = 1 RAM
                            4: 000000007e14c000 - 000000007f000000 = 2 RESERVED
                            5: 00000000f8000000 - 00000000f9000000 = 2 RESERVED
                          enter handle_19:
                            NULL
                          Booting from Hard Disk...
                          Booting from 0000:7c00
                          
                          1  pfSense
                          2  pfSense
                          
                          F6 PXE
                          Boot:  1
                          /boot/config: -S115200 -hConsoles: serial port
                          BIOS drive C: is disk0
                          BIOS 639kB/2064688kB available memory
                          
                          FreeBSD/x86 bootstrap loader, Revision 1.1
                          (root@pfs22-amd64-builder, Wed Nov  4 16:13:22 CST 2015)
                          Loading /boot/defaults/loader.conf
                          
                          For reference, this is what I normally see:
                          [code]*** FINAL System shutdown message from root@GateKeeper.localdomain ***
                          
                          System going down IMMEDIATELY
                          
                          pfSense is now shutting down ...
                          
                          Nov 20 00:30:26 lighttpd[45365]: (server.c.1567) server stopped by UID = 0 PID = 1
                          Waiting (max 60 seconds) for system process `vnlru' to stop...done
                          Waiting (max 60 seconds) for system process `bufdaemon' to stop...done
                          Waiting (max 60 seconds) for system process `syncer' to stop...
                          Syncing disks, vnodes remaining...0 0 done
                          All buffers synced.
                          Uptime: 5m27s
                          re0: link state changed to DOWN
                          re1: link state changed to DOWN
                          re1: link state changed to UP
                          re2: link state changed to DOWN
                          re2: link state changed to UP
                          PC Engines APU BIOS build date: Apr  5 2014
                          Reading data from file [bootorder]
                          SeaBIOS (version ?-20140405_120742-frink)
                          SeaBIOS (version ?-20140405_120742-frink)
                          Found coreboot cbmem console @ 7e150400
                          Found mainboard PC Engines APU
                          Relocating init from 0x000e8e71 to 0x7e1065e0 (size 39259)
                          Found CBFS header at 0xfffffb90
                          found file "bootorder" in cbmem
                          CPU Mhz=1001
                          Found 27 PCI devices (max PCI bus is 05)
                          Copying PIR from 0x7e160400 to 0x000f27a0
                          Copying MPTABLE from 0x7e161400/7e161410 to 0x000f25b0 with length 1ec
                          Copying ACPI RSDP from 0x7e162400 to 0x000f2590
                          Copying SMBIOS entry point from 0x7e16d800 to 0x000f2570
                          Using pmtimer, ioport 0x808
                          Scan for VGA option rom
                          EHCI init on dev 00:12.2 (regs=0xf7f04420)
                          Found 1 lpt ports
                          Found 2 serial ports
                          AHCI controller at 11.0, iobase f7f04000, irq 11
                          EHCI init on dev 00:13.2 (regs=0xf7f04520)
                          EHCI init on dev 00:16.2 (regs=0xf7f04620)
                          Searching bootorder for: /rom@img/setup
                          Searching bootorder for: /rom@img/memtest
                          OHCI init on dev 00:12.0 (regs=0xf7f00000)
                          OHCI init on dev 00:13.0 (regs=0xf7f01000)
                          OHCI init on dev 00:14.5 (regs=0xf7f02000)
                          OHCI init on dev 00:16.0 (regs=0xf7f03000)
                          Searching bootorder for: /pci@i0cf8/usb@16,2/storage@1/*@0/*@0,0
                          Searching bootorder for: /pci@i0cf8/usb@16,2/usb-*@1
                          USB MSC vendor='Multiple' product='Card  Reader' rev='1.00' type=0 removable=1
                          USB MSC blksize=512 sectors=15523840
                          All threads complete.
                          Scan for option roms
                          Running option rom at c000:0003
                          
                          iPXE (http://ipxe.org) 00:00.0 C000 PCI2.10 PnP PMMpmm call arg1=1
                          pmm call arg1=0
                          +7E0DA5C0pmm call arg1=1
                          pmm call arg1=0
                          +7E03A5C0 C000
                          
                          Searching bootorder for: /rom@genroms/pxeboot.rom
                          
                          Build date: Apr  5 2014
                          System memory size: 2017 MB
                          
                          Press F12 for boot menu.
                          
                          Searching bootorder for: HALT
                          drive 0x000f2520: PCHS=0/0/0 translation=lba LCHS=966/255/63 s=15523840
                          Space available for UMB: c1000-ee800, f0000-f2520
                          Returned 245760 bytes of ZoneHigh
                          e820 map has 6 items:
                            0: 0000000000000000 - 000000000009fc00 = 1 RAM
                            1: 000000000009fc00 - 00000000000a0000 = 2 RESERVED
                            2: 00000000000f0000 - 0000000000100000 = 2 RESERVED
                            3: 0000000000100000 - 000000007e14c000 = 1 RAM
                            4: 000000007e14c000 - 000000007f000000 = 2 RESERVED
                            5: 00000000f8000000 - 00000000f9000000 = 2 RESERVED
                          enter handle_19:
                            NULL
                          Booting from Hard Disk...
                          Booting from 0000:7c00
                          
                          1  pfSense
                          2  pfSense
                          [/code]
                          
                          I also see this in the startup:
                          [code]Trying to mount root from ufs:/dev/ufs/pfsense0 [ro,sync,noatime]...
                          mountroot: waiting for device /dev/ufs/pfsense0 ...
                          da0 at umass-sim0 bus 0 scbus6 target 0 lun 0
                          da0: <multiple card ="" reader="" 1.00=""> Removable Direct Access SCSI-4 device
                          da0: Serial Number 058F63666485
                          da0: 40.000MB/s transfers
                          da0: 7580MB (15523840 512 byte sectors: 255H 63S/T 966C)
                          da0: quirks=0x2 <no_6_byte>WARNING: / was not properly dismounted
                          Configuring crash dumps...
                          /dev/ufs/pfsense0: 30974 files, 2013156 used, 1766872 free (2632 frags, 220530 blocks, 0.1% fragmentation)
                          /dev/ufs/cf: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED)
                          /dev/ufs/cf: 30 files, 3971 used, 97084 free (28 frags, 12132 blocks, 0.0% fragmentation)
                          Filesystems are clean, continuing...
                          Mounting filesystems...
                          Setting up memory disks... done.
                          [/code]
                          
                          Any idea where to see the crash dumps?[/thread]</no_6_byte></multiple>
                          
                          1 Reply Last reply Reply Quote 0
                          • S
                            Sylas
                            last edited by

                            Hey guys

                            I have a similar problem on FreeBSD/FreeNAS and I just wanted to ask if you ever found a solution?

                            The error message from above:

                            Tracing command kernel pid 0 tid 100018 td 0xfffff80003224000
                            sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a3aeab0
                            mi_switch() at mi_switch+0xe1/frame 0xfffffe001a3aeaf0
                            sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a3aeb20
                            msleep_spin_sbt() at msleep_spin_sbt+0x1a3/frame 0xfffffe001a3aeb80
                            taskqueue_thread_loop() at taskqueue_thread_loop+0xfd/frame 0xfffffe001a3aebb0
                            fork_exit() at fork_exit+0x9a/frame 0xfffffe001a3aebf0
                            fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a3aebf0
                            –- trap 0, rip = 0, rsp = 0xfffffe001a3aecb0, rbp = 0 ---

                            Tracing command kernel pid 0 tid 100014 td 0xfffff80003225490
                            sched_switch() at sched_switch+0x2b3/frame 0xfffffe001a39aa90
                            mi_switch() at mi_switch+0xe1/frame 0xfffffe001a39aad0
                            sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe001a39ab00
                            _sleep() at _sleep+0x287/frame 0xfffffe001a39ab80
                            taskqueue_thread_loop() at taskqueue_thread_loop+0xd5/frame 0xfffffe001a39abb0
                            fork_exit() at fork_exit+0x9a/frame 0xfffffe001a39abf0
                            fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a39abf0
                            --- trap 0, rip = 0, rsp = 0xfffffe001a39acb0, rbp = 0 ---

                            I do see something like that - here's the https://bugs.freenas.org/issues/15089 –> second.jpg ...

                            I'd appreciate any help!

                            Thanks and best regards

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post
                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.