Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Router Locking Up (maybe due to excessive lan traffic?)

    Scheduled Pinned Locked Moved General pfSense Questions
    64 Posts 6 Posters 5.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • stephenw10S
      stephenw10 Netgate Administrator
      last edited by

      What are those hosts at 10.111.11.115 and 10.111.11.118?

      X 1 Reply Last reply Reply Quote 0
      • X
        Ximulate @stephenw10
        last edited by

        @stephenw10
        .115 is an iPhone. Interesting thing here is that device would not have been on the network at that time (09:44). This episode & the one before, .115 was in the logs reporting the same thing minutes before the issue started (it would have been on the network the previous episode.)

        Not sure yet what .118 is. It might be another iPhone.

        1 Reply Last reply Reply Quote 0
        • stephenw10S
          stephenw10 Netgate Administrator
          last edited by

          Is it possible the system clock is wrong?

          X 1 Reply Last reply Reply Quote 0
          • X
            Ximulate @stephenw10
            last edited by

            @stephenw10 no, the time is correct

            X 1 Reply Last reply Reply Quote 0
            • X
              Ximulate @Ximulate
              last edited by Ximulate

              This morning all seemed fine (smart TV was working, not complaints from the alarm, etc) until I logged into my desktop PC and it would not load local (i.e. pfSense GUI) or WWW pages. I tried to SSH into the router, but no joy.

              The logs are relatively quite from midnight until the time I power cycled the router. I did not see any "ssl handshake failed crypto error."

              There were several "filterdns 18089 Adding Action: pf table: XYZ host: xxx.xxx.xxx.xxx" prior to rebooting. I've seen this in the logs prior to other failures.

              I also noticed serveral ntpd logs like this:

              Mar 6 08:31:31 	ntpd 	87972 	Soliciting pool server 45.83.234.123
              

              Tried "ntpq -c pe" per stack exchange post, which if I understand correctly st:16 means out of sync:

              =============================================================================
              0.pfsense.pool. .POOL. 16 p - 64 0 0.000 +0.000 0.000
              1.pool.ntp.org .POOL. 16 p - 64 0 0.000 +0.000 0.000
              2.pool.ntp.org .POOL. 16 p - 64 0 0.000 +0.000 0.000
              3.pool.ntp.org .POOL. 16 p - 64 0 0.000 +0.000 0.000
              *65-100-46-166.d .SOCK. 1 u 38 128 377 74.742 +2.404 1.990
              +ns1.your-site.c 216.218.254.202 3 u 58 128 377 72.907 +1.203 5.012
              +104.156.246.53 204.9.54.119 2 u 103 128 377 40.948 -0.402 6.028

              Dashboard shows correct time

              X stephenw10S 2 Replies Last reply Reply Quote 0
              • X
                Ximulate @Ximulate
                last edited by

                Dashboard shows correct time

                NTP service is enabled with
                0.pfsense.pool.ntp.org
                1.pool.ntp.org
                2.pool.ntp.org
                3.pool.ntp.org

                Same timeservers are input into System > General > Timeservers
                I don't see any firewall rules that would block NTP requests.
                I'm disabling NTP Server, as I don't think I'm using it.
                I'm assuming the other timeservers listed in the ntpq results are requests from LAN devices

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator @Ximulate
                  last edited by

                  @Ximulate said in Router Locking Up (maybe due to excessive lan traffic?):

                  I logged into my desktop PC and it would not load local (i.e. pfSense GUI) or WWW pages. I tried to SSH into the router, but no joy.

                  How was it failing? Is it a DNS resolution failure? The services actually stopped responding on the firewall?

                  Progressively failing services like that could be a disk issue. Do you see gaps in the logging after recovering access?

                  X 1 Reply Last reply Reply Quote 0
                  • X
                    Ximulate @stephenw10
                    last edited by Ximulate

                    @stephenw10

                    No, the IP addresses appear to being dropped as if dhcp is failing or devices are not able to see other devices. In other words, if I type the pfSense router IP address into the browser it does not load... the browser does not see the pfSense gui. Once this happens, the only way I'm able to recover access is power cycling the router.

                    At one point, I had my laptop connected to the serial console of the router. I was usually able to access the command menu that way. Occasionally, I could RPD to the laptop to access the command menu but that would normally not work either.

                    I think I've tried this already, but I think I'll manually set the the IP address of my desktop & laptop to see if they still communicate next time the network fails. Currently pfSense is handling out static leases to my desktop & a few other items, and dynamic to the rest.

                    On the rare occasion that I catch the network acting up but can get to the router gui, I have not seen any failing services. I have also tried the pfsense tools in the CLI lile "playback restartallwan" without success. Reboot was required.

                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by

                      Was the console responsive if you were at the laptop connected to it directly?

                      X 1 Reply Last reply Reply Quote 0
                      • X
                        Ximulate @stephenw10
                        last edited by Ximulate

                        @stephenw10 To the best of my recollection, at least within the last few weeks, the console has always been accessable via serial.

                        1 Reply Last reply Reply Quote 0
                        • stephenw10S
                          stephenw10 Netgate Administrator
                          last edited by

                          Ok then I'd try to connect out from it when this happens and see what (if anything) still works.

                          X 1 Reply Last reply Reply Quote 0
                          • X
                            Ximulate @stephenw10
                            last edited by

                            @stephenw10 maybe I misunderstood your last question. When the network/router fails, I have been able to access the console via serial connection but devices on the network/router still do not communicate. I've tried restarting php, restarting the web configurator, using the playback scripts in the tools... none of those resolve the issue, except rebooting

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator
                              last edited by

                              Right but can you ping out from the console to external targets? By IP and FQDN? What about internal targets?

                              X 1 Reply Last reply Reply Quote 0
                              • X
                                Ximulate @stephenw10
                                last edited by Ximulate

                                @stephenw10
                                I had to go back to the first post to refresh my memory, but yes I did also try pinging back then
                                https://forum.netgate.com/post/1152732

                                When I can get into the GUI, I don't see any issues in the dashboard like down WAN, CPU or memory issues. Most of the time, I don't notice 'til its too late so I can't connect to GUI. I have set-up my laptop to the router using the console. I've tried various options in the menu, including restarting PHP, the web configurator, tools like "playback restartallwan" and others to no avail. The one interesting thing is, although the lan devices aren't connecting, I can, from the console, sometimes ping external IPs like 9.9.9.9 OK but 8.8.8.8 might not respond. Internal LAN devices don't respond to ping either.

                                Now a lot has transpired since that post so I'll try to ping next time. However, I do think I'm going to have the same/similar results. I just reconnected my laptop via serial to the console so its ready to go as soon as I can get to it.

                                BTW... Thank you for hanging in there with me on this!

                                1 Reply Last reply Reply Quote 0
                                • stephenw10S
                                  stephenw10 Netgate Administrator
                                  last edited by

                                  Hmm, unable to ping any internal IP address seems like it just stops moving traffic. Unlikely to be a NIC issue on an APU2 assuming you are only using the igb NICs.

                                  Hmm, something of a mystery. You can try booting in verbose mode. If it is something hardware related that might show something.

                                  Beyond that you can try loading the debug kernel:
                                  https://docs.netgate.com/pfsense/en/latest/troubleshooting/debug-kernel.html

                                  X 1 Reply Last reply Reply Quote 0
                                  • X
                                    Ximulate @stephenw10
                                    last edited by

                                    I booted verbose. Nothing stands-out to me, but I don't know what I'm looking at. It appears that the kernel.debug package is not available for CE?

                                    I suppose I could try memtest

                                    L2 unified cache: 2048 kbytes, 64 bytes/line, 1 lines/tag, 16-way associative
                                    L2 4KB instruction TLB: 512 entries, 4-way associative
                                    L2 4KB data TLB: 512 entries, 4-way associative
                                    L2 2MB instruction TLB: 0 entries, 2-way associative
                                    L2 2MB data TLB: 256 entries, 2-way associative
                                    L1 instruction cache: 32 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative
                                    L1 data cache: 32 kbytes, 64 bytes/line, 1 lines/tag, 8-way associative
                                    L1 4KB instruction TLB: 32 entries, fully associative
                                    L1 4KB data TLB: 40 entries, fully associative
                                    L1 2MB instruction TLB: 8 entries, fully associative
                                    L1 2MB data TLB: 8 entries, fully associative
                                    TSC: P-state invariant, performance statistics
                                    Revision=1, ASIDs=8
                                    SVM: Features=0x1cdf<NP,LbrVirt,SVML,NRIPS,TscRateMsr,FlushByAsid,DecodeAssist,PauseFilter,EncryptedMcodePatch,PauseFilterThreshold>
                                    XSAVE Features=0x1<XSAVEOPT>
                                    Structured Extended Features=0x8<BMI1>
                                    AMD Features2=0x1d4037ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,Topology,PNXC,DBE,PTSC,PL2I>
                                    AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
                                    Features2=0x3ed8220b<SSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C>
                                    Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
                                    Origin="AuthenticAMD" Id=0x730f01 Family=0x16 Model=0x30 Stepping=1
                                    CPU: AMD GX-412TC SOC (998.13-MHz K8-class CPU)
                                    cpuctl: access to MSR registers/cpuid info.
                                    start_init: trying /sbin/init
                                    atrtc0: providing initial system time
                                    GEOM: new disk ada0
                                    ada0: 15272MB (31277232 512 byte sectors)
                                    ada0: Command Queueing enabled
                                    ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
                                    ada0: Serial Number B6B60773070000011017
                                    ada0: <SATA SSD SBFM01.0> ACS-4 ATA SATA 3.x device
                                    ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
                                    pass0: Command Queueing enabled
                                    pass0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
                                    pass0: Serial Number B6B60773070000011017
                                    pass0: <SATA SSD SBFM01.0> ACS-4 ATA SATA 3.x device
                                    pass0 at ahcich0 bus 0 scbus0 target 0 lun 0
                                    Root mount waiting for: CAM
                                    Root mount waiting for: CAM
                                    Root mount waiting for: CAM
                                    Root mount waiting for: CAM
                                    Root mount waiting for: CAM
                                    Root mount waiting for: CAM
                                    Root mount waiting for: CAM
                                    uhub2: 4 ports with 4 removable, self powered
                                    Root mount waiting for: CAM usbus1
                                    uhub2: <vendor 0x0438 product 0x7900, class 9/0, rev 2.00/0.18, addr 2> on usbus1
                                    uhub2 on uhub0
                                    ugen1.2: <vendor 0x0438 product 0x7900> at usbus1
                                    uhub0: 2 ports with 2 removable, self powered
                                    ugen0.2: <OR1500PFCRT2U CRBA101.3B4> at usbus0
                                    uhub1: 4 ports with 4 removable, self powered
                                    uhub1: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
                                    uhub1 on usbus0
                                    uhub0: <AMD EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
                                    uhub0 on usbus1
                                    ugen1.1: <AMD EHCI root HUB> at usbus1
                                    ugen0.1: <AMD XHCI root HUB> at usbus0
                                    Trying to mount root from zfs:zroot/ROOT/default []...
                                    pci3: driver added
                                    pci2: driver added
                                    pci1: driver added
                                    pci0:0:20:0: reprobing on driver added
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0403, statreg=0x0220, cachelnsz=0 (dwords)
                                    class=0c-05-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=20, func=0
                                    found-> vendor=0x1022, dev=0x780b, revid=0x42
                                    pci0:0:8:0: reprobing on driver added
                                    MSI-X supports 2 messages in map 0x24
                                    powerspec 3 supports D0 D3 current D0
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0002, statreg=0x0010, cachelnsz=0 (dwords)
                                    class=10-80-00, hdrtype=0x00, mfdev=0
                                    domain=0, bus=0, slot=8, func=0
                                    found-> vendor=0x1022, dev=0x1537, revid=0x00
                                    pci0: driver added
                                    pci3: driver added
                                    pci2: driver added
                                    pci1: driver added
                                    pci0:0:20:0: reprobing on driver added
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0403, statreg=0x0220, cachelnsz=0 (dwords)
                                    class=0c-05-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=20, func=0
                                    found-> vendor=0x1022, dev=0x780b, revid=0x42
                                    pci0:0:8:0: reprobing on driver added
                                    MSI-X supports 2 messages in map 0x24
                                    powerspec 3 supports D0 D3 current D0
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0002, statreg=0x0010, cachelnsz=0 (dwords)
                                    class=10-80-00, hdrtype=0x00, mfdev=0
                                    domain=0, bus=0, slot=8, func=0
                                    found-> vendor=0x1022, dev=0x1537, revid=0x00
                                    pci0: driver added
                                    ahcich1: AHCI reset: device not found
                                    ahcich1: SATA connect timeout time=10000us status=00000000
                                    ahcich1: AHCI reset...
                                    ahcich0: AHCI reset: device ready after 0ms
                                    ahcich0: AHCI reset: device found
                                    ahcich0: SATA connect time=100us status=00000133
                                    ahcich0: AHCI reset...
                                    AcpiOsExecute: enqueue 4 pending tasks
                                    pflog0: bpf attached
                                    pfsync0: bpf attached
                                    tcp_init: net.inet.tcp.tcbhashsize auto tuned to 32768
                                    IPsec: Initialized Security Association Processing.
                                    lo0: bpf attached
                                    enc0: bpf attached
                                    vlan: initialized, using hash tables with chaining
                                    ZFS storage pool version: features support (5000)
                                    ZFS filesystem version: 5
                                    Timecounters tick every 1.000 msec
                                    lapic: Divisor 2, Frequency 49906384 Hz
                                    Statistical lapic calibration took 43359 us and 45329 data points
                                    Timecounter "TSC" frequency 998127954 Hz quality 1000
                                    Statistical TSC calibration took 71528 us and 36437 data points
                                    procfs registered
                                    Device configuration finished.
                                    hwpstate0: <Cool`n'Quiet 2.0> on cpu0
                                    AcpiOsExecute: task queue not started
                                    AcpiOsExecute: task queue not started
                                    AcpiOsExecute: task queue not started
                                    AcpiOsExecute: task queue not started
                                    isa_probe_children: probing PnP devices
                                    uart1: PPS capture mode: DCD
                                    uart1: fast interrupt
                                    ioapic0: routing intpin 3 (ISA IRQ 3) to lapic 3 vector 53
                                    pcib0: allocated type 4 (0x2f8-0x2f8) for rid 0 of uart1
                                    uart1: <16550 or compatible> at port 0x2f8 irq 3 on isa0
                                    pcib0: allocated type 4 (0x2f8-0x2f8) for rid 0 of uart1
                                    pcib0: allocated type 4 (0x2f8-0x2f8) for rid 0 of uart1
                                    ppc0 failed to probe at irq 7 on isa0
                                    ppc0: cannot reserve I/O port range
                                    fdc0 failed to probe at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
                                    pcib0: allocated type 4 (0x3f7-0x3f7) for rid 1 of fdc0
                                    pcib0: allocated type 4 (0x3f0-0x3f5) for rid 0 of fdc0
                                    atkbdc0 failed to probe at port 0x60,0x64 on isa0
                                    atkbdc0: AT keyboard controller not found
                                    pcib0: allocated type 4 (0x64-0x64) for rid 1 of atkbdc0
                                    pcib0: allocated type 4 (0x60-0x60) for rid 0 of atkbdc0
                                    vga0 failed to probe on isa0
                                    sc0 failed to probe on isa0
                                    orm0: <ISA Option ROM> at iomem 0xef000-0xeffff pnpid ORM0000 on isa0
                                    isa_probe_children: probing non-PnP devices
                                    uart: uart0 already exists; skipping it
                                    sc: sc0 already exists; skipping it
                                    attimer: attimer0 already exists; skipping it
                                    atrtc: atrtc0 already exists; skipping it
                                    isa_probe_children: disabling PnP devices
                                    ahc_isa_identify 14: ioport 0xec00 alloc failed
                                    ahc_isa_identify 13: ioport 0xdc00 alloc failed
                                    ahc_isa_identify 12: ioport 0xcc00 alloc failed
                                    ahc_isa_identify 11: ioport 0xbc00 alloc failed
                                    ahc_isa_identify 10: ioport 0xac00 alloc failed
                                    ahc_isa_identify 9: ioport 0x9c00 alloc failed
                                    ahc_isa_identify 8: ioport 0x8c00 alloc failed
                                    ahc_isa_identify 7: ioport 0x7c00 alloc failed
                                    ahc_isa_identify 6: ioport 0x6c00 alloc failed
                                    ahc_isa_identify 5: ioport 0x5c00 alloc failed
                                    ahc_isa_identify 4: ioport 0x4c00 alloc failed
                                    ahc_isa_identify 3: ioport 0x3c00 alloc failed
                                    ahc_isa_identify 2: ioport 0x2c00 alloc failed
                                    ahc_isa_identify 1: ioport 0x1c00 alloc failed
                                    ahc_isa_identify 0: ioport 0xc00 alloc failed
                                    ACPI: Enabled 4 GPEs in block 00 to 1F
                                    uart0: PPS capture mode: DCD
                                    uart0: fast interrupt
                                    ioapic0: routing intpin 4 (ISA IRQ 4) to lapic 2 vector 53
                                    uart0: console (115200,n,8,1)
                                    uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
                                    ioapic0: routing intpin 16 (PCI IRQ 16) to lapic 1 vector 52
                                    sdhci_pci0: 1 slot(s) allocated
                                    sdhci_pci0-slot0: ===========================================
                                    sdhci_pci0-slot0: ADMA addr:0x00000000 | Slot int: 0x000000ff
                                    sdhci_pci0-slot0: Max curr: 0x00c80064 | ADMA err: 0x00000000
                                    sdhci_pci0-slot0: Caps: 0x21fe32b2 | Caps2: 0x00000070
                                    sdhci_pci0-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000
                                    sdhci_pci0-slot0: Int enab: 0x00000000 | Sig enab: 0x00000000
                                    sdhci_pci0-slot0: Timeout: 0x00000000 | Int stat: 0x00000000
                                    sdhci_pci0-slot0: Wake-up: 0x00000000 | Clock: 0x00000000
                                    sdhci_pci0-slot0: Power: 0x00000000 | Blk gap: 0x00000000
                                    sdhci_pci0-slot0: Present: 0x01f20000 | Host ctl: 0x00000000
                                    sdhci_pci0-slot0: Argument: 0x00000000 | Trn mode: 0x00000000
                                    sdhci_pci0-slot0: Blk size: 0x00000000 | Blk cnt: 0x00000000
                                    sdhci_pci0-slot0: Sys addr: 0x00000000 | Version: 0x00001001
                                    sdhci_pci0-slot0: ============== REGISTER DUMP ==============
                                    sdhci_pci0-slot0: 50MHz 8bits VDD: VCCQ: 3.3V DRV: B DMA removable
                                    pcib0: slot 20 INTA hardwired to IRQ 16
                                    pcib0: matched entry for 0.20.INTA
                                    sdhci_pci0: <Generic SD HCI> mem 0xfeb25500-0xfeb255ff at device 20.7 on pci0
                                    isa0: <ISA bus> on isab0
                                    isab0: <PCI-ISA bridge> at device 20.3 on pci0
                                    pci0: <serial bus, SMBus> at device 20.0 (no driver attached)
                                    usbus1: 480Mbps High Speed USB v2.0
                                    ehci0: usbpf: Attached
                                    usbus1 on ehci0
                                    usbus1: EHCI version 1.0
                                    ioapic0: routing intpin 18 (PCI IRQ 18) to lapic 0 vector 53
                                    pcib0: slot 19 INTA hardwired to IRQ 18
                                    pcib0: matched entry for 0.19.INTA
                                    ehci0: <AMD FCH USB 2.0 controller> mem 0xfeb25400-0xfeb254ff at device 19.0 on pci0
                                    ahcich1: Caps: FBSCP
                                    ahcich1: <AHCI channel> at channel 1 on ahci0
                                    ahcich0: Caps: FBSCP
                                    ahcich0: <AHCI channel> at channel 0 on ahci0
                                    ahci0: Caps2:
                                    ahci0: Caps: 64bit NCQ SNTF MPS ALP AL CLO 6Gbps PM FBS PMD SSC PSC 32cmd 2ports
                                    ahci0: AHCI v1.30 with 2 6Gbps ports, Port Multiplier supported with FBS
                                    ioapic0: routing intpin 19 (PCI IRQ 19) to lapic 3 vector 52
                                    pcib0: slot 17 INTA hardwired to IRQ 19
                                    pcib0: matched entry for 0.17.INTA
                                    ahci0: <AMD Hudson-2 AHCI SATA controller> port 0x4010-0x4017,0x4020-0x4023,0x4018-0x401f,0x4024-0x4027,0x4000-0x400f mem 0xfeb25000-0xfeb253ff at device 17.0 on pci0
                                    usbus0: 5.0Gbps Super Speed USB v3.0
                                    xhci0: usbpf: Attached
                                    usbus0 on xhci0
                                    xhci0: MSI-X enabled
                                    xhci0: using IRQ 71 for MSI-X
                                    msi: routing MSI-X IRQ 71 to local APIC 2 vector 52
                                    xhci0: attempting to allocate 1 MSI-X vectors (8 supported)
                                    xhci0: 32 bytes context size, 64-bit DMA
                                    xhci0: <AMD FCH USB 3.0 controller> mem 0xfeb22000-0xfeb23fff at device 16.0 on pci0
                                    pci0: <encrypt/decrypt> at device 8.0 (no driver attached)
                                    igb2: netmap queues/slots: TX 4/1024, RX 4/1024
                                    igb2: Ethernet address: 00:0d:b9:45:16:92
                                    igb2: bpf attached
                                    msi: Assigning MSI-X IRQ 69 to local APIC 3 vector 51
                                    msi: Assigning MSI-X IRQ 68 to local APIC 2 vector 51
                                    msi: Assigning MSI-X IRQ 67 to local APIC 1 vector 50
                                    msi: Assigning MSI-X IRQ 66 to local APIC 0 vector 54
                                    igb2: allocated for 4 rx_queues
                                    igb2: allocated for 4 tx_queues
                                    igb2: Using MSI-X interrupts with 5 vectors
                                    igb2: using IRQs 66-70 for MSI-X
                                    msi: routing MSI-X IRQ 70 to local APIC 1 vector 51
                                    msi: routing MSI-X IRQ 69 to local APIC 0 vector 53
                                    msi: routing MSI-X IRQ 68 to local APIC 3 vector 51
                                    msi: routing MSI-X IRQ 67 to local APIC 2 vector 51
                                    msi: routing MSI-X IRQ 66 to local APIC 1 vector 50
                                    igb2: attempting to allocate 5 MSI-X vectors (5 supported)
                                    igb2: Using 4 RX queues 4 TX queues
                                    igb2: intr CPUs: 4 queue msgs: 4 admincnt: 1
                                    igb2: msix_init qsets capped at 4
                                    igb2: Using 1024 TX descriptors and 1024 RX descriptors
                                    igb2: NVM V0.6 imgtype5
                                    igb2: attach_pre capping queues at 4
                                    igb2: <Intel(R) I210 Flashless (Copper)> port 0x5000-0x501f mem 0xfe800000-0xfe81ffff,0xfe820000-0xfe823fff at device 0.0 on pci3
                                    pcib3: allocated memory range (0xfe820000-0xfe823fff) for rid 1c of pci0:3:0:0
                                    map[1c]: type Memory, range 32, base 0xfe820000, size 14, enabled
                                    pcib3: allocated I/O port range (0x5000-0x501f) for rid 18 of pci0:3:0:0
                                    pcib3: allocated initial I/O port window of 0x5000-0x5fff
                                    pcib0: allocated type 4 (0x5000-0x5fff) for rid 1c of pcib3
                                    pcib3: failed to allocate initial I/O port window (0x3000-0x301f,0x20)
                                    map[18]: type I/O Port, range 32, base 0x3000, size 5, enabled
                                    pcib3: allocated memory range (0xfe800000-0xfe81ffff) for rid 10 of pci0:3:0:0
                                    map[10]: type Memory, range 32, base 0xfe800000, size 17, enabled
                                    MSI-X supports 5 messages in map 0x1c
                                    MSI supports 1 message, 64 bit, vector masks
                                    powerspec 3 supports D0 D3 current D0
                                    intpin=a, irq=255
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0003, statreg=0x0010, cachelnsz=16 (dwords)
                                    class=02-00-00, hdrtype=0x00, mfdev=0
                                    domain=0, bus=3, slot=0, func=0
                                    found-> vendor=0x8086, dev=0x157b, revid=0x03
                                    pci3: domain=0, physical bus=3
                                    pcib3: allocated bus range (3-3) for rid 0 of pci3
                                    pci3: <ACPI PCI bus> on pcib3
                                    pcib3: memory decode 0xfe800000-0xfe8fffff
                                    pcib3: subordinate bus 3
                                    pcib3: secondary bus 3
                                    pcib3: domain 0
                                    pcib3: failed to allocate initial I/O port window: 0x3000-0x3fff
                                    pcib3: <ACPI PCI-PCI bridge> at device 2.4 on pci0
                                    igb1: netmap queues/slots: TX 4/1024, RX 4/1024
                                    igb1: Ethernet address: 00:0d:b9:45:16:91
                                    igb1: bpf attached
                                    igb1: allocated for 4 rx_queues
                                    igb1: allocated for 4 tx_queues
                                    igb1: Using MSI-X interrupts with 5 vectors
                                    igb1: using IRQs 61-65 for MSI-X
                                    msi: routing MSI-X IRQ 65 to local APIC 0 vector 52
                                    msi: routing MSI-X IRQ 64 to local APIC 3 vector 50
                                    msi: routing MSI-X IRQ 63 to local APIC 2 vector 49
                                    msi: routing MSI-X IRQ 62 to local APIC 1 vector 48
                                    msi: routing MSI-X IRQ 61 to local APIC 0 vector 50
                                    igb1: attempting to allocate 5 MSI-X vectors (5 supported)
                                    igb1: Using 4 RX queues 4 TX queues
                                    igb1: intr CPUs: 4 queue msgs: 4 admincnt: 1
                                    igb1: msix_init qsets capped at 4
                                    igb1: Using 1024 TX descriptors and 1024 RX descriptors
                                    igb1: NVM V0.6 imgtype5
                                    igb1: attach_pre capping queues at 4
                                    igb1: <Intel(R) I210 Flashless (Copper)> port 0x3000-0x301f mem 0xfe700000-0xfe71ffff,0xfe720000-0xfe723fff at device 0.0 on pci2
                                    pcib2: allocated memory range (0xfe720000-0xfe723fff) for rid 1c of pci0:2:0:0
                                    map[1c]: type Memory, range 32, base 0xfe720000, size 14, enabled
                                    pcib2: allocated I/O port range (0x3000-0x301f) for rid 18 of pci0:2:0:0
                                    pcib2: allocated initial I/O port window of 0x3000-0x3fff
                                    pcib0: allocated type 4 (0x3000-0x3fff) for rid 1c of pcib2
                                    pcib2: failed to allocate initial I/O port window (0x2000-0x201f,0x20)
                                    map[18]: type I/O Port, range 32, base 0x2000, size 5, enabled
                                    pcib2: allocated memory range (0xfe700000-0xfe71ffff) for rid 10 of pci0:2:0:0
                                    map[10]: type Memory, range 32, base 0xfe700000, size 17, enabled
                                    MSI-X supports 5 messages in map 0x1c
                                    MSI supports 1 message, 64 bit, vector masks
                                    powerspec 3 supports D0 D3 current D0
                                    intpin=a, irq=255
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0003, statreg=0x0010, cachelnsz=16 (dwords)
                                    class=02-00-00, hdrtype=0x00, mfdev=0
                                    domain=0, bus=2, slot=0, func=0
                                    found-> vendor=0x8086, dev=0x157b, revid=0x03
                                    pci2: domain=0, physical bus=2
                                    pcib2: allocated bus range (2-2) for rid 0 of pci2
                                    pci2: <ACPI PCI bus> on pcib2
                                    pcib2: memory decode 0xfe700000-0xfe7fffff
                                    pcib2: subordinate bus 2
                                    pcib2: secondary bus 2
                                    pcib2: domain 0
                                    pcib2: failed to allocate initial I/O port window: 0x2000-0x2fff
                                    pcib2: <ACPI PCI-PCI bridge> at device 2.3 on pci0
                                    igb0: netmap queues/slots: TX 4/1024, RX 4/1024
                                    igb0: Ethernet address: 00:0d:b9:45:16:90
                                    igb0: bpf attached
                                    msi: Assigning MSI-X IRQ 59 to local APIC 3 vector 48
                                    msi: Assigning MSI-X IRQ 58 to local APIC 2 vector 50
                                    msi: Assigning MSI-X IRQ 57 to local APIC 1 vector 49
                                    msi: Assigning MSI-X IRQ 56 to local APIC 0 vector 51
                                    igb0: allocated for 4 rx_queues
                                    igb0: allocated for 4 tx_queues
                                    igb0: Using MSI-X interrupts with 5 vectors
                                    igb0: using IRQs 56-60 for MSI-X
                                    msi: routing MSI-X IRQ 60 to local APIC 3 vector 49
                                    msi: routing MSI-X IRQ 59 to local APIC 2 vector 49
                                    msi: routing MSI-X IRQ 58 to local APIC 1 vector 48
                                    msi: routing MSI-X IRQ 57 to local APIC 0 vector 50
                                    msi: routing MSI-X IRQ 56 to local APIC 3 vector 48
                                    igb0: attempting to allocate 5 MSI-X vectors (5 supported)
                                    igb0: Using 4 RX queues 4 TX queues
                                    igb0: intr CPUs: 4 queue msgs: 4 admincnt: 1
                                    igb0: msix_init qsets capped at 4
                                    igb0: Using 1024 TX descriptors and 1024 RX descriptors
                                    igb0: NVM V0.6 imgtype5
                                    igb0: attach_pre capping queues at 4
                                    igb0: <Intel(R) I210 Flashless (Copper)> port 0x2000-0x201f mem 0xfe600000-0xfe61ffff,0xfe620000-0xfe623fff at device 0.0 on pci1
                                    pcib1: allocated memory range (0xfe620000-0xfe623fff) for rid 1c of pci0:1:0:0
                                    map[1c]: type Memory, range 32, base 0xfe620000, size 14, enabled
                                    pcib1: allocated I/O port range (0x2000-0x201f) for rid 18 of pci0:1:0:0
                                    pcib1: allocated initial I/O port window of 0x2000-0x2fff
                                    pcib0: allocated type 4 (0x2000-0x2fff) for rid 1c of pcib1
                                    pcib1: failed to allocate initial I/O port window (0x1000-0x101f,0x20)
                                    map[18]: type I/O Port, range 32, base 0x1000, size 5, enabled
                                    pcib1: allocated memory range (0xfe600000-0xfe61ffff) for rid 10 of pci0:1:0:0
                                    map[10]: type Memory, range 32, base 0xfe600000, size 17, enabled
                                    MSI-X supports 5 messages in map 0x1c
                                    MSI supports 1 message, 64 bit, vector masks
                                    powerspec 3 supports D0 D3 current D0
                                    intpin=a, irq=255
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0003, statreg=0x0010, cachelnsz=16 (dwords)
                                    class=02-00-00, hdrtype=0x00, mfdev=0
                                    domain=0, bus=1, slot=0, func=0
                                    found-> vendor=0x8086, dev=0x157b, revid=0x03
                                    pci1: domain=0, physical bus=1
                                    pcib1: allocated bus range (1-1) for rid 0 of pci1
                                    pci1: <ACPI PCI bus> on pcib1
                                    pcib1: memory decode 0xfe600000-0xfe6fffff
                                    pcib1: subordinate bus 1
                                    pcib1: secondary bus 1
                                    pcib1: domain 0
                                    pcib1: failed to allocate initial I/O port window: 0x1000-0x1fff
                                    pcib1: <ACPI PCI-PCI bridge> at device 2.2 on pci0
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords)
                                    class=06-00-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=24, func=5
                                    found-> vendor=0x1022, dev=0x1585, revid=0x00
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords)
                                    class=06-00-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=24, func=4
                                    found-> vendor=0x1022, dev=0x1584, revid=0x00
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords)
                                    class=06-00-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=24, func=3
                                    found-> vendor=0x1022, dev=0x1583, revid=0x00
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords)
                                    class=06-00-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=24, func=2
                                    found-> vendor=0x1022, dev=0x1582, revid=0x00
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords)
                                    class=06-00-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=24, func=1
                                    found-> vendor=0x1022, dev=0x1581, revid=0x00
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords)
                                    class=06-00-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=24, func=0
                                    found-> vendor=0x1022, dev=0x1580, revid=0x00
                                    map[10]: type Memory, range 32, base 0xfeb25500, size 8, enabled
                                    intpin=a, irq=255
                                    lattimer=0x47 (2130 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0006, statreg=0x0220, cachelnsz=16 (dwords)
                                    class=08-05-01, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=20, func=7
                                    found-> vendor=0x1022, dev=0x7813, revid=0x01
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x000f, statreg=0x0220, cachelnsz=0 (dwords)
                                    class=06-01-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=20, func=3
                                    found-> vendor=0x1022, dev=0x780e, revid=0x11
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0403, statreg=0x0220, cachelnsz=0 (dwords)
                                    class=0c-05-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=20, func=0
                                    found-> vendor=0x1022, dev=0x780b, revid=0x42
                                    map[10]: type Memory, range 32, base 0xfeb25400, size 8, enabled
                                    powerspec 2 supports D0 D1 D2 D3 current D0
                                    intpin=a, irq=255
                                    lattimer=0x40 (1920 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0006, statreg=0x02b0, cachelnsz=16 (dwords)
                                    class=0c-03-20, hdrtype=0x00, mfdev=0
                                    domain=0, bus=0, slot=19, func=0
                                    found-> vendor=0x1022, dev=0x7808, revid=0x39
                                    map[24]: type Memory, range 32, base 0xfeb25000, size 10, enabled
                                    pcib0: allocated type 4 (0x4000-0x400f) for rid 20 of pci0:0:17:0
                                    map[20]: type I/O Port, range 32, base 0x4000, size 4, enabled
                                    pcib0: allocated type 4 (0x4024-0x4027) for rid 1c of pci0:0:17:0
                                    map[1c]: type I/O Port, range 32, base 0x4024, size 2, enabled
                                    pcib0: allocated type 4 (0x4018-0x401f) for rid 18 of pci0:0:17:0
                                    map[18]: type I/O Port, range 32, base 0x4018, size 3, enabled
                                    pcib0: allocated type 4 (0x4020-0x4023) for rid 14 of pci0:0:17:0
                                    map[14]: type I/O Port, range 32, base 0x4020, size 2, enabled
                                    pcib0: allocated type 4 (0x4010-0x4017) for rid 10 of pci0:0:17:0
                                    map[10]: type I/O Port, range 32, base 0x4010, size 3, enabled
                                    powerspec 3 supports D0 D3 current D0
                                    intpin=a, irq=255
                                    lattimer=0x40 (1920 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0007, statreg=0x0230, cachelnsz=16 (dwords)
                                    class=01-01-8f, hdrtype=0x00, mfdev=0
                                    domain=0, bus=0, slot=17, func=0
                                    found-> vendor=0x1022, dev=0x7800, revid=0x40
                                    map[10]: type Memory, range 64, base 0xfeb22000, size 13, enabled
                                    MSI-X supports 8 messages in map 0x10
                                    MSI supports 8 messages, 64 bit
                                    powerspec 3 supports D0 D3 current D0
                                    intpin=a, irq=255
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0006, statreg=0x0010, cachelnsz=16 (dwords)
                                    class=0c-03-30, hdrtype=0x00, mfdev=0
                                    domain=0, bus=0, slot=16, func=0
                                    found-> vendor=0x1022, dev=0x7814, revid=0x11
                                    map[24]: type Memory, range 32, base 0xfeb20000, size 13, enabled
                                    map[20]: type Memory, range 32, base 0xfea00000, size 20, enabled
                                    map[1c]: type Memory, range 32, base 0xfeb24000, size 12, enabled
                                    map[18]: type Memory, range 32, base 0xfe900000, size 20, enabled
                                    map[10]: type Prefetchable Memory, range 64, base 0xfeb00000, size 17, enabled
                                    MSI-X supports 2 messages in map 0x24
                                    powerspec 3 supports D0 D3 current D0
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0002, statreg=0x0010, cachelnsz=0 (dwords)
                                    class=10-80-00, hdrtype=0x00, mfdev=0
                                    domain=0, bus=0, slot=8, func=0
                                    found-> vendor=0x1022, dev=0x1537, revid=0x00
                                    secbus=3, subbus=3
                                    MSI supports 1 message, 64 bit
                                    powerspec 3 supports D0 D3 current D0
                                    intpin=d, irq=255
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0007, statreg=0x0010, cachelnsz=16 (dwords)
                                    class=06-04-00, hdrtype=0x01, mfdev=1
                                    domain=0, bus=0, slot=2, func=4
                                    found-> vendor=0x1022, dev=0x1439, revid=0x00
                                    secbus=2, subbus=2
                                    MSI supports 1 message, 64 bit
                                    powerspec 3 supports D0 D3 current D0
                                    intpin=c, irq=255
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0007, statreg=0x0010, cachelnsz=16 (dwords)
                                    class=06-04-00, hdrtype=0x01, mfdev=1
                                    domain=0, bus=0, slot=2, func=3
                                    found-> vendor=0x1022, dev=0x1439, revid=0x00
                                    secbus=1, subbus=1
                                    MSI supports 1 message, 64 bit
                                    powerspec 3 supports D0 D3 current D0
                                    intpin=b, irq=255
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0007, statreg=0x0010, cachelnsz=16 (dwords)
                                    class=06-04-00, hdrtype=0x01, mfdev=1
                                    domain=0, bus=0, slot=2, func=2
                                    found-> vendor=0x1022, dev=0x1439, revid=0x00
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords)
                                    class=06-00-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=2, func=0
                                    found-> vendor=0x1022, dev=0x156b, revid=0x00
                                    lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
                                    cmdreg=0x0004, statreg=0x0000, cachelnsz=0 (dwords)
                                    class=06-00-00, hdrtype=0x00, mfdev=1
                                    domain=0, bus=0, slot=0, func=0
                                    found-> vendor=0x1022, dev=0x1566, revid=0x00
                                    pci0: domain=0, physical bus=0
                                    pci0: <ACPI PCI bus> on pcib0
                                    pcib0: decoding 4 range 0xd00-0xffff
                                    pcib0: decoding 4 range 0x3b0-0x3df
                                    pcib0: decoding 4 range 0-0xcf7
                                    pcib0: decoding 5 range 0-0xff
                                    pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
                                    acpi_button0: <Power Button> on acpi0
                                    After Disable 0 255 N 0 3 5 7 10 11 12 15
                                    Validation 0 10 N 0 3 5 7 10 11 12 15
                                    Initial Probe 0 10 N 0 3 5 7 10 11 12 15
                                    pci_link5: Index IRQ Rtd Ref IRQs
                                    After Disable 0 255 N 0 3 5 7 10 11 12 15
                                    Validation 0 11 N 0 3 5 7 10 11 12 15
                                    Initial Probe 0 11 N 0 3 5 7 10 11 12 15
                                    pci_link4: Index IRQ Rtd Ref IRQs
                                    After Disable 0 255 N 0 3 5 7 10 11 12 15
                                    Validation 0 7 N 0 3 5 7 10 11 12 15
                                    Initial Probe 0 7 N 0 3 5 7 10 11 12 15
                                    pci_link3: Index IRQ Rtd Ref IRQs
                                    After Disable 0 255 N 0 3 5 7 10 11 12 15
                                    Validation 0 5 N 0 3 5 7 10 11 12 15
                                    Initial Probe 0 5 N 0 3 5 7 10 11 12 15
                                    pci_link2: Index IRQ Rtd Ref IRQs
                                    After Disable 0 255 N 0 3 5 7 10 11 12 15
                                    Validation 0 3 N 0 3 5 7 10 11 12 15
                                    Initial Probe 0 3 N 0 3 5 7 10 11 12 15
                                    pci_link1: Index IRQ Rtd Ref IRQs
                                    After Disable 0 255 N 0 3 5 7 10 11 12 15
                                    Validation 0 3 N 0 3 5 7 10 11 12 15
                                    Initial Probe 0 3 N 0 3 5 7 10 11 12 15
                                    pci_link0: Index IRQ Rtd Ref IRQs
                                    acpi_timer0: <32-bit timer at 3.579545MHz> port 0x818-0x81b on acpi0
                                    Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
                                    ACPI timer: -> 10
                                    Timecounter "HPET" frequency 14318180 Hz quality 950
                                    hpet0: t2: irqs 0x00c00000 (0), periodic
                                    hpet0: t1: irqs 0x00c00000 (0), periodic
                                    hpet0: t0: irqs 0x00c00000 (0), periodic
                                    hpet0: vendor 0x1022, rev 0x1, 14318180Hz, 3 timers, legacy route
                                    hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
                                    apei0: <ACPI Platform Error Interface> on acpi0
                                    Event timer "i8254" frequency 1193182 Hz quality 100
                                    ioapic0: routing intpin 2 (ISA IRQ 0) to lapic 2 vector 48
                                    Timecounter "i8254" frequency 1193182 Hz quality 0
                                    attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
                                    Event timer "RTC" frequency 32768 Hz quality 0
                                    ioapic0: routing intpin 8 (ISA IRQ 8) to lapic 0 vector 49
                                    ioapic0: routing intpin 8 (ISA IRQ 8) to lapic 1 vector 48
                                    atrtc0: registered as a time-of-day clock, resolution 1.000000s
                                    atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
                                    ACPI: Processor \134_PR_.P007 (ACPI ID 7) ignored
                                    ACPI: Processor \134_PR_.P006 (ACPI ID 6) ignored
                                    ACPI: Processor \134_PR_.P005 (ACPI ID 5) ignored
                                    ACPI: Processor \134_PR_.P004 (ACPI ID 4) ignored
                                    cpu3: <ACPI CPU> on acpi0
                                    cpu2: <ACPI CPU> on acpi0
                                    cpu1: <ACPI CPU> on acpi0
                                    cpu0: <ACPI CPU> on acpi0
                                    acpi0: wakeup code va 0xfffffe0008516000 pa 0x9c000
                                    acpi0: Power Button (fixed)
                                    ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48
                                    ACPI: 4 ACPI AML tables successfully acquired and loaded
                                    acpi0: <CORE COREBOOT>
                                    crypto: assign cryptosoft0 driver id 0, flags 0x6000000
                                    smbios0: Version: 2.7
                                    smbios0: <System Management BIOS> at iomem 0xf4870-0xf488e
                                    vtvga0: <VT VGA driver>
                                    netgate0: <Netgate APU>
                                    WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
                                    tcp_log: tcp_log device
                                    io: <I/O>
                                    null: <full device, null device, zero device>
                                    crypto: <crypto core>
                                    mem: <memory>
                                    kbd0 at kbdmux0
                                    [ath_hal] loaded
                                    
                                    X 1 Reply Last reply Reply Quote 0
                                    • X
                                      Ximulate @Ximulate
                                      last edited by

                                      EFI systbl not available
                                      firmware: 'iwm3160fw' version 0: 918268 bytes loaded at 0xffffffff81b196f6
                                      module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff807652e0, 0) error 1
                                      iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                      iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                      firmware: 'rt2860fw' version 0: 8192 bytes loaded at 0xffffffff82acc5ce
                                      firmware: 'rt2661fw' version 0: 8192 bytes loaded at 0xffffffff82aca5ce
                                      firmware: 'rt2561sfw' version 0: 8192 bytes loaded at 0xffffffff82ac85ce
                                      firmware: 'rt2561fw' version 0: 8192 bytes loaded at 0xffffffff82ac65ce
                                      module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80765230, 0) error 1
                                      iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                      iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                      module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80765180, 0) error 1
                                      iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                      iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                      module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80747700, 0) error 1
                                      ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                      ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                      module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1
                                      ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                      ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                      module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff807475a0, 0) error 1
                                      ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                      ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                      firmware: 'runfw' version 0: 8192 bytes loaded at 0xffffffff82b18392
                                      firmware: 'rsu-rtl8712fw' version 120: 122328 bytes loaded at 0xffffffff82afa5ba
                                      firmware: 't6fw' version 0: 730624 bytes loaded at 0xffffffff819491f2
                                      firmware: 't6fw_cfg_uwire' version 0: 22693 bytes loaded at 0xffffffff8194394d
                                      firmware: 't6fw_cfg' version 0: 5960 bytes loaded at 0xffffffff81942205
                                      firmware: 't5fw' version 0: 678912 bytes loaded at 0xffffffff8189c605
                                      firmware: 't5fw_cfg_uwire' version 0: 21859 bytes loaded at 0xffffffff818970a2
                                      firmware: 't5fw_cfg' version 0: 5902 bytes loaded at 0xffffffff81895994
                                      wlan: <802.11 Link Layer>
                                      firmware: 't4fw' version 0: 570880 bytes loaded at 0xffffffff8180a394
                                      firmware: 't4fw_cfg_uwire' version 0: 21433 bytes loaded at 0xffffffff81804fdb
                                      firmware: 't4fw_cfg' version 0: 4523 bytes loaded at 0xffffffff81803e30
                                      firmware: 'iwn6050fw' version 0: 469780 bytes loaded at 0xffffffff82a3bef6
                                      firmware: 'iwn6000g2bfw' version 0: 679436 bytes loaded at 0xffffffff829960ea
                                      firmware: 'iwn6000g2afw' version 0: 677296 bytes loaded at 0xffffffff828f0b3a
                                      firmware: 'iwn6000fw' version 0: 454608 bytes loaded at 0xffffffff82881b6a
                                      firmware: 'iwn5150fw' version 0: 337400 bytes loaded at 0xffffffff8282f572
                                      firmware: 'iwn5000fw' version 0: 340696 bytes loaded at 0xffffffff827dc29a
                                      wlan: mac acl policy registered
                                      firmware: 'mxge_rss_ethp_z8e' version 544468: 152837 bytes loaded at 0xffffffff82cafd20
                                      firmware: 'mxge_rss_eth_z8e' version 534724: 151912 bytes loaded at 0xffffffff82c8ab00
                                      firmware: 'mxge_ethp_z8e' version 387604: 121317 bytes loaded at 0xffffffff82c6d060
                                      firmware: 'mxge_eth_z8e' version 377284: 120629 bytes loaded at 0xffffffff82c4f870
                                      firmware: 'mwlboot' version 0: 2280 bytes loaded at 0xffffffff82ac5ce6
                                      firmware: 'mw88W8363fw' version 0: 94940 bytes loaded at 0xffffffff82aaea0a
                                      feeder_register: snd_unit=-1 snd_maxautovchans=16 latency=2 feeder_rate_min=1 feeder_rate_max=2016000 feeder_rate_round=25
                                      snd_unit_init() u=0x00ff8000 [512] d=0x00007c00 [32] c=0x000003ff [1024]
                                      firmware: 'iwn4965fw' version 0: 187972 bytes loaded at 0xffffffff827ae456
                                      firmware: 'iwn2030fw' version 0: 707392 bytes loaded at 0xffffffff82701916
                                      firmware: 'iwn2000fw' version 0: 695876 bytes loaded at 0xffffffff82657ad2
                                      firmware: 'iwn135fw' version 0: 701228 bytes loaded at 0xffffffff825ac7a6
                                      firmware: 'iwn105fw' version 0: 689680 bytes loaded at 0xffffffff82504196
                                      firmware: 'iwn100fw' version 0: 337572 bytes loaded at 0xffffffff824b1af2
                                      firmware: 'iwn1000fw' version 0: 337520 bytes loaded at 0xffffffff8245f482
                                      firmware: 'iwm8265fw' version 0: 1811984 bytes loaded at 0xffffffff822a4e72
                                      firmware: 'rtwn-rtl8821aufw' version 111: 27804 bytes loaded at 0xffffffff82af391e
                                      firmware: 'rtwn-rtl8812aufw' version 111: 32060 bytes loaded at 0xffffffff82aebbe2
                                      firmware: 'rtwn-rtl8192eufw' version 111: 31818 bytes loaded at 0xffffffff82ae3f98
                                      firmware: 'rtwn-rtl8192cfwU' version 111: 16126 bytes loaded at 0xffffffff82ae009a
                                      firmware: 'rtwn-rtl8192cfwT' version 111: 16126 bytes loaded at 0xffffffff82adc19c
                                      firmware: 'rtwn-rtl8192cfwE_B' version 111: 16332 bytes loaded at 0xffffffff82ad81d0
                                      firmware: 'wpifw' version 153229: 150100 bytes loaded at 0xffffffff82b1a392
                                      firmware: 'rtwn-rtl8192cfwE' version 111: 14818 bytes loaded at 0xffffffff82ad47ee
                                      firmware: 'rtwn-rtl8188eufw' version 111: 13904 bytes loaded at 0xffffffff82ad119e
                                      firmware: 'rtwn-rtl8188eefw' version 111: 11216 bytes loaded at 0xffffffff82ace5ce
                                      firmware: 'iwm8000Cfw' version 0: 2351636 bytes loaded at 0xffffffff82066c5e
                                      firmware: 'iwm7265Dfw' version 0: 1383604 bytes loaded at 0xffffffff81f14faa
                                      firmware: 'iwm7265fw' version 0: 1180412 bytes loaded at 0xffffffff81df4cae
                                      firmware: 'iwm7260fw' version 0: 1049340 bytes loaded at 0xffffffff81cf49b2
                                      firmware: 'iwm3168fw' version 0: 1028032 bytes loaded at 0xffffffff81bf99f2
                                      random: entropy device external interface
                                      TCP_ratelimit: Is now initialized
                                      SMP: passed TSC synchronization test
                                      elvt0: 0x00010000 elvt1: 0x00010000 elvt2: 0x00010000 elvt3: 0x00010000
                                      AMD ext features: 0x00040007
                                      timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400
                                      lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff
                                      ID: 0x01000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff
                                      cpu1 AP:
                                      SMP: AP CPU #1 Launched!
                                      elvt0: 0x00010000 elvt1: 0x00010000 elvt2: 0x00010000 elvt3: 0x00010000
                                      AMD ext features: 0x00040007
                                      timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400
                                      lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff
                                      ID: 0x03000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff
                                      cpu3 AP:
                                      SMP: AP CPU #3 Launched!
                                      elvt0: 0x00010000 elvt1: 0x00010000 elvt2: 0x00010000 elvt3: 0x00010000
                                      AMD ext features: 0x00040007
                                      timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400
                                      lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff
                                      ID: 0x02000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff
                                      cpu2 AP:
                                      SMP: AP CPU #2 Launched!
                                      elvt0: 0x00010000 elvt1: 0x000000f2 elvt2: 0x00010000 elvt3: 0x00010000
                                      AMD ext features: 0x00040007
                                      timer: 0x000300ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400
                                      lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff
                                      ID: 0x00000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff
                                      cpu0 BSP:
                                      ioapic1 <Version 2.1> irqs 24-55
                                      ioapic0 <Version 2.1> irqs 0-23
                                      lapic: LINT1 polarity: high
                                      lapic: LINT1 trigger: edge
                                      lapic: Routing NMI -> LINT1
                                      ioapic0: intpin 9 polarity: low
                                      ioapic0: intpin 9 trigger: level
                                      MADT: Interrupt override: source 9, irq 9
                                      ioapic0: Routing IRQ 0 -> intpin 2
                                      MADT: Interrupt override: source 0, irq 2
                                      ioapic1: ver 0x21 maxredir 0x1f
                                      ioapic1: MADT APIC ID 5 != hw id 0
                                      MADT: Found IO APIC ID 5, Interrupt 24 at 0xfec20000
                                      ioapic0: Routing external 8259A's -> intpin 0
                                      ioapic0: ver 0x21 maxredir 0x17
                                      MADT: Found IO APIC ID 4, Interrupt 0 at 0xfec00000
                                      ACPI: HPET 0x00000000DFFBEB10 000038 (v01 CORE COREBOOT 00000000 CORE 00000000)
                                      ACPI: SSDT 0x00000000DFFBE340 0007C8 (v01 AMD AGESA 00000001 AMD 00000001)
                                      ACPI: SSDT 0x00000000DFFB9A90 0048A6 (v02 AMD AGESA 00000002 MSFT 04000000)
                                      ACPI: HEST 0x00000000DFFB98C0 0001D0 (v01 CORE COREBOOT 00000000 CORE 00000000)
                                      ACPI: APIC 0x00000000DFFB9840 00007E (v01 CORE COREBOOT 00000000 CORE 00000000)
                                      ACPI: SSDT 0x00000000DFFB97F0 000045 (v02 CORE COREBOOT 0000002A CORE 0000002A)
                                      ACPI: FACS 0x00000000DFFB8210 000040
                                      ACPI: DSDT 0x00000000DFFB8250 001496 (v02 AMD COREBOOT 00010001 INTL 20140114)
                                      ACPI: FACP 0x00000000DFFB96F0 0000F4 (v04 CORE COREBOOT 00000000 CORE 00000000)
                                      ACPI: XSDT 0x00000000DFFB80E0 00005C (v01 CORE COREBOOT 00000000 CORE 00000000)
                                      ACPI: RSDP 0x00000000000F4840 000024 (v02 CORE )
                                      ULE: setup cpu 3
                                      ULE: setup cpu 2
                                      ULE: setup cpu 1
                                      ULE: setup cpu 0
                                      hostuuid: using 00000000-0000-0000-0000-000000000000
                                      VIMAGE (virtualized network stack) enabled
                                      random: unblocking device.
                                      random: no platform bootloader entropy
                                      random: read 4096 bytes from preloaded cache
                                      x86bios: ROM 0x0a0000-0x0fefff at 0xfffff800000a0000
                                      x86bios: EBDA 0x09f000-0x09ffff at 0xfffff8000009f000
                                      x86bios: SSEG 0x09e000-0x09efff at 0xfffffe0008531000
                                      x86bios: IVT 0x000000-0x0004ff at 0xfffff80000000000
                                      Pentium Pro MTRR support enabled
                                      APIC: CPU 3 has ACPI ID 3
                                      APIC: CPU 2 has ACPI ID 2
                                      APIC: CPU 1 has ACPI ID 1
                                      APIC: CPU 0 has ACPI ID 0
                                      CPU3 (AP): APIC ID: 3
                                      Core HW ID = 3
                                      CPU2 (AP): APIC ID: 2
                                      Core HW ID = 2
                                      CPU1 (AP): APIC ID: 1
                                      Core HW ID = 1
                                      CPU0 (BSP): APIC ID: 0
                                      Core HW ID = 0
                                      Package HW ID = 0
                                      FreeBSD/SMP: 1 package(s) x 4 core(s)
                                      FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
                                      INTR: Adding local APIC 3 as a target
                                      INTR: Adding local APIC 2 as a target
                                      INTR: Adding local APIC 1 as a target
                                      AP boot address 0x9e000
                                      Core ID shift: 0
                                      L1 cache ID shift: 0
                                      L2 cache ID shift: 2
                                      Package ID shift: 3
                                      ACPI APIC Table: <CORE COREBOOT>
                                      LAPIC: ipi_wait() us multiplier 5 (r 176182 tsc 998139400)
                                      Event timer "LAPIC" quality 100
                                      SMP: Added CPU 3 (AP)
                                      MADT: Found CPU APIC ID 3 ACPI ID 3: enabled
                                      SMP: Added CPU 2 (AP)
                                      MADT: Found CPU APIC ID 2 ACPI ID 2: enabled
                                      SMP: Added CPU 1 (AP)
                                      MADT: Found CPU APIC ID 1 ACPI ID 1: enabled
                                      SMP: Added CPU 0 (AP)
                                      MADT: Found CPU APIC ID 0 ACPI ID 0: enabled
                                      avail memory = 4071268352 (3882 MB)
                                      0x0000000100000000 - 0x000000011efe7fff, 519995392 bytes (126952 pages)
                                      0x00000000dfe00000 - 0x00000000dff8cfff, 1626112 bytes (397 pages)
                                      0x0000000004002000 - 0x00000000d87a5fff, 3564781568 bytes (870308 pages)
                                      0x0000000000100000 - 0x00000000001fffff, 1048576 bytes (256 pages)
                                      0x0000000000010000 - 0x000000000009efff, 585728 bytes (143 pages)
                                      Physical memory chunk(s):
                                      real memory = 4815060992 (4592 MB)
                                      L2 unified cache: 2048 kbytes, 64 bytes/line, 1 lines/tag, 16-way associative
                                      L2 4KB instruction TLB: 512 entries, 4-way associative
                                      L2 4KB data TLB: 512 entries, 4-way associative
                                      L2 2MB instruction TLB: 0 entries, 2-way associative
                                      L2 2MB data TLB: 256 entries, 2-way associative
                                      L1 instruction cache: 32 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative
                                      L1 data cache: 32 kbytes, 64 bytes/line, 1 lines/tag, 8-way associative
                                      L1 4KB instruction TLB: 32 entries, fully associative
                                      L1 4KB data TLB: 40 entries, fully associative
                                      L1 2MB instruction TLB: 8 entries, fully associative
                                      L1 2MB data TLB: 8 entries, fully associative
                                      TSC: P-state invariant, performance statistics
                                      Revision=1, ASIDs=8
                                      SVM: Features=0x1cdf<NP,LbrVirt,SVML,NRIPS,TscRateMsr,FlushByAsid,DecodeAssist,PauseFilter,EncryptedMcodePatch,PauseFilterThreshold>
                                      XSAVE Features=0x1<XSAVEOPT>
                                      Structured Extended Features=0x8<BMI1>
                                      AMD Features2=0x1d4037ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,Topology,PNXC,DBE,PTSC,PL2I>
                                      AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
                                      Features2=0x3ed8220b<SSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C>
                                      Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
                                      Origin="AuthenticAMD" Id=0x730f01 Family=0x16 Model=0x30 Stepping=1
                                      CPU: AMD GX-412TC SOC (998.14-MHz K8-class CPU)
                                      Early TSC frequency 998139400Hz calibrated from 8254 PIT
                                      Preloaded TSLOG data "TSLOG" at 0xffffffff83cd9b80.
                                      Preloaded boot_entropy_cache "/boot/entropy" at 0xffffffff83cd9b28.
                                      Preloaded elf obj module "/boot/kernel/zfs.ko" at 0xffffffff83cd92c0.
                                      Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff83cd0000.
                                      VT(vga): resolution 640x480
                                      pmap: large map 8 PML4 slots (4096 GB)
                                      PPIM 0: PA=0xa0000, VA=0xffffffff84410000, size=0x10000, mode=0
                                      FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
                                      root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense amd64
                                      FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023
                                      FreeBSD is a registered trademark of The FreeBSD Foundation.
                                      The Regents of the University of California. All rights reserved.
                                      Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
                                      Copyright (c) 1992-2023 The FreeBSD Project.
                                      
                                      1 Reply Last reply Reply Quote 0
                                      • stephenw10S
                                        stephenw10 Netgate Administrator
                                        last edited by

                                        Yeah that all looks normal. I wouldn't expect it to show anything until stops responding. If it's a driver/hardware issue it might show additional output at that point.

                                        X 1 Reply Last reply Reply Quote 0
                                        • X
                                          Ximulate @stephenw10
                                          last edited by

                                          @stephenw10 I thought I nipped this issue.. running will for several days until just now.

                                          I have DNS redirection configured according to this recipe:
                                          https://docs.netgate.com/pfsense/en/latest/recipes/dns-redirect.html
                                          except I noticed I had set Destination: !This Firewall instead of LAN Address. I'm not sure the difference, but I changed it to LAN Address several days ago.

                                          Just now, the network failed again. GUI via browser reported 504 Gateway Timeout. I was able to RDP to my laptop which is connected to the pfSense console via serial. I pinged:
                                          8.8.8.8 - OK
                                          9.9.9.9 - OK
                                          1.1.1.1 - 100% packet lose
                                          10.0.11.11 - OK

                                          Via Console menu, I tried restarting PHP-FPM, and I was then able to open the GUI in the browser. Only issue I saw was the primary gateway offline. Via console, I tried playback restartallwan... waited probably about 5 mins but no response from the console. Went back to the GUI & rebooted. The router didn't come up. Had to power cycle.

                                          Excerpt from the System log shows:

                                          Mar 13 21:47:07 router kernel: module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1
                                          

                                          For context...

                                          Mar 13 21:47:07 router kernel: ---<<BOOT>>---
                                          Mar 13 21:47:07 router kernel: Copyright (c) 1992-2023 The FreeBSD Project.
                                          Mar 13 21:47:07 router kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
                                          Mar 13 21:47:07 router kernel: 	The Regents of the University of California. All rights reserved.
                                          Mar 13 21:47:07 router kernel: FreeBSD is a registered trademark of The FreeBSD Foundation.
                                          Mar 13 21:47:07 router kernel: FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec  6 20:45:47 UTC 2023
                                          Mar 13 21:47:07 router kernel:     root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense amd64
                                          Mar 13 21:47:07 router kernel: FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
                                          Mar 13 21:47:07 router kernel: VT(vga): resolution 640x480
                                          Mar 13 21:47:07 router kernel: CPU: AMD GX-412TC SOC                                (998.28-MHz K8-class CPU)
                                          Mar 13 21:47:07 router kernel:   Origin="AuthenticAMD"  Id=0x730f01  Family=0x16  Model=0x30  Stepping=1
                                          Mar 13 21:47:07 router kernel:   Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
                                          Mar 13 21:47:07 router kernel:   Features2=0x3ed8220b<SSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C>
                                          Mar 13 21:47:07 router kernel:   AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
                                          Mar 13 21:47:07 router kernel:   AMD Features2=0x1d4037ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,Topology,PNXC,DBE,PTSC,PL2I>
                                          Mar 13 21:47:07 router kernel:   Structured Extended Features=0x8<BMI1>
                                          Mar 13 21:47:07 router kernel:   XSAVE Features=0x1<XSAVEOPT>
                                          Mar 13 21:47:07 router kernel:   SVM: NP,NRIP,AFlush,DAssist,NAsids=8
                                          Mar 13 21:47:07 router kernel:   TSC: P-state invariant, performance statistics
                                          Mar 13 21:47:07 router kernel: real memory  = 4815060992 (4592 MB)
                                          Mar 13 21:47:07 router kernel: avail memory = 4071268352 (3882 MB)
                                          Mar 13 21:47:07 router kernel: Event timer "LAPIC" quality 100
                                          Mar 13 21:47:07 router kernel: ACPI APIC Table: <CORE   COREBOOT>
                                          Mar 13 21:47:07 router kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
                                          Mar 13 21:47:07 router kernel: FreeBSD/SMP: 1 package(s) x 4 core(s)
                                          Mar 13 21:47:07 router kernel: random: unblocking device.
                                          Mar 13 21:47:07 router kernel: ioapic1: MADT APIC ID 5 != hw id 0
                                          Mar 13 21:47:07 router kernel: ioapic0 <Version 2.1> irqs 0-23
                                          Mar 13 21:47:07 router kernel: ioapic1 <Version 2.1> irqs 24-55
                                          Mar 13 21:47:07 router kernel: Launching APs: 2 1 3
                                          Mar 13 21:47:07 router kernel: TCP_ratelimit: Is now initialized
                                          Mar 13 21:47:07 router kernel: random: entropy device external interface
                                          Mar 13 21:47:07 router kernel: wlan: mac acl policy registered
                                          Mar 13 21:47:07 router kernel: ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                          Mar 13 21:47:07 router kernel: ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                          Mar 13 21:47:07 router kernel: module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff807475a0, 0) error 1
                                          Mar 13 21:47:07 router kernel: ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                          Mar 13 21:47:07 router kernel: ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                          Mar 13 21:47:07 router kernel: module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1
                                          Mar 13 21:47:07 router kernel: ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                          Mar 13 21:47:07 router kernel: ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                          Mar 13 21:47:07 router kernel: module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80747700, 0) error 1
                                          Mar 13 21:47:07 router kernel: iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                          Mar 13 21:47:07 router kernel: iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                          Mar 13 21:47:07 router kernel: module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80765180, 0) error 1
                                          Mar 13 21:47:07 router kernel: iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                          Mar 13 21:47:07 router kernel: iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                          Mar 13 21:47:07 router kernel: module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80765230, 0) error 1
                                          Mar 13 21:47:07 router kernel: iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                          Mar 13 21:47:07 router kernel: iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                          Mar 13 21:47:07 router kernel: module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff807652e0, 0) error 1
                                          Mar 13 21:47:07 router kernel: kbd0 at kbdmux0
                                          Mar 13 21:47:07 router kernel: WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
                                          Mar 13 21:47:07 router kernel: netgate0: <Netgate APU>
                                          

                                          System log before reboot has a lot of:

                                          Mar 13 20:55:54 router kernel: arpresolve: can't allocate llinfo for 192.0.0.1 on igb1
                                          Mar 13 20:56:04 router kernel: arpresolve: can't allocate llinfo for 192.0.0.1 on igb1
                                          

                                          192.0.0.1 is the IPv4 IP from T-Mobile cellular I use for backup. For a deeper dive, see https://wirelessjoint.com/viewtopic.php?t=4191

                                          Then, in resolver log:

                                          Mar 13 20:25:28 router unbound[15698]: [15698:2] notice: ssl handshake failed 10.111.11.118 port 54946
                                          Mar 13 20:26:50 router unbound[15698]: [15698:3] error: ssl handshake failed crypto error:0A000416:SSL routines::sslv3 alert certificate unknown
                                          Mar 13 20:26:50 router unbound[15698]: [15698:3] notice: ssl handshake failed 10.111.11.115 port 61484
                                          Mar 13 20:52:15 router unbound[15698]: [15698:0] info: service stopped (unbound 1.18.0).
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: server stats for thread 0: 0 queries, 0 answers from cache, 0 recursions, 0 prefetch, 0 rejected by ip ratelimiting
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: server stats for thread 0: requestlist max 0 avg 0 exceeded 0 jostled 0
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: server stats for thread 1: 4 queries, 4 answers from cache, 0 recursions, 3 prefetch, 0 rejected by ip ratelimiting
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: server stats for thread 1: requestlist max 0 avg 0 exceeded 0 jostled 0
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: server stats for thread 2: 0 queries, 0 answers from cache, 0 recursions, 0 prefetch, 0 rejected by ip ratelimiting
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: server stats for thread 2: requestlist max 0 avg 0 exceeded 0 jostled 0
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: server stats for thread 3: 3 queries, 2 answers from cache, 1 recursions, 1 prefetch, 0 rejected by ip ratelimiting
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: server stats for thread 3: requestlist max 1 avg 0.5 exceeded 0 jostled 0
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: average recursion processing time 0.042078 sec
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: histogram of recursion processing times
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: [25%]=0 median[50%]=0 [75%]=0
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info: lower(secs) upper(secs) recursions
                                          Mar 13 20:52:19 router unbound[15698]: [15698:0] info:    0.032768    0.065536 1
                                          Mar 13 20:53:04 router unbound[61026]: [61026:0] notice: init module 0: iterator
                                          Mar 13 20:53:04 router unbound[61026]: [61026:0] info: start of service (unbound 1.18.0).
                                          Mar 13 20:53:32 router unbound[61026]: [61026:0] info: service stopped (unbound 1.18.0).
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: server stats for thread 0: 7 queries, 1 answers from cache, 6 recursions, 0 prefetch, 0 rejected by ip ratelimiting
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: server stats for thread 0: requestlist max 1 avg 0.333333 exceeded 0 jostled 0
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: average recursion processing time 0.153774 sec
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: histogram of recursion processing times
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: [25%]=0.028672 median[50%]=0.174763 [75%]=0.240299
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: lower(secs) upper(secs) recursions
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    0.016384    0.032768 2
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    0.131072    0.262144 3
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    0.262144    0.524288 1
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: server stats for thread 1: 35 queries, 12 answers from cache, 23 recursions, 0 prefetch, 0 rejected by ip ratelimiting
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: server stats for thread 1: requestlist max 5 avg 1.13043 exceeded 0 jostled 0
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: average recursion processing time 0.232330 sec
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: histogram of recursion processing times
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: [25%]=0.0251611 median[50%]=0.114688 [75%]=0.199885
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: lower(secs) upper(secs) recursions
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    0.008192    0.016384 2
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    0.016384    0.032768 7
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    0.032768    0.065536 1
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    0.065536    0.131072 2
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    0.131072    0.262144 10
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info:    2.000000    4.000000 1
                                          Mar 13 20:53:36 router unbound[61026]: [61026:0] info: server stats for thread 2: 16 queries, 8 answers from cache, 8 recursions, 0 prefetch, 0 rejected by ip ratelimiting
                                          
                                          1 Reply Last reply Reply Quote 0
                                          • stephenw10S
                                            stephenw10 Netgate Administrator
                                            last edited by

                                            Did you decide what 192.0.0.1 is?

                                            One interesting thing is that it's detected as an APU1 but that's an APU2. What does the output of kenv | grep smbios show?

                                            X 2 Replies Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.