Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    pfSense crashed

    Scheduled Pinned Locked Moved Virtualization
    12 Posts 4 Posters 1.5k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • K Offline
      kevinkok @kiokoman
      last edited by

      @kiokoman I'm running the latest Proxmox VE, and I think everything is as updated as it can be already... So, I suppose there's not much info in the dump files that would point to something?

      1 Reply Last reply Reply Quote 0
      • stephenw10S Offline
        stephenw10 Netgate Administrator
        last edited by

        Hmm, weird backtrace:

        db:0:kdb.enter.default>  bt
        Tracing pid 12 tid 100114 td 0xfffff800061ca000
        kdb_enter() at kdb_enter+0x37/frame 0xffffffff83727560
        vpanic() at vpanic+0x197/frame 0xffffffff837275b0
        panic() at panic+0x43/frame 0xffffffff83727610
        dblfault_handler() at dblfault_handler+0x1d1/frame 0xffffffff837276d0
        Xdblfault() at Xdblfault+0xd2/frame 0xffffffff837276d0
        --- trap 0x17, rip = 0xffffffff8138264a, rsp = 0xfffffe0000541fe0, rbp = 0xfffffe00005420e0 ---
        trap() at trap+0x20a/frame 0xfffffe00005420e0
        calltrap() at calltrap+0x8/frame 0xfffffe00005420e0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe00005421b8, rbp = 0xfffffe00005422c0 ---
        printf() at printf+0x3/frame 0xfffffe00005422c0
        calltrap() at calltrap+0x8/frame 0xfffffe00005422c0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000542398, rbp = 0xfffffe00005424a0 ---
        printf() at printf+0x3/frame 0xfffffe00005424a0
        calltrap() at calltrap+0x8/frame 0xfffffe00005424a0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000542578, rbp = 0xfffffe0000542680 ---
        printf() at printf+0x3/frame 0xfffffe0000542680
        calltrap() at calltrap+0x8/frame 0xfffffe0000542680
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000542758, rbp = 0xfffffe0000542860 ---
        printf() at printf+0x3/frame 0xfffffe0000542860
        calltrap() at calltrap+0x8/frame 0xfffffe0000542860
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000542938, rbp = 0xfffffe0000542a40 ---
        printf() at printf+0x3/frame 0xfffffe0000542a40
        calltrap() at calltrap+0x8/frame 0xfffffe0000542a40
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000542b18, rbp = 0xfffffe0000542c20 ---
        printf() at printf+0x3/frame 0xfffffe0000542c20
        calltrap() at calltrap+0x8/frame 0xfffffe0000542c20
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000542cf8, rbp = 0xfffffe0000542e00 ---
        printf() at printf+0x3/frame 0xfffffe0000542e00
        calltrap() at calltrap+0x8/frame 0xfffffe0000542e00
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000542ed8, rbp = 0xfffffe0000542fe0 ---
        printf() at printf+0x3/frame 0xfffffe0000542fe0
        calltrap() at calltrap+0x8/frame 0xfffffe0000542fe0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe00005430b8, rbp = 0xfffffe00005431c0 ---
        printf() at printf+0x3/frame 0xfffffe00005431c0
        calltrap() at calltrap+0x8/frame 0xfffffe00005431c0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000543298, rbp = 0xfffffe00005433a0 ---
        printf() at printf+0x3/frame 0xfffffe00005433a0
        calltrap() at calltrap+0x8/frame 0xfffffe00005433a0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000543478, rbp = 0xfffffe0000543580 ---
        printf() at printf+0x3/frame 0xfffffe0000543580
        calltrap() at calltrap+0x8/frame 0xfffffe0000543580
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000543658, rbp = 0xfffffe0000543760 ---
        printf() at printf+0x3/frame 0xfffffe0000543760
        calltrap() at calltrap+0x8/frame 0xfffffe0000543760
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000543838, rbp = 0xfffffe0000543940 ---
        printf() at printf+0x3/frame 0xfffffe0000543940
        calltrap() at calltrap+0x8/frame 0xfffffe0000543940
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000543a18, rbp = 0xfffffe0000543b20 ---
        printf() at printf+0x3/frame 0xfffffe0000543b20
        calltrap() at calltrap+0x8/frame 0xfffffe0000543b20
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000543bf8, rbp = 0xfffffe0000543d00 ---
        printf() at printf+0x3/frame 0xfffffe0000543d00
        calltrap() at calltrap+0x8/frame 0xfffffe0000543d00
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000543dd8, rbp = 0xfffffe0000543ee0 ---
        printf() at printf+0x3/frame 0xfffffe0000543ee0
        calltrap() at calltrap+0x8/frame 0xfffffe0000543ee0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000543fb8, rbp = 0xfffffe00005440c0 ---
        printf() at printf+0x3/frame 0xfffffe00005440c0
        calltrap() at calltrap+0x8/frame 0xfffffe00005440c0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000544198, rbp = 0xfffffe00005442a0 ---
        printf() at printf+0x3/frame 0xfffffe00005442a0
        calltrap() at calltrap+0x8/frame 0xfffffe00005442a0
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000544378, rbp = 0xfffffe0000544480 ---
        printf() at printf+0x3/frame 0xfffffe0000544480
        calltrap() at calltrap+0x8/frame 0xfffffe0000544480
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000544558, rbp = 0xfffffe0000544660 ---
        printf() at printf+0x3/frame 0xfffffe0000544660
        calltrap() at calltrap+0x8/frame 0xfffffe0000544660
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000544738, rbp = 0xfffffe0000544840 ---
        printf() at printf+0x3/frame 0xfffffe0000544840
        calltrap() at calltrap+0x8/frame 0xfffffe0000544840
        --- trap 0x16, rip = 0xffffffff80de22f3, rsp = 0xfffffe0000544918, rbp = 0xfffffe0000544a20 ---
        printf() at printf+0x3/frame 0xfffffe0000544a20
        calltrap() at calltrap+0x8/frame 0xfffffe0000544a20
        --- trap 0x16, rip = 0xffffffff80d9f035, rsp = 0xfffffe0000544af8, rbp = 0xfffffe0000544b40 ---
        binuptime() at binuptime+0x5/frame 0xfffffe0000544b40
        lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0000544b70
        Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0000544b70
        --- interrupt, rip = 0xffffffff80ea0fd9, rsp = 0xfffffe0000544c40, rbp = 0xfffffe0000544c40 ---
        if_inc_counter() at if_inc_counter+0x19/frame 0xfffffe0000544c40
        vlan_transmit() at vlan_transmit+0x164/frame 0xfffffe0000544cb0
        ether_output_frame() at ether_output_frame+0xb4/frame 0xfffffe0000544ce0
        ng_apply_item() at ng_apply_item+0x8c/frame 0xfffffe0000544d80
        ng_snd_item() at ng_snd_item+0x188/frame 0xfffffe0000544dc0
        ng_pppoe_rcvdata() at ng_pppoe_rcvdata+0x24c/frame 0xfffffe0000544e50
        ng_apply_item() at ng_apply_item+0x8c/frame 0xfffffe0000544ef0
        ng_snd_item() at ng_snd_item+0x188/frame 0xfffffe0000544f30
        ng_apply_item() at ng_apply_item+0x8c/frame 0xfffffe0000544fd0
        ng_snd_item() at ng_snd_item+0x188/frame 0xfffffe0000545010
        ng_ppp_link_xmit() at ng_ppp_link_xmit+0x124/frame 0xfffffe0000545060
        ng_apply_item() at ng_apply_item+0x8c/frame 0xfffffe0000545100
        ng_snd_item() at ng_snd_item+0x188/frame 0xfffffe0000545140
        ng_apply_item() at ng_apply_item+0x8c/frame 0xfffffe00005451e0
        ng_snd_item() at ng_snd_item+0x188/frame 0xfffffe0000545220
        ng_iface_send() at ng_iface_send+0xd2/frame 0xfffffe00005452a0
        ng_iface_start() at ng_iface_start+0x62/frame 0xfffffe00005452e0
        if_transmit() at if_transmit+0x168/frame 0xfffffe0000545320
        ng_iface_output() at ng_iface_output+0x161/frame 0xfffffe0000545360
        pf_test() at pf_test+0x1e8e/frame 0xfffffe00005455c0
        pf_test() at pf_test+0x1ce4/frame 0xfffffe0000545820
        pf_check_in() at pf_check_in+0x1d/frame 0xfffffe0000545840
        pfil_run_hooks() at pfil_run_hooks+0x87/frame 0xfffffe00005458d0
        ip_tryforward() at ip_tryforward+0x193/frame 0xfffffe0000545950
        ip_input() at ip_input+0x3fe/frame 0xfffffe0000545a00
        netisr_dispatch_src() at netisr_dispatch_src+0xca/frame 0xfffffe0000545a50
        ether_demux() at ether_demux+0x16a/frame 0xfffffe0000545a80
        ether_nh_input() at ether_nh_input+0x330/frame 0xfffffe0000545ae0
        netisr_dispatch_src() at netisr_dispatch_src+0xca/frame 0xfffffe0000545b30
        ether_input() at ether_input+0x89/frame 0xfffffe0000545b90
        vtnet_rxq_eof() at vtnet_rxq_eof+0x7a5/frame 0xfffffe0000545c50
        vtnet_rx_vq_process() at vtnet_rx_vq_process+0xb7/frame 0xfffffe0000545c90
        ithread_loop() at ithread_loop+0x23c/frame 0xfffffe0000545cf0
        fork_exit() at fork_exit+0x7e/frame 0xfffffe0000545d30
        fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000545d30
        --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
        

        You are running PPPoE over a VLAN?

        Has this been setup for long? First time it crashed?

        Steve

        K 1 Reply Last reply Reply Quote 0
        • K Offline
          kevinkok @stephenw10
          last edited by

          Hey @stephenw10, yes, PPPoE over VLAN, in a home lab environment. This setup is kind of recent, like a month or so, and yes, this is the first time it crashed.

          1 Reply Last reply Reply Quote 0
          • stephenw10S Offline
            stephenw10 Netgate Administrator
            last edited by

            Hmm, nothing changed recently?

            K 1 Reply Last reply Reply Quote 0
            • K Offline
              kevinkok @stephenw10
              last edited by

              @stephenw10 No, I don't think so. There haven't been any changes to the VM settings nor pfSense settings...

              A 1 Reply Last reply Reply Quote 0
              • A Offline
                AdriftAtlas @kevinkok
                last edited by

                What's the host's CPU?

                K 1 Reply Last reply Reply Quote 0
                • K Offline
                  kevinkok @AdriftAtlas
                  last edited by

                  Sorry for the late reply, the host CPU is 4 x Intel(R) Celeron(R) N5105 @ 2.00GHz.

                  A 1 Reply Last reply Reply Quote 0
                  • A Offline
                    AdriftAtlas @kevinkok
                    last edited by

                    You're in good company:
                    VM freezes irregularly

                    TL;DR: VMs running on a Jasper Lake CPU Proxmox host crash. The host normally stays up and LXC containers are not affected. Issue appears to be related to C-States.

                    K 1 Reply Last reply Reply Quote 1
                    • K Offline
                      kevinkok @AdriftAtlas
                      last edited by

                      Thanks for the info, guess I'll follow that thread then. Thanks again everyone!

                      1 Reply Last reply Reply Quote 0
                      • A Offline
                        AdriftAtlas
                        last edited by

                        The issue is fixed with 0x24000024 microcode:
                        https://forum.proxmox.com/threads/vm-freezes-irregularly.111494/post-538922

                        1 Reply Last reply Reply Quote 1
                        • jimpJ jimp moved this topic from General pfSense Questions on
                        • First post
                          Last post
                        Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.