Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Reproducible kernel panic with pfSense 2.2 and IPSEC

    Scheduled Pinned Locked Moved IPsec
    52 Posts 14 Posters 19.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • w0wW
      w0w
      last edited by

      My system is D2500CC mini-ITX motherboard from Intel, all embedded into it.
      I have configured WAN as PPPoE and LAN as 10.0.x.x
      I have also configured IPsec for mobile clients using this "guide" https://forum.pfsense.org/index.php?topic=87655.msg488294#msg488294
      Virtual IP network for mobile clients is configured as 10.0.y.y
      When I get the successful connection it looks like traffic is not moving at all between client and firewall. Mostly it crashes with this panic

      Fatal double fault:
      eip = 0xc0cd225f
      esp = 0xe0783fe8
      ebp = 0xe0784050
      cpuid = 1; apic id = 01
      panic: double fault
      cpuid = 1
      KDB: enter: panic

      Full version is

      http://pastebin.com/mSLw8QfX

      1 Reply Last reply Reply Quote 0
      • w0wW
        w0w
        last edited by

        Currently disabled IP Random id generation (Insert a stronger id into IP header of packets passing through the filter.)
        Testing…

        1 Reply Last reply Reply Quote 0
        • w0wW
          w0w
          last edited by

          So far so good… no problems currently with IPSEC uptime and panics. Using Stronswan android client 12 hours already.
          Previous record was 1 minute with  IP Random id generation enabled

          1 Reply Last reply Reply Quote 0
          • S
            sh0gun
            last edited by

            @ermal:

            For example
            kern.timecounter.hardware: TSC-low
            kern.timecounter.choice: TSC-low(1000) ACPI-fast(900) i8254(0) HPET(950) dummy(-1000000)

            On my ALIX board I have the choice between the following time sources: TSC(800) i8254(0) dummy(-1000000)

            Changing the timesource with

            sysctl kern.timecounter.hardware=i8254
            kern.timecounter.hardware: TSC -> i8254
            

            does not have an effect on this issue. After changing the timesource IPSEC keeps crashing on first ping from remote.

            Here are the latest dump with timesource i8254:

            Fatal double fault:
            eip = 0xc0cef7e0
            esp = 0xc8b69000
            ebp = 0xc8b69008
            cpuid = 0; apic id = 00
            panic: double fault
            cpuid = 0
            KDB: enter: panic
            [ thread pid 12 tid 100015 ]
            Stopped at      kdb_enter+0x3d: movl    $0,kdb_why
            db:0:kdb.enter.default> textdump set
            textdump set
            db:0:kdb.enter.default>  capture on
            db:0:kdb.enter.default>  run lockinfo
            db:1:lockinfo> show locks
            No such command
            db:1:locks>  show alllocks
            No such command
            db:1:alllocks>  show lockedvnods
            Locked vnodes
            db:0:kdb.enter.default>  show pcpu
            cpuid        = 0
            dynamic pcpu = 0x5e7a00
            curthread    = 0xc4317c40: pid 12 "swi5: fast taskq"
            curpcb       = 0xc8b6ad60
            fpcurthread  = none
            idlethread   = 0xc426d000: tid 100003 "idle: cpu0"
            APIC ID      = 0
            currentldt   = 0x50
            db:0:kdb.enter.default>  bt
            Tracing pid 12 tid 100015 td 0xc4317c40
            kdb_enter(c142c723,c142c723,c15ea443,c205b4c8,0,...) at kdb_enter+0x3d/frame 0xc205b480
            panic(c15ea443,0,0,0,c8b69008,...) at panic+0x144/frame 0xc205b4bc
            dblfault_handler() at dblfault_handler+0xab/frame 0xc205b4bc
            --- trap 0x17, eip = 0xc0cef7e0, esp = 0xc8b69000, ebp = 0xc8b69008 ---
            critical_exit(c1e3718c,c0cd1bf4,0,0,0,...) at critical_exit/frame 0xc8b69008
            i8254_get_timecount(c446f618,c1e049c4,34,0,0,...) at i8254_get_timecount+0x141/frame 0xc8b69030
            tc_windup(1,0,c142675e,219,0,...) at tc_windup+0x45/frame 0xc8b69080
            hardclock_cnt(1,0,c1e3718c,0,0,...) at hardclock_cnt+0x447/frame 0xc8b690e8
            handleevents(0,0,0,0,0,...) at handleevents+0xee/frame 0xc8b69138
            timercb(c446f640,0,c4268310,0,0,...) at timercb+0x3b9/frame 0xc8b69198
            clkintr(c446f600,0,c4317c40,0,c1e3718c,...) at clkintr+0xfc/frame 0xc8b691bc
            intr_event_handle(c426bb80,c8b69228,c42685f0,c4ead154,c1e3718c,...) at intr_event_handle+0x85/frame 0xc8b691dc
            intr_execute_handlers(c1e3718c,c8b69228) at intr_execute_handlers+0x42/frame 0xc8b691fc
            atpic_handle_intr(0,c8b69228) at atpic_handle_intr+0x5a/frame 0xc8b69218
            Xatpic_intr0() at Xatpic_intr0+0x22/frame 0xc8b69218
            --- interrupt, eip = 0xc0dd89f7, esp = 0xc8b69268, ebp = 0xc8b69290 ---
            rn_match(c8b692c8,c4ead100,c8b692c8,c0e22d00,c1e14bb8,...) at rn_match+0x17/frame 0xc8b69290
            pfr_match_addr(c4ec0000,c4c3e832,2,c48ff600,0,...) at pfr_match_addr+0xd5/frame 0xc8b692f0
            pf_normalize_ip(c8b6962c,2,c4a24800,c8b69584,c8b69528,...) at pf_normalize_ip+0x2d6/frame 0xc8b69388
            pf_test(2,c424f400,c8b6962c,0,c8b696c8,...) at pf_test+0x246/frame 0xc8b695e4
            pf_check_out(0,c8b6962c,c424f400,2,0,...) at pf_check_out+0x4b/frame 0xc8b69608
            pfil_run_hooks(c20a1c14,c8b696f4,c424f400,2,0,...) at pfil_run_hooks+0x88/frame 0xc8b69660
            ip_output(c48f7b00,0,0,2,0,...) at ip_output+0xaac/frame 0xc8b69718
            ipsec_process_done(c48f7b00,c4e94180,0,f228ae0e,c48f7b00,...) at ipsec_process_done+0x3cf/frame 0xc8b69768
            esp_output_cb(c60c2bf4,c1e21524,c8b697f8,c0f9f5e1,c48f7b00,...) at esp_output_cb+0x3cd/frame 0xc8b697c0
            crypto_done(c60c2bf4,c48f7b00,8c,c,c8b699a8,...) at crypto_done+0x99/frame 0xc8b697f8
            swcr_process(c4269080,c60c2bf4,0,c8b69a60,c0ccd50d,...) at swcr_process+0x6e/frame 0xc8b69a00
            crypto_invoke(0,40,0,0,0,...) at crypto_invoke+0x79/frame 0xc8b69a38
            crypto_dispatch(c60c2bf4,c145696b,375,c8b69abb,c4c3e828,...) at crypto_dispatch+0x64/frame 0xc8b69a60
            esp_output(c48f7b00,c4e94180,0,14,9,...) at esp_output+0x91d/frame 0xc8b69ae0
            ipsec4_process_packet(c48f7b00,c4e94180,0,0,0,...) at ipsec4_process_packet+0x312/frame 0xc8b69b70
            ip_ipsec_output(c8b69c34,0,c8b69c30,c8b69c2c,0,...) at ip_ipsec_output+0x1c8/frame 0xc8b69ba0
            ip_output(c48f7b00,0,0,0,0,...) at ip_output+0xa2f/frame 0xc8b69c58
            icmp_reflect(c8b69d28,10,0,c8b69d04,90000,...) at icmp_reflect+0x5b5/frame 0xc8b69cb0
            icmp_input(c48f7b00,14,c8b69d8c,1,c8b69ddc,...) at icmp_input+0x9b9/frame 0xc8b69d78
            ip_input(c48f7b00,c20a184c,c4317c40,0,c8b69e50,...) at ip_input+0x295/frame 0xc8b69ddc
            netisr_dispatch_src(1,0,c48f7b00) at netisr_dispatch_src+0x8b/frame 0xc8b69e24
            netisr_dispatch(1,c48f7b00,1,102,0,...) at netisr_dispatch+0x20/frame 0xc8b69e38
            _ipip_input(c48f7b00,14,4,1,3c,...) at _ipip_input+0x650/frame 0xc8b69e80
            encap4_input(c48f7b00,14,0,c0dd4f18,1,...) at encap4_input+0x210/frame 0xc8b69ee0
            ip_input(c48f7b00,2,40,0,0,...) at ip_input+0x295/frame 0xc8b69f48
            netisr_dispatch_src(1,611ea2cb,c48f7b00,101,68,...) at netisr_dispatch_src+0x8b/frame 0xc8b69f90
            ipsec4_common_input_cb(c48f7b00,c67d6d00,14,9,0,...) at ipsec4_common_input_cb+0x276/frame 0xc8b69fd8
            esp_input_cb(c60c2bf4,c053cd1d,c4f59cf8,e,c4c3e89e,...) at esp_input_cb+0x772/frame 0xc8b6a068
            crypto_done(c60c2bf4,c8b6a240,10,10,c8b6a240,...) at crypto_done+0x99/frame 0xc8b6a0a0
            swcr_process(c4269080,c60c2bf4,0,c8b6a308,c0ccd50d,...) at swcr_process+0x6e/frame 0xc8b6a2a8
            crypto_invoke(0,c4c3e8ae,c60850b8,c,c60850b8,...) at crypto_invoke+0x79/frame 0xc8b6a2e0
            crypto_dispatch(c60c2bf4,c145696b,1c8,c60850b8,c57dc528,...) at crypto_dispatch+0x64/frame 0xc8b6a308
            esp_input(c48f7b00,c67d6d00,14,9,d0,...) at esp_input+0x771/frame 0xc8b6a370
            ipsec_common_input(9,2,32,c8b6a408) at ipsec_common_input+0x4f7/frame 0xc8b6a3dc
            ipsec4_common_input(c48f7b00,14,32) at ipsec4_common_input+0x39/frame 0xc8b6a3f4
            esp4_input(c48f7b00,14,c424f400,1,0,...) at esp4_input+0x20/frame 0xc8b6a408
            ip_input(c48f7b00,801,c4902a00,c43c0f68,c0d1f5ce,...) at ip_input+0x295/frame 0xc8b6a470
            netisr_dispatch_src(1,0,c48f7b00) at netisr_dispatch_src+0x8b/frame 0xc8b6a4b8
            netisr_dispatch(1,c48f7b00,c4902a00,c431a000,6e,...) at netisr_dispatch+0x20/frame 0xc8b6a4cc
            ng_iface_rcvdata(c4793680,c4a4a000,c4317c40,c4f20600,0,...) at ng_iface_rcvdata+0xea/frame 0xc8b6a4f4
            ng_apply_item(0,c4902a00,14,c4a632f4,c8b6a584,...) at ng_apply_item+0x22d/frame 0xc8b6a550
            ng_snd_item(c4a4a000,0,c4793700,0,0,...) at ng_snd_item+0x1a0/frame 0xc8b6a584
            ng_tcpmss_rcvdata(c4793800,c4a4a000,46507c40,2f1c645d,c8b6a68c,...) at ng_tcpmss_rcvdata+0xac/frame 0xc8b6a5cc
            ng_apply_item(0,34,5dc,c8b6a760,0,...) at ng_apply_item+0x22d/frame 0xc8b6a628
            ng_snd_item(c4a4a000,0,c47b9000,0,c4a4a000,...) at ng_snd_item+0x1a0/frame 0xc8b6a65c
            ng_ppp_comp_recv(21,0,1,c48f7b00,c4a4a000,...) at ng_ppp_comp_recv+0x158/frame 0xc8b6a688
            ng_ppp_crypt_recv(21,0,d80e0e6a,c8b6a820,c0ee51a9,...) at ng_ppp_crypt_recv+0x70/frame 0xc8b6a6a4
            ng_ppp_rcvdata(c4793b00,c4a4a000,c4902a00,0,c4317c40,...) at ng_ppp_rcvdata+0x2e4/frame 0xc8b6a700
            ng_apply_item(0,0,0,246,c209f300,...) at ng_apply_item+0x22d/frame 0xc8b6a75c
            ng_snd_item(c4a4a000,0,c4793880,0,362cd2a1,...) at ng_snd_item+0x1a0/frame 0xc8b6a790
            ng_tee_rcvdata(c4793c00,c4a4a000,1,0,c8b6a7e4,...) at ng_tee_rcvdata+0x156/frame 0xc8b6a7b8
            ng_apply_item(0,c4c3e812,6,c4a645e0,1,...) at ng_apply_item+0x22d/frame 0xc8b6a814
            ng_snd_item(c4a4a000,0,c4793c80,0,c46a9900,...) at ng_snd_item+0x1a0/frame 0xc8b6a848
            ng_pppoe_rcvdata_ether(c4793d00,c4a4a000,c4a645e0,34,1c5,...) at ng_pppoe_rcvdata_ether+0x2a3/frame 0xc8b6a8c4
            ng_apply_item(0,c47b0000,c48f7b00,0,c8b6a954,...) at ng_apply_item+0x22d/frame 0xc8b6a920
            ng_snd_item(c4a4a000,0,c47b9a00,0,c47b0000,...) at ng_snd_item+0x1a0/frame 0xc8b6a954
            ng_ether_input_orphan(c47b0000,c48f7b00,0,b1ce9d7,a1d20db3,...) at ng_ether_input_orphan+0x66/frame 0xc8b6a974
            ether_demux(c47b0000,c48f7b00,6,c4317c40,c4317c40,...) at ether_demux+0x1f9/frame 0xc8b6a9a0
            ether_nh_input(c48f7b00,c8b6aa14,0,0,0,...) at ether_nh_input+0x37e/frame 0xc8b6a9f0
            netisr_dispatch_src(9,0,c48f7b00) at netisr_dispatch_src+0x8b/frame 0xc8b6aa38
            netisr_dispatch(9,c48f7b00) at netisr_dispatch+0x20/frame 0xc8b6aa4c
            ether_input(c47b0000,c48f7b00,0,c8b6aae0,c0cd1bf4,...) at ether_input+0x19/frame 0xc8b6aa5c
            vlan_input(c424fc00,c48f7b00,c4317c40,c4bfd008,c43d0100,...) at vlan_input+0x1a8/frame 0xc8b6aa8c
            ether_demux(c424fc00,c48f7b00,6,7f8,c4bfd008,...) at ether_demux+0xaf/frame 0xc8b6aab8
            ether_nh_input(c48f7b00,c4bbd200,2f4,c8b6ab70,c0b4e3ba,...) at ether_nh_input+0x37e/frame 0xc8b6ab04
            netisr_dispatch_src(9,0,c48f7b00) at netisr_dispatch_src+0x8b/frame 0xc8b6ab4c
            netisr_dispatch(9,c48f7b00) at netisr_dispatch+0x20/frame 0xc8b6ab60
            ether_input(c424fc00,c48f7b00,c43a4000,745,c8b6abb8,...) at ether_input+0x19/frame 0xc8b6ab70
            vr_rxeof(0,0,c4317c40,c8b6abd8,46,...) at vr_rxeof+0x1f1/frame 0xc8b6abb8
            vr_int_task(c43cc000,1,c8b6ac18,c12bc042,c426bb80,...) at vr_int_task+0x123/frame 0xc8b6abe8
            taskqueue_run_locked(c8b6ac88,c128c712,0,c8b6ac44,c4310008,...) at taskqueue_run_locked+0xee/frame 0xc8b6ac2c
            taskqueue_run(c4269980) at taskqueue_run+0xa3/frame 0xc8b6ac50
            taskqueue_fast_run(0,0,246,0,0,...) at taskqueue_fast_run+0x11/frame 0xc8b6ac5c
            intr_event_execute_handlers(109,c4269900,c1428033,55a,0,...) at intr_event_execute_handlers+0xaa/frame 0xc8b6ac88
            ithread_loop(c41b5e70,c8b6ad08,0,0,0,...) at ithread_loop+0x80/frame 0xc8b6acc4
            fork_exit(c0cb63f0,c41b5e70,c8b6ad08) at fork_exit+0xa3/frame 0xc8b6acf4
            fork_trampoline() at fork_trampoline+0x8/frame 0xc8b6acf4
            --- trap 0, eip = 0, esp = 0xc8b6ad40, ebp = 0 ---
            db:0:kdb.enter.default>  ps
              pid  ppid  pgrp   uid   state   wmesg     wchan    cmd
            30982   285   285     0  R                           php-fpm
            71440 73267    21     0  S       nanslp   0xc1efd568 sleep
            60001 59799 60001     0  Ss      (threaded)          charon
            100155                   S       uwait    0xc57e6580 charon
            100154                   S       uwait    0xc57e6500 charon
            100153                   S       uwait    0xc4a6f280 charon
            100152                   S       uwait    0xc57e6400 charon
            100151                   S       uwait    0xc57e6780 charon
            100150                   S       uwait    0xc57e7b80 charon
            100149                   S       uwait    0xc57e7c00 charon
            100148                   S       uwait    0xc57e6a80 charon
            100147                   S       uwait    0xc57e6800 charon
            100146                   S       uwait    0xc4e94b00 charon
            100145                   S       uwait    0xc57e6600 charon
            100144                   S       uwait    0xc4a6f380 charon
            100143                   S       select   0xc46af6e4 charon
            100142                   S       select   0xc46af724 charon
            100141                   S       accept   0xc57d61e6 charon
            100140                   S       uwait    0xc57e9700 charon
            100060                   S       sigwait  0xc674c000 charon
            59799     1 59799     0  Ss      select   0xc6703824 starter
            85529 89861 89861     0  S+      ttyin    0xc4313470 sh
            90198 78569 90198     0  Ss      (threaded)          sshlockout_pf
            100124                   S       nanslp   0xc1efd568 sshlockout_pf
            100055                   S       piperd   0xc47f47f8 sshlockout_pf
            89861     1 89861     0  Ss+     wait     0xc48ac8d0 login
            89557     1     1     0  S       nanslp   0xc1efd568 getty
            87839 87796 87796     0  S       nanslp   0xc1efd568 minicron
            87796     1 87796     0  Ss      wait     0xc47985e0 minicron
            87654 87281 87281     0  S       nanslp   0xc1efd568 minicron
            87281     1 87281     0  Ss      wait     0xc48ab000 minicron
            86900 86382 86382     0  S       nanslp   0xc1efd568 minicron
            86382     1 86382     0  Ss      wait     0xc4f96000 minicron
            84022     1 84022     0  Ss      nanslp   0xc1efd568 cron
            78569     1 78569     0  Ss      select   0xc4a361e4 syslogd
            73996     1 73996     0  Ss      select   0xc4a38ba4 igmpproxy
            73267     1    21     0  S+      wait     0xc4f978d0 sh
            65451     1 65451     0  Ss      (threaded)          ntpd
            100056                   S       select   0xc46ac7a4 ntpd
            60741     1 60741     0  Ss      (threaded)          filterdns
            100101                   S       uwait    0xc4d6b500 signal-thread
            100100                   S       uwait    0xc57e9680 filterdns
            54653     1 54653  1002  Ss      select   0xc4437ba4 dhcpd
            48648     1 48359 65534  S       select   0xc4a362e4 dnsmasq
            44941     1 44633     0  S       kqread   0xc4ea7b80 lighttpd
            35762 35604 35604     0  S       piperd   0xc47f44c8 rrdtool
            35604     1 35604     0  Ss      select   0xc4a365a4 apinger
            32684     1 32684     0  Ss      select   0xc4a36824 inetd
            32208     1 32208     0  Ss      select   0xc4a36224 openvpn
            32123     1 32123     0  Ss      bpf      0xc4314c00 filterlog
            30648     1 30648     0  Ss      select   0xc4a36664 openvpn
            29293     1 29293     0  Ss      select   0xc4a366a4 openvpn
            28370     1 28370     0  Ss      select   0xc4a36ba4 openvpn
            25601     1 25601     0  Ss      select   0xc4a376e4 hostapd
            22824     1 22824    65  Ss      select   0xc4a37c64 dhclient
            19122     1 19122     0  Ss      select   0xc4a37ce4 dhclient
             8090     1  8090     0  Ss      (threaded)          sshlockout_pf
            100073                   S       nanslp   0xc1efd568 sshlockout_pf
            100072                   S       uwait    0xc47bae80 sshlockout_pf
             7521     1  7521     0  Ss      select   0xc4a38924 sshd
             6233     1  6233     0  Ss      (threaded)          mpd5
            100068                   S       select   0xc41d6ba4 mpd5
              320     1   320     0  Ss      select   0xc4437aa4 devd
              302   300   300     0  S       kqread   0xc47baa80 check_reload_status
              300     1   300     0  Ss      kqread   0xc47baa00 check_reload_status
              285     1   285     0  Ss      kqread   0xc4792700 php-fpm
               54     0     0     0  DL      mdwait   0xc442b000 [md1]
               49     0     0     0  DL      mdwait   0xc442d800 [md0]
               20     0     0     0  DL      syncer   0xc1f1cac4 [syncer]
               19     0     0     0  DL      vlruwt   0xc4799000 [vnlru]
               18     0     0     0  DL      psleep   0xc1f1c204 [bufdaemon]
               17     0     0     0  DL      pollid   0xc1efbf30 [idlepoll]
                9     0     0     0  DL      pgzero   0xc2047d20 [pagezero]
                8     0     0     0  DL      psleep   0xc2047a44 [vmdaemon]
                7     0     0     0  DL      psleep   0xc20a7484 [pagedaemon]
                6     0     0     0  DL      waiting_ 0xc20a1d8c [sctp_iterator]
                5     0     0     0  DL      pftm     0xc0f622c0 [pf purge]
               16     0     0     0  DL      (threaded)          [usb]
            100038                   D       -        0xc43a8d34 [usbus1]
            100037                   D       -        0xc43a8d04 [usbus1]
            100036                   D       -        0xc43a8cd4 [usbus1]
            100035                   D       -        0xc43a8ca4 [usbus1]
            100034                   D       -        0xc443cb5c [usbus0]
            100033                   D       -        0xc443cb2c [usbus0]
            100032                   D       -        0xc443cafc [usbus0]
            100031                   D       -        0xc443cacc [usbus0]
                4     0     0     0  DL      (threaded)          [cam]
            100045                   D       -        0xc1e3e4a8 [scanner]
            100017                   D       -        0xc1e3e600 [doneq0]
                3     0     0     0  DL      crypto_r 0xc2046978 [crypto returns]
                2     0     0     0  DL      crypto_w 0xc20468b8 [crypto]
               15     0     0     0  DL      -        0xc1e58680 [rand_harvestq]
               14     0     0     0  DL      (threaded)          [geom]
            100010                   D       -        0xc209dde0 [g_down]
            100009                   D       -        0xc209dddc [g_up]
            100008                   D       -        0xc209ddd8 [g_event]
               13     0     0     0  DL      sleep    0xc1e14bb8 [ng_queue0]
               12     0     0     0  RL      (threaded)          [intr]
            100043                   I                           [swi1: pfsync]
            100041                   I                           [swi1: pf send]
            100039                   I                           [swi0: uart uart]
            100030                   I                           [irq12: ohci0 ehci0]
            100029                   I                           [irq15: vr2 ata1]
            100028                   I                           [irq14: ata0]
            100025                   I                           [irq9: ath0]
            100023                   I                           [swi6: Giant taskq]
            100021                   I                           [swi6: task queue]
            100015                   Run     CPU 0               [swi5: fast taskq]
            100006                   I                           [swi3: vm]
            100005                   I                           [swi4: clock]
            100004                   I                           [swi1: netisr 0]
               11     0     0     0  RL                          [idle: cpu0]
                1     0     1     0  SLs     wait     0xc42662f0 [init]
               10     0     0     0  DL      audit_wo 0xc20a5d88 [audit]
                0     0     0     0  DLs     (threaded)          [kernel]
            100044                   D       -        0xc4269800 [CAM taskq]
            100027                   D       -        0xc43cf700 [ath0 net80211 taskq]
            100026                   D       -        0xc43cf780 [ath0 taskq]
            100024                   D       -        0xc4269180 [thread]
            100022                   D       -        0xc4269300 [ffs_trim taskq]
            100020                   D       -        0xc4269480 [acpi_task_2]
            100019                   D       -        0xc4269480 [acpi_task_1]
            100018                   D       -        0xc4269480 [acpi_task_0]
            100016                   D       -        0xc4269880 [kqueue taskq]
            100011                   D       -        0xc426aa80 [firmware taskq]
            100000                   D       swapin   0xc209de64 [swapper]
            db:0:kdb.enter.default>[/thread]
            
            1 Reply Last reply Reply Quote 0
            • w0wW
              w0w
              last edited by

              And you don't have "IP Random id generation" enabled?

              1 Reply Last reply Reply Quote 0
              • S
                sh0gun
                last edited by

                @w0w:

                And you don't have "IP Random id generation" enabled?

                "IP Random id generation" is off. This setting I have never changed. Otherwise, I have only MSS clamping enabled and the Unity plugin disabled. "IPsec Mobile Client Support" is also turned off. All other settings are defaults.

                Apparently the kernel timesource is not the cause of the error. Could someone have another look at the dump? What information is still needed?

                1 Reply Last reply Reply Quote 0
                • w0wW
                  w0w
                  last edited by

                  We need to use bugtracker to report the bug. Please report this issue here https://redmine.pfsense.org/
                  Don't link the forum page, post your dumps and I'll add mine too.
                  FYI I don't have changed MSS and unity settings.

                  1 Reply Last reply Reply Quote 0
                  • w0wW
                    w0w
                    last edited by

                    https://redmine.pfsense.org/issues/4454

                    1 Reply Last reply Reply Quote 0
                    • A
                      afasoas
                      last edited by

                      Similar issue here. If I connect via VPN, PFSense stops and restarts - the IPSEC connection lasts between 30 seconds and 5 minutes. This issue is 100% reproducible - I've crashed my box about six times today.

                      Fatal double fault:
                      eip = 0xc12c62a8
                      esp = 0xecf4cff8
                      ebp = 0xecf4d000
                      cpuid = 0; apic id = 00
                      panic: double fault
                      cpuid = 0
                      KDB: enter: panic
                      panic.txt0600001412471723700  7136 ustarrootwheeldouble faultversion.txt06000025112471723700  7614 ustarrootwheelFreeBSD 10.1-RELEASE-p4 #0 36d7dec(releng/10.1)-dirty: Thu Jan 22 15:12:38 CST 2015
                          root@pfsense-22-i386-builder:/usr/obj.i386/usr/pfSensesrc/src/sys/pfSense_SMP.10

                      PFSense 2.2 - upgraded from 2.1.5

                      Hardware:
                      CPU: Intel(R) Atom(TM) CPU N270 @ 1.60GHz
                      Mobo: KINO-945GSE
                      Storage: 2 GB CF Card
                      Dual LAN: Realtek PCIe 8111CP GbE controller

                      IPSEC Details:
                      Mobile Client
                      No IP Compression
                      Unity plugin disabled
                      IKE v1
                      Virtual IP Address Assigned to Clients
                      IP Random ID Generation at default value (default is 0: sequential IP IDs)

                      Interfaces:
                      RE0: WAN: PPOE
                      RE1: LAN/OPT1/OPT2 using VLAN tagging

                      May try a clean install of v2.2 if you think there's any mileage in it.

                      pfsenseCrashDump.txt

                      1 Reply Last reply Reply Quote 0
                      • G
                        georgeman
                        last edited by

                        @afasoas: are you running 32 or 64 bit version? So far I think all the reports are coming from x86 versions. Is this reproducible under x64??

                        If it ain't broke, you haven't tampered enough with it

                        1 Reply Last reply Reply Quote 0
                        • A
                          afasoas
                          last edited by

                          32 bit.
                          Well spotted.
                          I will add my crash dump to the bug tracker shortly.

                          1 Reply Last reply Reply Quote 0
                          • A
                            afasoas
                            last edited by

                            Upgraded my hardware so I could run the 64-bit version. No issues to report thus far. IPSEC seems solid and stable.

                            1 Reply Last reply Reply Quote 0
                            • w0wW
                              w0w
                              last edited by

                              Great solution, but this is like cutting the head and sewing back a new one, more "brainful".
                              It could be also driver Ethernet issue with physical low memory installed. I can only wait when somebody really smart will check our crash dumps to find out the reason of double triple crash and panic.

                              1 Reply Last reply Reply Quote 0
                              • A
                                afasoas
                                last edited by

                                @w0w:

                                Great solution, but this is like cutting the head and sewing back a new one, more "brainful".
                                It could be also driver Ethernet issue with physical low memory installed. I can only wait when somebody really smart will check our crash dumps to find out the reason of double triple crash and panic.

                                I appreciate that this isn't the most helpful solution. I just wanted to confirm that the problem went away using the same configuration with a 64-bit version.

                                On Edit: I realise that you are using an Atom D2500 - you can run the 64-bit version of pfSense on it, if that helps?

                                1 Reply Last reply Reply Quote 0
                                • w0wW
                                  w0w
                                  last edited by

                                  I can, really, but what if I don't need it? My typical memory usage is less then 6% and CPU is mostly 90% in peak (300Mbit internet, three clients). I can buy some XEON based proliant G8 but why? :) 
                                  Maybe I'll move to x64 platform if we can't trust x86 anymore. But I need an answer for the question. DO we really need to move to x64 just because x86 is not supported or what?
                                  I think i'll wait for answer before buying some needless hardware. :)

                                  1 Reply Last reply Reply Quote 0
                                  • S
                                    sh0gun
                                    last edited by

                                    And what about the ALIX boards? As far as I know they are all 32bit.

                                    1 Reply Last reply Reply Quote 0
                                    • D
                                      doktornotor Banned
                                      last edited by

                                      @sh0gun:

                                      And what about the ALIX boards? As far as I know they are all 32bit.

                                      Not getting any IPsec panics on Alix. (Also, make sure you did not enable some stupid features, like the infamous "Insert a stronger id into IP header of packets passing through the filter.")

                                      1 Reply Last reply Reply Quote 0
                                      • A
                                        afasoas
                                        last edited by

                                        But your hardware is already 64-bit capable, at least as far as pfSense is concerned!
                                        Yes Intel don't provide 64-bit video drivers but seems to be a non-issue here.

                                        @w0w:

                                        My system is D2500CC mini-ITX motherboard from Intel, all embedded into it.

                                        1 Reply Last reply Reply Quote 0
                                        • w0wW
                                          w0w
                                          last edited by

                                          @doktornotor:

                                          @sh0gun:

                                          And what about the ALIX boards? As far as I know they are all 32bit.

                                          Not getting any IPsec panics on Alix. (Also, make sure you did not enable some stupid features, like the infamous "Insert a stronger id into IP header of packets passing through the filter.")

                                          I don't think that hiding your client OS unique ID behind firewall is so stupid as you think about it.

                                          1 Reply Last reply Reply Quote 0
                                          • w0wW
                                            w0w
                                            last edited by

                                            @afasoas:

                                            But your hardware is already 64-bit capable, at least as far as pfSense is concerned!
                                            Yes Intel don't provide 64-bit video drivers but seems to be a non-issue here.

                                            @w0w:

                                            My system is D2500CC mini-ITX motherboard from Intel, all embedded into it.

                                            Yep. But what is the point to use 64-bit OS with 2GB of RAM? It does not fix the problem in 32-bit version also :) There is some bug, that must be fixed and this is good, maybe, that it is pointed now to 32-bit version only, but next time it could be related to 64-bit only, so migrating between platforms is useless for me, until I read something like "64-bit freebsd is more secure and stable, don't use 32-bit anymore".

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.