Help with crash log
-
Hello, I have just recently setup pfsense as a software router running in VirtualBox. I have been experiencing crashing under heavy load however I'm not sure how to interpret the crash log. Here is a copy of the log, let me know what other information is needed.
Crash report begins. Anonymous machine information: i386 8.3-RELEASE-p16 FreeBSD 8.3-RELEASE-p16 #0: Fri Jun 20 13:17:08 EDT 2014 root@pf2_1_1_i386.pfsense.org:/usr/obj.i386/usr/pfSensesrc/src/sys/pfSense_SMP.8 Crash report details: Filename: /var/crash/bounds 1 Filename: /var/crash/info.0 Dump header from device /dev/ad4s1b Architecture: i386 Architecture Version: 1 Dump Length: 66560B (0 MB) Blocksize: 512 Dumptime: Sun Aug 10 13:29:47 2014 Hostname: pyros.ez.gg Magic: FreeBSD Text Dump Version String: FreeBSD 8.3-RELEASE-p16 #0: Fri Jun 20 13:17:08 EDT 2014 root@pf2_1_1_i386.pfsense.org:/usr/obj.i386/usr/pfSensesrc/src/sys/pfSense_SMP.8 Panic String: Dump Parity: 99582777 Bounds: 0 Dump Status: good Filename: /var/crash/minfree 2048 Filename: /var/crash/textdump.tar.0 ddb.txt���������������������������������������������������������������������������������������������0600����0�������0�������140000������12371735033� 7076� �����������������������������������������������������������������������������������������������������ustar���root����������������������������wheel������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������db:0:kdb.enter.default> run lockinfo db:1:lockinfo> show locks No such command db:1:locks> show alllocks No such command db:1:alllocks> show lockedvnods Locked vnodes db:0:kdb.enter.default> show pcpu cpuid = 0 dynamic pcpu = 0x306700 curthread = 0xc6692000: pid 74211 "openvpn" curpcb = 0xed4cdd80 fpcurthread = none idlethread = 0xc49948a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 db:0:kdb.enter.default> bt Tracing pid 74211 tid 100103 td 0xc6692000 selrecord(c6692000,c521191c,ed4cdadc,c5211900,3,...) at selrecord+0x8f tunpoll(c5213e00,3,c6692000,1,c14ef180,...) at tunpoll+0x5a devfs_poll_f(c4d9d578,3,c498f400,c6692000,c09fa280,...) at devfs_poll_f+0x64 poll(c6692000,ed4cdcec,2,c0ac9aac,c,...) at poll+0x362 syscall(ed4cdd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x28397097, esp = 0xbfbfdacc, ebp = 0xbfbfdb08 --- db:0:kdb.enter.default> ps pid ppid pgrp uid state wmesg wchan cmd 74354 73547 254 0 S piperd 0xc4da6498 sed 74211 1 74211 0 Rs CPU 0 openvpn 73965 73547 254 0 R cat 73927 42727 254 0 R pgrep 73673 3913 254 0 R pfctl 73547 30321 254 0 S wait 0xc5cd42b0 sh 72100 66700 254 0 S nanslp 0xc15571c4 sleep 70411 254 254 0 R initial thread 66700 1 254 0 S wait 0xc710dac0 sh 64049 254 254 0 R initial thread 55139 254 254 0 R initial thread 55028 254 254 0 R initial thread 54894 254 254 0 R initial thread 50704 25315 23 0 S nanslp 0xc15571c4 sleep 45667 254 254 0 R initial thread 37365 254 254 0 R initial thread 33843 254 254 0 R initial thread 30730 254 254 0 S lockf 0xc6677d00 initial thread 30544 254 254 0 S lockf 0xc6ea8040 initial thread 30321 254 254 0 S piperd 0xc5d19188 initial thread 6693 254 254 0 S lockf 0xc6ea7940 initial thread 98579 254 254 0 S lockf 0xc6678780 initial thread 98099 73654 23 0 S nanslp 0xc15571c4 sleep 77261 254 254 0 S lockf 0xc6b1a080 initial thread 62414 254 254 0 S lockf 0xc6ac5100 initial thread 42727 254 254 0 S piperd 0xc4da7188 initial thread 36436 254 254 0 S lockf 0xc6ac6200 initial thread 34876 254 254 0 S lockf 0xc6ac4000 initial thread 16184 254 254 0 S lockf 0xc6ac6600 initial thread 3913 254 254 0 S piperd 0xc4da7310 initial thread 98337 36901 36901 0 S accept 0xc5cc4376 php 8612 8031 7276 62 S piperd 0xc4da6dc8 unlinkd 8031 7276 7276 62 S kqread 0xc67f8600 initial thread 7276 1 7276 0 Ss wait 0xc67ff810 squid 90217 1 90217 0 Ss (threaded) snort 100131 S nanslp 0xc15571c4 snort 100086 S bpf 0xc6ceac00 snort 50223 1 254 0 S bpf 0xc6cbe100 arpwatch 44310 43137 254 0 S bpf 0xc6811500 bandwidthd 44046 43137 254 0 S bpf 0xc6ceb300 bandwidthd 43991 43137 254 0 S bpf 0xc65e0200 bandwidthd 43137 1 254 0 S bpf 0xc6697000 bandwidthd 34590 32692 34590 0 S+ ttyin 0xc4a4e270 sh 32692 32396 32692 0 S+ wait 0xc5d13ac0 sh 32682 79817 32682 0 Ss (threaded) sshlockout_pf 100130 S nanslp 0xc15571c4 sshlockout_pf 100127 S piperd 0xc4da6188 initial thread 32396 1 32396 0 Ss+ wait 0xc668d000 login 29005 28384 28384 0 S nanslp 0xc15571c4 minicron 28384 1 28384 0 Ss wait 0xc6cbbac0 minicron 27761 27262 27262 0 S nanslp 0xc15571c4 minicron 27262 1 27262 0 Ss wait 0xc6cbc810 minicron 27016 26694 26694 0 S nanslp 0xc15571c4 minicron 26694 1 26694 0 Ss wait 0xc6cbd2b0 minicron 25315 1 23 0 S+ wait 0xc5d102b0 sh 80564 1 80564 0 Ss nanslp 0xc15571c4 cron 79817 1 79817 0 Ss select 0xc531a4a4 syslogd 76039 1 76039 0 Ss select 0xc531ade4 miniupnpd 73654 1 23 0 S+ wait 0xc668e560 sh 66809 1 66809 0 Ss select 0xc6678164 bsnmpd 45156 1 45016 0 S select 0xc4ffc964 radvd 44767 1 44767 1002 Ss select 0xc4ffcba4 dhcpd 41654 36591 36591 0 S accept 0xc5cc4d1e php 38900 1 38838 65534 S select 0xc4ffcc24 dnsmasq 36901 36271 36901 0 Ss wait 0xc5cd3000 initial thread 36591 36271 36591 0 Ss wait 0xc5cd4810 initial thread 36271 1 36212 0 S kqread 0xc547d700 lighttpd 24389 24143 24143 0 S piperd 0xc4da7000 rrdtool 24143 1 24143 0 Ss select 0xc4ffcda4 apinger 20085 1 20085 0 Ss select 0xc531a0a4 inetd 18611 1 23 0 S+ piperd 0xc4da6620 logger 18560 1 23 0 S+ bpf 0xc5214900 tcpdump 13451 1 13451 65 Ss select 0xc531abe4 dhclient 6967 1 6967 0 Ss select 0xc4d893e4 dhclient 267 1 267 0 Ss select 0xc4d89564 devd 257 254 254 0 S kqread 0xc4d8ed80 check_reload_status 254 1 254 0 Rs check_reload_status 65 0 0 0 SL mdwait 0xc4ac3000 [md0] 35 0 0 0 SL (threaded) zfskern 100053 D l2arc_fe 0xc4f31b04 [l2arc_feed_thread] 100048 D arc_recl 0xc4f2297c [arc_reclaim_thread] 22 0 0 0 SL sdflush 0xc1585b60 [softdepflush] 21 0 0 0 SL vlruwt 0xc49da810 [vnlru] 20 0 0 0 SL syncer 0xc156af38 [syncer] 19 0 0 0 SL psleep 0xc156ac68 [bufdaemon] 18 0 0 0 RL [idlepoll] 17 0 0 0 SL pgzero 0xc1586814 [pagezero] 16 0 0 0 SL psleep 0xc158643c [vmdaemon] 15 0 0 0 SL psleep 0xc1586404 [pagedaemon] 9 0 0 0 SL ccb_scan 0xc151f5d4 [xpt_thrd] 8 0 0 0 SL pftm 0xc050c700 [pfpurge] 7 0 0 0 SL waiting_ 0xc1572338 [sctp_iterator] 14 0 0 0 SL - 0xc1557024 [yarrow] 6 0 0 0 SL crypto_r 0xc158510c [crypto returns] 5 0 0 0 SL crypto_w 0xc15850e8 [crypto] 4 0 0 0 SL - 0xc15547e4 [g_down] 3 0 0 0 SL - 0xc15547e0 [g_up] 2 0 0 0 SL - 0xc15547d8 [g_event] 13 0 0 0 SL sleep 0xc14f2fa0 [ng_queue0] 12 0 0 0 WL (threaded) intr 100032 I [irq12: psm0] 100031 I [irq1: atkbd0] 100030 I [irq11: atapci1] 100027 I [irq15: ata1] 100026 I [irq14: ata0] 100025 I [irq9: em1 acpi0] 100024 I [swi6: Giant taskq] 100022 I [swi5: +] 100019 I [swi2: cambio] 100015 I [swi6: task queue] 100006 I [swi3: vm] 100005 I [swi4: clock] 100004 I [swi1: netisr 0] 11 0 0 0 RL [idle: cpu0] 1 0 1 0 SLs wait 0xc4992ac0 [init] 10 0 0 0 SL audit_wo 0xc1585500 [audit] 0 0 0 0 SLs (threaded) kernel 100052 D - 0xc4d87280 [system_taskq] 100029 D - 0xc4b0e840 [em1 taskq] 100028 D - 0xc4b01d40 [em0 taskq] 100023 D - 0xc4a9a1c0 [thread] 100021 D - 0xc4a9a3c0 [ffs_trim taskq] 100020 D - 0xc4a9a400 [kqueue taskq] 100018 D - 0xc4a9a540 [acpi_task_2] 100017 D - 0xc4a9a540 [acpi_task_1] 100016 D - 0xc4a9a540 [acpi_task_0] 100011 D - 0xc4972980 [firmware taskq] 100000 D sched 0xc15548e0 [swapper] 82951 43137 254 0 Z bandwidthd 74857 43991 254 0 Z bandwidthd 45098 44046 254 0 Z bandwidthd 45186 44310 254 0 Z bandwidthd db:0:kdb.enter.default> alltrace Tracing command sed pid 74354 tid 100094 td 0xc66952e0 sched_switch(c66952e0,0,104,d4ce2234,2d3,...) at sched_switch+0xbc mi_switch(104,0,c4da6608,0,ed4a8b40,...) at mi_switch+0xd6 sleepq_switch(c66952e0,0,c0f9bf13,1a0,c497c0c0,...) at sleepq_switch+0xae sleepq_catch_signals(c4da6608,0,ed4a8b90,c0aae62a,c4da6498,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c4da6498,4c,c0f9c5fc,100,0,...) at sleepq_wait_sig+0x18 _sleep(c4da6498,c4da6608,14c,c0f9c5fc,0,...) at _sleep+0x27a pipe_read(c6f01460,ed4a8c3c,c498f400,0,c66952e0,...) at pipe_read+0x44a dofileread(ed4a8c3c,ffffffff,ffffffff,0,c6f01460,...) at dofileread+0x90 kern_readv(c66952e0,0,ed4a8c3c,ed4a8c5c,1,...) at kern_readv+0x6a read(c66952e0,ed4a8cec,2,c0ac9aac,c,...) at read+0x50 syscall(ed4a8d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2817ee73, esp = 0xbfbfeb5c, ebp = 0xbfbfeb78 --- Tracing command openvpn pid 74211 tid 100103 td 0xc6692000 selrecord(c6692000,c521191c,ed4cdadc,c5211900,3,...) at selrecord+0x8f tunpoll(c5213e00,3,c6692000,1,c14ef180,...) at tunpoll+0x5a devfs_poll_f(c4d9d578,3,c498f400,c6692000,c09fa280,...) at devfs_poll_f+0x64 poll(c6692000,ed4cdcec,2,c0ac9aac,c,...) at poll+0x362 syscall(ed4cdd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x28397097, esp = 0xbfbfdacc, ebp = 0xbfbfdb08 --- Tracing command cat pid 73965 tid 100105 td 0xc5cd8b80 sched_switch(c5cd8b80,0,207,d49662ad,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,0,...) at mi_switch+0xd6 ast(ed4d3d28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command pgrep pid 73927 tid 100072 td 0xc5cd65c0 sched_switch(c5cd65c0,0,207,d4e17d45,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,ed44dd28,...) at mi_switch+0xd6 ast(ed44dd28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command pfctl pid 73673 tid 100141 td 0xc6f1bb80 sched_switch(c6f1bb80,0,207,d4f791af,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,2832a080,...) at mi_switch+0xd6 ast(ed56dd28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command sh pid 73547 tid 100068 td 0xc5cd72e0 sched_switch(c5cd72e0,0,104,c98689de,2d3,...) at sched_switch+0xbc mi_switch(104,0,c5cd4338,0,ed43db60,...) at mi_switch+0xd6 sleepq_switch(c5cd72e0,0,c0f9bf13,1a0,c497d240,...) at sleepq_switch+0xae sleepq_catch_signals(c5cd4338,0,ed43dbb0,c0aae62a,c5cd42b0,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c5cd42b0,5c,c0f9c92e,100,0,...) at sleepq_wait_sig+0x18 _sleep(c5cd42b0,c5cd4338,15c,c0f9c92e,0,...) at _sleep+0x27a kern_wait(c5cd72e0,ffffffff,ed43dc58,2,0,...) at kern_wait+0x6ef wait4(c5cd72e0,ed43dcec,2,c0ac9aac,c,...) at wait4+0x3b syscall(ed43dd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816e53b, esp = 0xbfbfebfc, ebp = 0xbfbfec18 --- Tracing command sleep pid 72100 tid 100111 td 0xc6802000 sched_switch(c6802000,0,104,b1ce2638,2d3,...) at sched_switch+0xbc mi_switch(104,0,0,0,ed4e5ba0,...) at mi_switch+0xd6 sleepq_switch(c6802000,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(0,0,65,ed4e5bf4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c15571c4,5c,c0f99785,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c15571c4,0,15c,c0f99785,65,...) at _sleep+0x192 kern_nanosleep(c6802000,ed4e5c48,ed4e5c50,1,0,...) at kern_nanosleep+0xeb nanosleep(c6802000,ed4e5cec,1,c0ac9aac,c,...) at nanosleep+0x6c syscall(ed4e5d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815c567, esp = 0xbfbfedec, ebp = 0xbfbfee38 --- Tracing command php pid 70411 tid 100110 td 0xc68022e0 sched_switch(c68022e0,0,207,d53609f2,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,0,...) at mi_switch+0xd6 ast(ed4e2d28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command sh pid 66700 tid 100138 td 0xc6f1c5c0 sched_switch(c6f1c5c0,0,104,9f86f220,2d3,...) at sched_switch+0xbc mi_switch(104,0,c710db48,0,ed564b60,...) at mi_switch+0xd6 sleepq_switch(c6f1c5c0,0,c0f9bf13,1a0,c4fdc800,...) at sleepq_switch+0xae sleepq_catch_signals(c710db48,0,ed564bb0,c0aae62a,c710dac0,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c710dac0,5c,c0f9c92e,100,0,...) at sleepq_wait_sig+0x18 _sleep(c710dac0,c710db48,15c,c0f9c92e,0,...) at _sleep+0x27a kern_wait(c6f1c5c0,ffffffff,ed564c58,2,0,...) at kern_wait+0x6ef wait4(c6f1c5c0,ed564cec,46,c0ac9aac,c6f1c5c0,...) at wait4+0x3b syscall(ed564d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816e53b, esp = 0xbfbfea3c, ebp = 0xbfbfea58 --- Tracing command php pid 64049 tid 100146 td 0xc6f1ab80 sched_switch(c6f1ab80,0,207,d47c0f56,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,ed57cd28,...) at mi_switch+0xd6 ast(ed57cd28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command php pid 55139 tid 100065 td 0xc5cd7b80 sched_switch(c5cd7b80,0,207,d482a9d5,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,0,...) at mi_switch+0xd6 ast(ed434d28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command php pid 55028 tid 100078 td 0xc5d168a0 sched_switch(c5d168a0,0,207,d526081d,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,46,...) at mi_switch+0xd6 ast(ed46ed28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command php pid 54894 tid 100044 td 0xc4d725c0 sched_switch(c4d725c0,0,207,d5200b65,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,0,...) at mi_switch+0xd6 ast(ed3e5d28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command sleep pid 50704 tid 100140 td 0xc6f1c000 sched_switch(c6f1c000,0,104,59528119,2d0,...) at sched_switch+0xbc mi_switch(104,0,0,0,ed56aba0,...) at mi_switch+0xd6 sleepq_switch(c6f1c000,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(0,0,157d,ed56abf4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c15571c4,5c,c0f99785,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c15571c4,0,15c,c0f99785,157d,...) at _sleep+0x192 kern_nanosleep(c6f1c000,ed56ac48,ed56ac50,37,0,...) at kern_nanosleep+0xeb nanosleep(c6f1c000,ed56acec,ed56acc0,c0ac9a76,c155b1ac,...) at nanosleep+0x6c syscall(ed56ad28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815c567, esp = 0xbfbfedec, ebp = 0xbfbfee38 --- Tracing command php pid 45667 tid 100087 td 0xc66928a0 sched_switch(c66928a0,0,207,d4d27127,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,ed489d28,...) at mi_switch+0xd6 ast(ed489d28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command php pid 37365 tid 100063 td 0xc4d732e0 sched_switch(c4d732e0,0,207,d4bad61f,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,ed42ed28,...) at mi_switch+0xd6 ast(ed42ed28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command php pid 33843 tid 100059 td 0xc4fdb000 sched_switch(c4fdb000,0,207,d4e8b5e8,2d3,...) at sched_switch+0xbc mi_switch(207,0,c0f9c2cc,d3,ed422d28,...) at mi_switch+0xd6 ast(ed422d28) at ast+0x1ba doreti_ast() at doreti_ast+0x17 Tracing command php pid 30730 tid 100143 td 0xc6f1b5c0 sched_switch(c6f1b5c0,0,104,a472911a,2d2,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed573a74,...) at mi_switch+0xd6 sleepq_switch(c6f1b5c0,0,c0f9bf13,1a0,c4fdc940,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed573ac4,c0aae62a,c6677d00,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6677d00,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6677d00,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed573b40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed573c3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed573c3c,ed573c3c,ed573c54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c6f1b5c0,ed573cec,2,c0ac9aac,c,...) at flock+0x139 syscall(ed573d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command php pid 30544 tid 100136 td 0xc6cc05c0 sched_switch(c6cc05c0,0,104,76ab222,2d2,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed55ea74,...) at mi_switch+0xd6 sleepq_switch(c6cc05c0,0,c0f9bf13,1a0,c4fdcd80,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed55eac4,c0aae62a,c6ea8040,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6ea8040,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6ea8040,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed55eb40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed55ec3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed55ec3c,ed55ec3c,ed55ec54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c6cc05c0,ed55ecec,2,c0ac9aac,c,...) at flock+0x139 syscall(ed55ed28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command php pid 30321 tid 100134 td 0xc6802b80 sched_switch(c6802b80,0,104,b1a9b9b6,2d3,...) at sched_switch+0xbc mi_switch(104,0,c5d192f8,0,ed558b40,...) at mi_switch+0xd6 sleepq_switch(c6802b80,0,c0f9bf13,1a0,c497d040,...) at sleepq_switch+0xae sleepq_catch_signals(c5d192f8,0,ed558b90,c0aae62a,c5d19188,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c5d19188,4c,c0f9c5fc,100,0,...) at sleepq_wait_sig+0x18 _sleep(c5d19188,c5d192f8,14c,c0f9c5fc,0,...) at _sleep+0x27a pipe_read(c4d9d428,ed558c3c,c498f400,0,c6802b80,...) at pipe_read+0x44a dofileread(ed558c3c,ffffffff,ffffffff,0,c4d9d428,...) at dofileread+0x90 kern_readv(c6802b80,17,ed558c3c,ed558c5c,1,...) at kern_readv+0x6a read(c6802b80,ed558cec,1,c6802e2c,c,...) at read+0x50 syscall(ed558d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2870ae73, esp = 0xbfbfaccc, ebp = 0xbfbface8 --- Tracing command php pid 6693 tid 100117 td 0xc6800b80 sched_switch(c6800b80,0,104,21e5b48c,2d0,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed50ca74,...) at mi_switch+0xd6 sleepq_switch(c6800b80,0,c0f9bf13,1a0,c497da40,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed50cac4,c0aae62a,c6ea7940,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6ea7940,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6ea7940,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed50cb40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed50cc3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed50cc3c,ed50cc3c,ed50cc54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c6800b80,ed50ccec,46,c0ac9aac,c6800b80,...) at flock+0x139 syscall(ed50cd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command php pid 98579 tid 100069 td 0xc5cd7000 sched_switch(c5cd7000,0,104,8e6ac9f6,2ce,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed441a74,...) at mi_switch+0xd6 sleepq_switch(c5cd7000,0,c0f9bf13,1a0,c4fdcc40,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed441ac4,c0aae62a,c6678780,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6678780,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6678780,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed441b40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed441c3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed441c3c,ed441c3c,ed441c54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c5cd7000,ed441cec,2,c0ac9aac,c,...) at flock+0x139 syscall(ed441d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command sleep pid 98099 tid 100083 td 0xc5d158a0 sched_switch(c5d158a0,0,104,7874254f,2c7,...) at sched_switch+0xbc mi_switch(104,0,0,0,ed47dba0,...) at mi_switch+0xd6 sleepq_switch(c5d158a0,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(0,0,1771,ed47dbf4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c15571c4,5c,c0f99785,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c15571c4,0,15c,c0f99785,1771,...) at _sleep+0x192 kern_nanosleep(c5d158a0,ed47dc48,ed47dc50,3c,0,...) at kern_nanosleep+0xeb nanosleep(c5d158a0,ed47dcec,1,c0ac9aac,c,...) at nanosleep+0x6c syscall(ed47dd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815c567, esp = 0xbfbfeddc, ebp = 0xbfbfee28 --- Tracing command php pid 77261 tid 100084 td 0xc5d155c0 sched_switch(c5d155c0,0,104,bb8693d4,2ca,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed480a74,...) at mi_switch+0xd6 sleepq_switch(c5d155c0,0,c0f9bf13,1a0,c497dd80,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed480ac4,c0aae62a,c6b1a080,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6b1a080,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6b1a080,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed480b40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed480c3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed480c3c,ed480c3c,ed480c54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c5d155c0,ed480cec,46,c0ac9aac,c5d155c0,...) at flock+0x139 syscall(ed480d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command php pid 62414 tid 100050 td 0xc4d712e0 sched_switch(c4d712e0,0,104,ca48ba91,2c8,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed3fda74,...) at mi_switch+0xd6 sleepq_switch(c4d712e0,0,c0f9bf13,1a0,c497d980,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed3fdac4,c0aae62a,c6ac5100,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6ac5100,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6ac5100,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed3fdb40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed3fdc3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed3fdc3c,ed3fdc3c,ed3fdc54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c4d712e0,ed3fdcec,2,c0ac9aac,c,...) at flock+0x139 syscall(ed3fdd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command php pid 42727 tid 100113 td 0xc68018a0 sched_switch(c68018a0,0,104,c46939a2,2d3,...) at sched_switch+0xbc mi_switch(104,0,c4da72f8,0,ed4ebb40,...) at mi_switch+0xd6 sleepq_switch(c68018a0,0,c0f9bf13,1a0,c497de00,...) at sleepq_switch+0xae sleepq_catch_signals(c4da72f8,0,ed4ebb90,c0aae62a,c4da7188,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c4da7188,4c,c0f9c5fc,100,0,...) at sleepq_wait_sig+0x18 _sleep(c4da7188,c4da72f8,14c,c0f9c5fc,0,...) at _sleep+0x27a pipe_read(c6f018f8,ed4ebc3c,c498f400,0,c68018a0,...) at pipe_read+0x44a dofileread(ed4ebc3c,ffffffff,ffffffff,0,c6f018f8,...) at dofileread+0x90 kern_readv(c68018a0,13,ed4ebc3c,ed4ebc5c,1,...) at kern_readv+0x6a read(c68018a0,ed4ebcec,46,c0ac9aac,c68018a0,...) at read+0x50 syscall(ed4ebd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2870ae73, esp = 0xbfbfab5c, ebp = 0xbfbfab78 --- Tracing command php pid 36436 tid 100102 td 0xc66922e0 sched_switch(c66922e0,0,104,3f95262e,2c6,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed4caa74,...) at mi_switch+0xd6 sleepq_switch(c66922e0,0,c0f9bf13,1a0,c497de40,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed4caac4,c0aae62a,c6ac6200,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6ac6200,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6ac6200,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed4cab40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed4cac3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed4cac3c,ed4cac3c,ed4cac54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c66922e0,ed4cacec,2,c0ac9aac,c,...) at flock+0x139 syscall(ed4cad28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command php pid 34876 tid 100115 td 0xc68012e0 sched_switch(c68012e0,0,104,a3d8ad96,2c6,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed506a74,...) at mi_switch+0xd6 sleepq_switch(c68012e0,0,c0f9bf13,1a0,c4fdce00,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed506ac4,c0aae62a,c6ac4000,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6ac4000,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6ac4000,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed506b40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed506c3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed506c3c,ed506c3c,ed506c54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c68012e0,ed506cec,2,c0ac9aac,c,...) at flock+0x139 syscall(ed506d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command php pid 16184 tid 100060 td 0xc4d73b80 sched_switch(c4d73b80,0,104,68003974,2bf,...) at sched_switch+0xbc mi_switch(104,0,c6677248,0,ed425a74,...) at mi_switch+0xd6 sleepq_switch(c4d73b80,0,c0f9bf13,1a0,c497d700,...) at sleepq_switch+0xae sleepq_catch_signals(c6677248,0,ed425ac4,c0aae62a,c6ac6600,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6ac6600,68,c14e1d44,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6ac6600,c6677248,168,c14e1d44,0,...) at _sleep+0x27a lf_advlockasync(ed425b40,c531eea4,0,0,0,...) at lf_advlockasync+0x1125 lf_advlock(ed425c3c,c531eea4,0,0,1,...) at lf_advlock+0x55 vop_stdadvlock(ed425c3c,ed425c3c,ed425c54,0,53e7afe5,...) at vop_stdadvlock+0xb5 flock(c4d73b80,ed425cec,2,c0ac9aac,c,...) at flock+0x139 syscall(ed425d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (131, FreeBSD ELF32, flock), eip = 0x2867045b, esp = 0xbfbfb0bc, ebp = 0xbfbfb0f8 --- Tracing command php pid 3913 tid 100122 td 0xc6cc32e0 sched_switch(c6cc32e0,0,104,bba22e6e,2d3,...) at sched_switch+0xbc mi_switch(104,0,c4da7480,0,ed51bb40,...) at mi_switch+0xd6 sleepq_switch(c6cc32e0,0,c0f9bf13,1a0,c497d940,...) at sleepq_switch+0xae sleepq_catch_signals(c4da7480,0,ed51bb90,c0aae62a,c4da7310,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c4da7310,4c,c0f9c5fc,100,0,...) at sleepq_wait_sig+0x18 _sleep(c4da7310,c4da7480,14c,c0f9c5fc,0,...) at _sleep+0x27a pipe_read(c669b9a0,ed51bc3c,c498f400,0,c6cc32e0,...) at pipe_read+0x44a dofileread(ed51bc3c,ffffffff,ffffffff,0,c669b9a0,...) at dofileread+0x90 kern_readv(c6cc32e0,11,ed51bc3c,ed51bc5c,1,...) at kern_readv+0x6a read(c6cc32e0,ed51bcec,1,c0ac9a76,c,...) at read+0x50 syscall(ed51bd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2870ae73, esp = 0xbfbfae4c, ebp = 0xbfbfae68 --- Tracing command php pid 98337 tid 100076 td 0xc4fdd8a0 sched_switch(c4fdd8a0,0,104,c3f2b527,2d2,...) at sched_switch+0xbc mi_switch(104,0,c156aab0,0,ed468b9c,...) at mi_switch+0xd6 sleepq_switch(c4fdd8a0,0,c0f9bf13,1a0,c4fdc900,...) at sleepq_switch+0xae sleepq_catch_signals(c156aab0,0,ed468bec,c0aae62a,c5cc4376,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c5cc4376,58,c0f9c99e,100,0,...) at sleepq_wait_sig+0x18 _sleep(c5cc4376,c156aab0,158,c0f9c99e,0,...) at _sleep+0x27a kern_accept(c4fdd8a0,0,ed468c54,ed468c50,ed468c4c,...) at kern_accept+0x183 accept(c4fdd8a0,ed468cec,46,c0ac9aac,c4fdd8a0,...) at accept+0x73 syscall(ed468d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (30, FreeBSD ELF32, accept), eip = 0x286a6c5f, esp = 0xbfbeca9c, ebp = 0xbfbecab8 --- Tracing command unlinkd pid 8612 tid 100088 td 0xc5cd88a0 sched_switch(c5cd88a0,0,104,424b0fac,2af,...) at sched_switch+0xbc mi_switch(104,0,c4da6f38,0,ed490b40,...) at mi_switch+0xd6 sleepq_switch(c5cd88a0,0,c0f9bf13,1a0,c4fdcdc0,...) at sleepq_switch+0xae sleepq_catch_signals(c4da6f38,0,ed490b90,c0aae62a,c4da6dc8,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c4da6dc8,4c,c0f9c5fc,100,0,...) at sleepq_wait_sig+0x18 _sleep(c4da6dc8,c4da6f38,14c,c0f9c5fc,0,...) at _sleep+0x27a pipe_read(c5d09b98,ed490c3c,c5d35300,0,c5cd88a0,...) at pipe_read+0x44a dofileread(ed490c3c,ffffffff,ffffffff,0,c5d09b98,...) at dofileread+0x90 kern_readv(c5cd88a0,0,ed490c3c,ed490c5c,1,...) at kern_readv+0x6a read(c5cd88a0,ed490cec,46,c0ac9aac,c5cd88a0,...) at read+0x50 syscall(ed490d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28178e73, esp = 0xbfbfe86c, ebp = 0xbfbfe888 --- Tracing command squid pid 8031 tid 100090 td 0xc5cd82e0 sched_switch(c5cd82e0,0,104,c81d985d,2d3,...) at sched_switch+0xbc mi_switch(104,0,c67f8600,0,ed497a80,...) at mi_switch+0xd6 sleepq_switch(c5cd82e0,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(c67f8600,0,35,ed497ad4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c67f8600,58,c0f9501a,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c67f8600,c67f8600,158,c0f9501a,35,...) at _sleep+0x192 kern_kevent(c5cd82e0,9,0,80,ed497c3c,...) at kern_kevent+0x325 kevent(c5cd82e0,ed497cec,ed497cc0,c0ac9a76,c155b1ac,...) at kevent+0x88 syscall(ed497d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, kevent), eip = 0x283edbf7, esp = 0xbfbfeb9c, ebp = 0xbfbfec18 --- Tracing command squid pid 7276 tid 100101 td 0xc66925c0 sched_switch(c66925c0,0,104,8fadcc19,30,...) at sched_switch+0xbc mi_switch(104,0,c67ff898,0,ed4c7b60,...) at mi_switch+0xd6 sleepq_switch(c66925c0,0,c0f9bf13,1a0,c497dc40,...) at sleepq_switch+0xae sleepq_catch_signals(c67ff898,0,ed4c7bb0,c0aae62a,c67ff810,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c67ff810,5c,c0f9c92e,100,0,...) at sleepq_wait_sig+0x18 _sleep(c67ff810,c67ff898,15c,c0f9c92e,0,...) at _sleep+0x27a kern_wait(c66925c0,ffffffff,ed4c7c58,0,0,...) at kern_wait+0x6ef wait4(c66925c0,ed4c7cec,46,c0ac9aac,c66925c0,...) at wait4+0x3b syscall(ed4c7d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x283b653b, esp = 0xbfbfebcc, ebp = 0xbfbfebe8 --- Tracing command snort pid 90217 tid 100131 td 0xc68035c0 sched_switch(c68035c0,0,104,f18d695f,2d3,...) at sched_switch+0xbc mi_switch(104,0,0,0,ed552ba0,...) at mi_switch+0xd6 sleepq_switch(c68035c0,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(0,0,65,ed552bf4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c15571c4,5c,c0f99785,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c15571c4,0,15c,c0f99785,65,...) at _sleep+0x192 kern_nanosleep(c68035c0,ed552c48,ed552c50,1,0,...) at kern_nanosleep+0xeb nanosleep(c68035c0,ed552cec,46,c0ac9aac,c68035c0,...) at nanosleep+0x6c syscall(ed552d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x284eb567, esp = 0xbf9feedc, ebp = 0xbf9fef08 --- Tracing command snort pid 90217 tid 100086 td 0xc5d15000 sched_switch(c5d15000,0,104,f18ba103,2d3,...) at sched_switch+0xbc mi_switch(104,0,c6ceac84,0,ed486b10,...) at mi_switch+0xd6 sleepq_switch(c5d15000,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(c6ceac84,0,64,ed486b64,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c6ceac00,1a,c0faacc8,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c6ceac00,c6ceac84,11a,c0faacc8,64,...) at _sleep+0x192 bpfread(c4981600,ed486c3c,0,0,8000,...) at bpfread+0x258 devfs_read_f(c669b930,ed486c3c,c498f400,0,c5d15000,...) at devfs_read_f+0x7e dofileread(ed486c3c,ffffffff,ffffffff,0,c669b930,...) at dofileread+0x90 kern_readv(c5d15000,13,ed486c3c,ed486c5c,1,...) at kern_readv+0x6a read(c5d15000,ed486cec,ed486cc0,c0ac9a76,c155b1ac,...) at read+0x50 syscall(ed486d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28507e73, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command arpwatch pid 50223 tid 100096 td 0xc6693b80 sched_switch(c6693b80,0,104,d335da5d,2d3,...) at sched_switch+0xbc mi_switch(104,0,c6cbe184,0,ed4b0b10,...) at mi_switch+0xd6 sleepq_switch(c6693b80,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(c6cbe184,0,64,ed4b0b64,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c6cbe100,1a,c0faacc8,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c6cbe100,c6cbe184,11a,c0faacc8,64,...) at _sleep+0x192 bpfread(c4981600,ed4b0c3c,0,0,8000,...) at bpfread+0x258 devfs_read_f(c6822bd0,ed4b0c3c,c6671780,0,c6693b80,...) at devfs_read_f+0x7e dofileread(ed4b0c3c,ffffffff,ffffffff,0,c6822bd0,...) at dofileread+0x90 kern_readv(c6693b80,12,ed4b0c3c,ed4b0c5c,1,...) at kern_readv+0x6a read(c6693b80,ed4b0cec,46,c0ac9aac,c6693b80,...) at read+0x50 syscall(ed4b0d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281abe73, esp = 0xbfbfea4c, ebp = 0xbfbfeb48 --- Tracing command bandwidthd pid 44310 tid 100129 td 0xc6cc0b80 sched_switch(c6cc0b80,0,104,d4953a45,2d3,...) at sched_switch+0xbc mi_switch(104,0,c6811584,0,ed530b10,...) at mi_switch+0xd6 sleepq_switch(c6cc0b80,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(c6811584,0,64,ed530b64,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c6811500,1a,c0faacc8,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c6811500,c6811584,11a,c0faacc8,64,...) at _sleep+0x192 bpfread(c4981600,ed530c3c,0,0,80000,...) at bpfread+0x258 devfs_read_f(c4d9c428,ed530c3c,c498f400,0,c6cc0b80,...) at devfs_read_f+0x7e dofileread(ed530c3c,ffffffff,ffffffff,0,c4d9c428,...) at dofileread+0x90 kern_readv(c6cc0b80,14,ed530c3c,ed530c5c,1,...) at kern_readv+0x6a read(c6cc0b80,ed530cec,46,c0ac9aac,c6cc0b80,...) at read+0x50 syscall(ed530d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28353e73, esp = 0xbfbfea7c, ebp = 0xbfbfeb78 --- Tracing command bandwidthd pid 44046 tid 100112 td 0xc6801b80 sched_switch(c6801b80,0,104,d33ec63e,2d3,...) at sched_switch+0xbc mi_switch(104,0,c6ceb384,0,ed4e8b10,...) at mi_switch+0xd6 sleepq_switch(c6801b80,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(c6ceb384,0,64,ed4e8b64,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c6ceb300,1a,c0faacc8,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c6ceb300,c6ceb384,11a,c0faacc8,64,...) at _sleep+0x192 bpfread(c4981600,ed4e8c3c,0,0,80000,...) at bpfread+0x258 devfs_read_f(c68221f8,ed4e8c3c,c498f400,0,c6801b80,...) at devfs_read_f+0x7e dofileread(ed4e8c3c,ffffffff,ffffffff,0,c68221f8,...) at dofileread+0x90 kern_readv(c6801b80,14,ed4e8c3c,ed4e8c5c,1,...) at kern_readv+0x6a read(c6801b80,ed4e8cec,46,c0ac9aac,c6801b80,...) at read+0x50 syscall(ed4e8d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28353e73, esp = 0xbfbfea7c, ebp = 0xbfbfeb78 --- Tracing command bandwidthd pid 43991 tid 100071 td 0xc5cd68a0 sched_switch(c5cd68a0,0,104,d48da5dd,2d3,...) at sched_switch+0xbc mi_switch(104,0,c65e0284,0,ed449b10,...) at mi_switch+0xd6 sleepq_switch(c5cd68a0,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(c65e0284,0,64,ed449b64,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c65e0200,1a,c0faacc8,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c65e0200,c65e0284,11a,c0faacc8,64,...) at _sleep+0x192 bpfread(c4981600,ed449c3c,0,0,80000,...) at bpfread+0x258 devfs_read_f(c68228c0,ed449c3c,c498f400,0,c5cd68a0,...) at devfs_read_f+0x7e dofileread(ed449c3c,ffffffff,ffffffff,0,c68228c0,...) at dofileread+0x90 kern_readv(c5cd68a0,14,ed449c3c,ed449c5c,1,...) at kern_readv+0x6a read(c5cd68a0,ed449cec,46,c0ac9aac,c5cd68a0,...) at read+0x50 syscall(ed449d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28353e73, esp = 0xbfbfea7c, ebp = 0xbfbfeb78 --- Tracing command bandwidthd pid 43137 tid 100132 td 0xc6cc02e0 sched_switch(c6cc02e0,0,104,d3321f06,2d3,...) at sched_switch+0xbc mi_switch(104,0,c6697084,0,ed53bb10,...) at mi_switch+0xd6 sleepq_switch(c6cc02e0,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(c6697084,0,64,ed53bb64,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c6697000,1a,c0faacc8,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c6697000,c6697084,11a,c0faacc8,64,...) at _sleep+0x192 bpfread(c4981600,ed53bc3c,0,0,80000,...) at bpfread+0x258 devfs_read_f(c521b850,ed53bc3c,c498f400,0,c6cc02e0,...) at devfs_read_f+0x7e dofileread(ed53bc3c,ffffffff,ffffffff,0,c521b850,...) at dofileread+0x90 kern_readv(c6cc02e0,14,ed53bc3c,ed53bc5c,1,...) at kern_readv+0x6a read(c6cc02e0,ed53bcec,46,c0ac9aac,c6cc02e0,...) at read+0x50 syscall(ed53bd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28353e73, esp = 0xbfbfea7c, ebp = 0xbfbfeb78 --- Tracing command sh pid 34590 tid 100119 td 0xc68005c0 sched_switch(c68005c0,0,104,d4295f86,1c,...) at sched_switch+0xbc mi_switch(104,0,c68005c0,1,ed512ab8,...) at mi_switch+0xd6 sleepq_switch(c68005c0,0,c0f9bf13,1a0,c497d340,...) at sleepq_switch+0xae sleepq_catch_signals(c68005c0,1,ed512afc,c0a5a607,c4a4e270,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c4a4e270,0,c0f9e519,101,0,...) at sleepq_wait_sig+0x18 _cv_wait_sig(c4a4e270,c1556450,0,0,ed512b68,...) at _cv_wait_sig+0x127 tty_wait(c4a4e200,c4a4e270,1,ed512b5b,ed512b50,...) at tty_wait+0x23 ttydisc_read(c4a4e200,ed512c3c,0,c6cba96c,ed512bbc,...) at ttydisc_read+0xa5 ttydev_read(c4aff100,ed512c3c,0,0,1,...) at ttydev_read+0x10f devfs_read_f(c5d09dc8,ed512c3c,c6671280,0,c68005c0,...) at devfs_read_f+0x7e dofileread(ed512c3c,ffffffff,ffffffff,0,c5d09dc8,...) at dofileread+0x90 kern_readv(c68005c0,0,ed512c3c,ed512c5c,1,...) at kern_readv+0x6a read(c68005c0,ed512cec,2,c0ac9aac,c,...) at read+0x50 syscall(ed512d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281f2e73, esp = 0xbfbfe97c, ebp = 0xbfbfea58 --- Tracing command sh pid 32692 tid 100099 td 0xc66932e0 sched_switch(c66932e0,0,104,82bfa8d2,1c,...) at sched_switch+0xbc mi_switch(104,0,c5d13b48,0,ed4bcb60,...) at mi_switch+0xd6 sleepq_switch(c66932e0,0,c0f9bf13,1a0,c497d5c0,...) at sleepq_switch+0xae sleepq_catch_signals(c5d13b48,0,ed4bcbb0,c0aae62a,c5d13ac0,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c5d13ac0,5c,c0f9c92e,100,0,...) at sleepq_wait_sig+0x18 _sleep(c5d13ac0,c5d13b48,15c,c0f9c92e,0,...) at _sleep+0x27a kern_wait(c66932e0,ffffffff,ed4bcc58,2,0,...) at kern_wait+0x6ef wait4(c66932e0,ed4bccec,2,c669358c,c,...) at wait4+0x3b syscall(ed4bcd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816e53b, esp = 0xbfbfea8c, ebp = 0xbfbfeaa8 --- Tracing command sshlockout_pf pid 32682 tid 100130 td 0xc6cc08a0 sched_switch(c6cc08a0,0,104,eea63998,201,...) at sched_switch+0xbc mi_switch(104,0,0,0,ed533ba0,...) at mi_switch+0xd6 sleepq_switch(c6cc08a0,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(0,0,2bf21,ed533bf4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c15571c4,5c,c0f99785,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c15571c4,0,15c,c0f99785,2bf21,...) at _sleep+0x192 kern_nanosleep(c6cc08a0,ed533c48,ed533c50,708,0,...) at kern_nanosleep+0xeb nanosleep(c6cc08a0,ed533cec,46,c0ac9aac,c6cc08a0,...) at nanosleep+0x6c syscall(ed533d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28172567, esp = 0xbf9fef4c, ebp = 0xbf9fef68 --- Tracing command sshlockout_pf pid 32682 tid 100127 td 0xc6cc22e0 sched_switch(c6cc22e0,0,104,a885d5a9,2b0,...) at sched_switch+0xbc mi_switch(104,0,c4da62f8,0,ed52ab40,...) at mi_switch+0xd6 sleepq_switch(c6cc22e0,0,c0f9bf13,1a0,c4fdcd40,...) at sleepq_switch+0xae sleepq_catch_signals(c4da62f8,0,ed52ab90,c0aae62a,c4da6188,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c4da6188,4c,c0f9c5fc,100,0,...) at sleepq_wait_sig+0x18 _sleep(c4da6188,c4da62f8,14c,c0f9c5fc,0,...) at _sleep+0x27a pipe_read(c669b738,ed52ac3c,c498f400,0,c6cc22e0,...) at pipe_read+0x44a dofileread(ed52ac3c,ffffffff,ffffffff,0,c669b738,...) at dofileread+0x90 kern_readv(c6cc22e0,0,ed52ac3c,ed52ac5c,1,...) at kern_readv+0x6a read(c6cc22e0,ed52acec,46,c0ac9aac,c6cc22e0,...) at read+0x50 syscall(ed52ad28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818ee73, esp = 0xbfbfe8ec, ebp = 0xbfbfe908 --- Tracing command login pid 32396 tid 100098 td 0xc66935c0 sched_switch(c66935c0,0,104,765e17bc,1c,...) at sched_switch+0xbc mi_switch(104,0,c668d088,0,ed4b8b60,...) at mi_switch+0xd6 sleepq_switch(c66935c0,0,c0f9bf13,1a0,c497db00,...) at sleepq_switch+0xae sleepq_catch_signals(c668d088,0,ed4b8bb0,c0aae62a,c668d000,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c668d000,5c,c0f9c92e,100,0,...) at sleepq_wait_sig+0x18 _sleep(c668d000,c668d088,15c,c0f9c92e,0,...) at _sleep+0x27a kern_wait(c66935c0,7fb4,ed4b8c58,0,0,...) at kern_wait+0x6ef wait4(c66935c0,ed4b8cec,2,c65e1e00,c,...) at wait4+0x3b syscall(ed4b8d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2810d53b, esp = 0xbfbfed3c, ebp = 0xbfbfed58 --- Tracing command minicron pid 29005 tid 100128 td 0xc6cc2000 sched_switch(c6cc2000,0,104,fecdaec8,1b,...) at sched_switch+0xbc mi_switch(104,0,0,0,ed52dba0,...) at mi_switch+0xd6 sleepq_switch(c6cc2000,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(0,0,83d601,ed52dbf4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c15571c4,5c,c0f99785,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c15571c4,0,15c,c0f99785,83d601,...) at _sleep+0x192 kern_nanosleep(c6cc2000,ed52dc48,ed52dc50,15180,0,...) at kern_nanosleep+0xeb nanosleep(c6cc2000,ed52dcec,2,0,c,...) at nanosleep+0x6c syscall(ed52dd28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815c567, esp = 0xbfbfed2c, ebp = 0xbfbfed58 --- Tracing command minicron pid 28384 tid 100125 td 0xc6cc28a0 sched_switch(c6cc28a0,0,104,fd79580f,1b,...) at sched_switch+0xbc mi_switch(104,0,c6cbbb48,0,ed524b60,...) at mi_switch+0xd6 sleepq_switch(c6cc28a0,0,c0f9bf13,1a0,c4fdccc0,...) at sleepq_switch+0xae sleepq_catch_signals(c6cbbb48,0,ed524bb0,c0aae62a,c6cbbac0,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6cbbac0,5c,c0f9c92e,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6cbbac0,c6cbbb48,15c,c0f9c92e,0,...) at _sleep+0x27a kern_wait(c6cc28a0,ffffffff,ed524c58,0,0,...) at kern_wait+0x6ef wait4(c6cc28a0,ed524cec,2,0,c,...) at wait4+0x3b syscall(ed524d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280f453b, esp = 0xbfbfed3c, ebp = 0xbfbfed58 --- Tracing command minicron pid 27761 tid 100123 td 0xc6cc3000 sched_switch(c6cc3000,0,104,f6aa6211,1b,...) at sched_switch+0xbc mi_switch(104,0,0,0,ed51eba0,...) at mi_switch+0xd6 sleepq_switch(c6cc3000,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(0,0,57e41,ed51ebf4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c15571c4,5c,c0f99785,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c15571c4,0,15c,c0f99785,57e41,...) at _sleep+0x192 kern_nanosleep(c6cc3000,ed51ec48,ed51ec50,e10,0,...) at kern_nanosleep+0xeb nanosleep(c6cc3000,ed51ecec,2,0,c,...) at nanosleep+0x6c syscall(ed51ed28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815c567, esp = 0xbfbfed3c, ebp = 0xbfbfed68 --- Tracing command minicron pid 27262 tid 100121 td 0xc6800000 sched_switch(c6800000,0,104,f685c385,1b,...) at sched_switch+0xbc mi_switch(104,0,c6cbc898,0,ed518b60,...) at mi_switch+0xd6 sleepq_switch(c6800000,0,c0f9bf13,1a0,c497d3c0,...) at sleepq_switch+0xae sleepq_catch_signals(c6cbc898,0,ed518bb0,c0aae62a,c6cbc810,...) at sleepq_catch_signals+0x33b sleepq_wait_sig(c6cbc810,5c,c0f9c92e,100,0,...) at sleepq_wait_sig+0x18 _sleep(c6cbc810,c6cbc898,15c,c0f9c92e,0,...) at _sleep+0x27a kern_wait(c6800000,ffffffff,ed518c58,0,0,...) at kern_wait+0x6ef wait4(c6800000,ed518cec,2,c0f99f18,c,...) at wait4+0x3b syscall(ed518d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280f453b, esp = 0xbfbfed4c, ebp = 0xbfbfed68 --- Tracing command minicron pid 27016 tid 100120 td 0xc68002e0 sched_switch(c68002e0,0,104,ce1ae65b,2a4,...) at sched_switch+0xbc mi_switch(104,0,0,0,ed515ba0,...) at mi_switch+0xd6 sleepq_switch(c68002e0,0,c0f9bf13,1a0,c0ab930a,...) at sleepq_switch+0xae sleepq_catch_signals(0,0,5dc1,ed515bf4,c0aae542,...) at sleepq_catch_signals+0x33b sleepq_timedwait_sig(c15571c4,5c,c0f99785,100,0,...) at sleepq_timedwait_sig+0x1c _sleep(c15571c4,0,15c,c0f99785,5dc1,...) at _sleep+0x192 kern_nanosleep(c68002e0,ed515c48,ed515c50,f0,0,...) at kern_nanosleep+0xeb nanosleep(c68002e0,ed515cec,2,c0ac9aac,c,...) at nanosleep+0x6c syscall(ed515d28) at syscall+0x1fb Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815c567, esp = 0xbfbfed3c, ebp = 0xbfbfed68 --- Tracing command minicron pid 26694 tid 100118 td 0xc68008a0 sched_switch(c68008a0,0,104,f568f99c,1b,...) at sched_switch+0xbc mi_switch(104,0,c6cbd338,0,ed50fb60,...) at mi_switch+0xd6 sleepq_switch(c68008a0,0,c0f9bf13,1a0,c497d300,...) at sleepq_switch+0xae sleepq_catch_signals(c6cbd33[/thread] -
It's missing some info, such as the message log/buffer with the other part of the kernel panic message.
Can't tell much from what you have. It doesn't look familiar, it's crashed in an operation on an OpenVPN tun device. Can't say I've seen that one before.
Could be hardware, but hard to say with any certainty.
Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.