PFSense hangs and needs to reboot
-
Hey guys,
Wonder if anyone can help in this issue.
PFSense 2.1.5, running on VMWare ESXi 5.0. 8GB RAM, 8 vCPUs. The box is used to receive about 90 IPSec VPNs connection from SonicWall firewalls. No fancy ACLs or anything, basically just IPSec tunnels configured.
PFSense once in a while (like 1 time perf month or two) suddenly looses the Web GUI and SSH access. IPsec tunnels that eventually disconnects can't connect anymore, and after a few hours is completely stops. After a reboot, it comes back to work.
System log shows nothings suspecious:
Nov 9 18:09:06 php: rc.newipsecdns: Reloading IPsec tunnel 'CORP13'. Previous IP '187.113.189.163', current IP '187.59.169.165'. Reloading policy Nov 10 08:20:26 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 10 08:20:26 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 10 08:21:22 php: /vpn_ipsec_phase1.php: Reload RJO8 tunnel(s) Nov 10 08:21:22 php: /vpn_ipsec_phase1.php: Reloading IPsec tunnel 'RJO8'. Previous IP '177.11.4.34', current IP '177.11.4.34'. Reloading policy Nov 10 08:21:23 check_reload_status: Syncing firewall Nov 10 08:21:48 check_reload_status: Reloading filter Nov 10 08:21:48 check_reload_status: Restarting ipsec tunnels Nov 10 08:22:06 php: rc.newipsecdns: IPSEC: One or more IPsec tunnel endpoints has changed its IP. Refreshing. Nov 10 10:43:03 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 10 10:43:03 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 10 10:44:10 php: /vpn_ipsec_phase2.php: Reloading IPsec tunnel 'RJO8'. Previous IP '177.11.4.34', current IP '177.11.4.34'. Reloading policy Nov 10 10:44:11 check_reload_status: Syncing firewall Nov 10 10:44:30 check_reload_status: Reloading filter Nov 10 10:49:26 php: /vpn_ipsec.php: Removing SPDs from tunnel gw 'vantixrjo8.dyndns.org'. Local Subnet '10.130.0.0/16' and Remote Subnet '10.133.15.0/24'. Reloading policy Nov 10 10:49:26 php: /vpn_ipsec.php: The command '/usr/local/sbin/setkey -f /tmp/spd.conf.reload.1447159766.OfwldA 2>&1' returned exit code '1', the output was 'libipsec: invalid IP address while parsing "vantixrjo8.dyndns.org" line 1: hostname nor servname provided, or not known at [ out ipsec esp/tunnel/177.154.137.25-vantixrjo8.dyndns.org/unique] parse failed, line 1.' Nov 10 10:49:26 check_reload_status: Syncing firewall Nov 10 10:49:26 check_reload_status: Reloading filter Nov 10 10:49:26 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 10 10:49:26 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 10 10:49:26 check_reload_status: Syncing firewall Nov 10 10:49:26 php: /vpn_ipsec_phase2.php: Reloading IPsec tunnel 'RJO8'. Previous IP '177.11.4.34', current IP '177.11.4.34'. Reloading policy Nov 10 10:49:26 check_reload_status: Reloading filter Nov 10 10:49:26 check_reload_status: Restarting ipsec tunnels Nov 10 10:52:19 check_reload_status: updating dyndns GW_WAN Nov 10 10:52:19 check_reload_status: Restarting ipsec tunnels Nov 10 10:52:19 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 10 10:52:19 check_reload_status: updating dyndns SPODCFW Nov 10 10:52:19 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 10 10:52:19 check_reload_status: updating dyndns GW_WAN Nov 10 10:52:19 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 10 10:52:19 check_reload_status: updating dyndns SPODCFW Nov 10 10:52:19 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 10 11:19:09 syslogd: kernel boot file is /boot/kernel/kernel Nov 10 11:19:09 kernel: Copyright (c) 1992-2012 The FreeBSD Project. Nov 10 11:19:09 kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 Nov 10 11:19:09 kernel: The Regents of the University of California. All rights reserved. Nov 10 11:19:09 kernel: FreeBSD is a registered trademark of The FreeBSD Foundation. Nov 10 11:19:09 kernel: FreeBSD 8.3-RELEASE-p16 #0: Mon Aug 25 08:27:11 EDT 2014 Nov 10 11:19:09 kernel: root@pf2_1_1_amd64.pfsense.org:/usr/obj.amd64/usr/pfSensesrc/src/sys/pfSense_SMP.8 amd64 Nov 10 11:19:09 kernel: Timecounter "i8254" frequency 1193182 Hz quality 0 Nov 10 11:19:09 kernel: CPU: Intel(R) Xeon(R) CPU E5320 @ 1.86GHz (1861.54-MHz K8-class CPU) Nov 10 11:19:09 kernel: Origin = "GenuineIntel" Id = 0x6f1 Family = 6 Model = f Stepping = 1 Nov 10 11:19:09 kernel: Features=0x1fe3fbff <fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,dts,acpi,mmx,fxsr,sse,sse2,ss,htt>Nov 10 11:19:09 kernel: Features2=0x80002201 <sse3,ssse3,cx16,hv>Nov 10 11:19:09 kernel: AMD Features=0x20100800 <syscall,nx,lm>Nov 10 11:19:09 kernel: AMD Features2=0x1 <lahf>Nov 10 11:19:09 kernel: TSC: P-state invariant Nov 10 11:19:09 kernel: real memory = 8589934592 (8192 MB) Nov 10 11:19:09 kernel: avail memory = 8244641792 (7862 MB) Nov 10 11:19:09 kernel: ACPI APIC Table: <ptltd apic=""> Nov 10 11:19:09 kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs Nov 10 11:19:09 kernel: FreeBSD/SMP: 1 package(s) x 4 core(s) Nov 10 11:19:09 kernel: cpu0 (BSP): APIC ID: 0 Nov 10 11:19:09 kernel: cpu1 (AP): APIC ID: 1 Nov 10 11:19:09 kernel: cpu2 (AP): APIC ID: 2 Nov 10 11:19:09 kernel: cpu3 (AP): APIC ID: 3 Nov 10 11:19:09 kernel: MADT: Forcing active-low polarity and level trigger for SCI Nov 10 11:19:09 kernel: ioapic0 <version 1.1=""> irqs 0-23 on motherboard Nov 10 11:19:09 kernel: wlan: mac acl policy registered Nov 10 11:19:09 kernel: ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/. Nov 10 11:19:09 kernel: ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Nov 10 11:19:09 kernel: module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff804abaf0, 0) error 1 Nov 10 11:19:09 kernel: ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/. Nov 10 11:19:09 kernel: ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Nov 10 11:19:09 kernel: module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff804abb90, 0) error 1 Nov 10 11:19:09 kernel: ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/. Nov 10 11:19:09 kernel: ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Nov 10 11:19:09 kernel: module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff804abc30, 0) error 1 Nov 10 11:19:09 kernel: kbd1 at kbdmux0 Nov 10 11:19:09 kernel: cryptosoft0: <software crypto=""> on motherboard Nov 10 11:19:09 kernel: padlock0: No ACE support. Nov 10 11:19:09 kernel: acpi0: <intel 440bx=""> on motherboard Nov 10 11:19:09 kernel: acpi0: [ITHREAD] Nov 10 11:19:09 kernel: acpi0: Power Button (fixed) Nov 10 11:19:09 kernel: acpi_hpet0: <high precision="" event="" timer=""> iomem 0xfed00000-0xfed003ff on acpi0 Nov 10 11:19:09 kernel: Timecounter "HPET" frequency 14318180 Hz quality 900 Nov 10 11:19:09 kernel: Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 Nov 10 11:19:09 kernel: acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 Nov 10 11:19:09 kernel: cpu0: <acpi cpu=""> on acpi0 Nov 10 11:19:09 kernel: cpu1: <acpi cpu=""> on acpi0 Nov 10 11:19:09 kernel: cpu2: <acpi cpu=""> on acpi0 Nov 10 11:19:09 kernel: cpu3: <acpi cpu=""> on acpi0 Nov 10 11:19:09 kernel: pcib0: <acpi host-pci="" bridge=""> port 0xcf8-0xcff on acpi0 Nov 10 11:19:09 kernel: pci0: <acpi pci="" bus=""> on pcib0 Nov 10 11:19:09 kernel: pcib1: <acpi pci-pci="" bridge=""> at device 1.0 on pci0 Nov 10 11:19:09 kernel: pci1: <acpi pci="" bus=""> on pcib1 Nov 10 11:19:09 kernel: isab0: <pci-isa bridge=""> at device 7.0 on pci0 Nov 10 11:19:09 kernel: isa0: <isa bus=""> on isab0 Nov 10 11:19:09 kernel: atapci0: <intel piix4="" udma33="" controller=""> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x10c0-0x10cf at device 7.1 on pci0 Nov 10 11:19:09 kernel: ata0: <ata channel=""> at channel 0 on atapci0 Nov 10 11:19:09 kernel: ata0: [ITHREAD] Nov 10 11:19:09 kernel: ata1: <ata channel=""> at channel 1 on atapci0 Nov 10 11:19:09 kernel: ata1: [ITHREAD] Nov 10 11:19:09 kernel: pci0: <bridge> at device 7.3 (no driver attached) Nov 10 11:19:09 kernel: pci0: <base peripheral=""> at device 7.7 (no driver attached) Nov 10 11:19:09 kernel: vgapci0: <vga-compatible display=""> port 0x10d0-0x10df mem 0xd8000000-0xdbffffff,0xd0800000-0xd0ffffff irq 16 at device 15.0 on pci0 Nov 10 11:19:09 kernel: mpt0: <lsilogic 1030="" ultra4="" adapter=""> port 0x1400-0x14ff mem 0xd0040000-0xd005ffff,0xd0020000-0xd003ffff irq 17 at device 16.0 on pci0 Nov 10 11:19:09 kernel: mpt0: [ITHREAD] Nov 10 11:19:09 kernel: mpt0: MPI Version=1.2.0.0 Nov 10 11:19:09 kernel: pcib2: <acpi pci-pci="" bridge=""> at device 17.0 on pci0 Nov 10 11:19:09 kernel: pci2: <acpi pci="" bus=""> on pcib2 Nov 10 11:19:09 kernel: em0: <intel(r) 1000="" pro="" legacy="" network="" connection="" 1.0.6=""> port 0x2000-0x203f mem 0xd1020000-0xd103ffff,0xd1000000-0xd100ffff irq 18 at device 0.0 on pci2 Nov 10 11:19:09 kernel: em0: [FILTER] Nov 10 11:19:09 kernel: em1: <intel(r) 1000="" pro="" legacy="" network="" connection="" 1.0.6=""> port 0x2040-0x207f mem 0xd1040000-0xd105ffff,0xd1010000-0xd101ffff irq 19 at device 1.0 on pci2 Nov 10 11:19:09 kernel: em1: [FILTER] Nov 10 11:19:09 kernel: pcib3: <acpi pci-pci="" bridge=""> at device 21.0 on pci0 Nov 10 11:19:09 kernel: pci3: <acpi pci="" bus=""> on pcib3 Nov 10 11:19:09 kernel: pcib4: <acpi pci-pci="" bridge=""> at device 21.1 on pci0 Nov 10 11:19:09 kernel: pci4: <acpi pci="" bus=""> on pcib4 Nov 10 11:19:09 kernel: pcib5: <acpi pci-pci="" bridge=""> at device 21.2 on pci0 Nov 10 11:19:09 kernel: pci5: <acpi pci="" bus=""> on pcib5 Nov 10 11:19:09 kernel: pcib6: <acpi pci-pci="" bridge=""> at device 21.3 on pci0 Nov 10 11:19:09 kernel: pci6: <acpi pci="" bus=""> on pcib6 Nov 10 11:19:09 kernel: pcib7: <acpi pci-pci="" bridge=""> at device 21.4 on pci0 Nov 10 11:19:09 kernel: pci7: <acpi pci="" bus=""> on pcib7 Nov 10 11:19:09 kernel: pcib8: <acpi pci-pci="" bridge=""> at device 21.5 on pci0 Nov 10 11:19:09 kernel: pci8: <acpi pci="" bus=""> on pcib8 Nov 10 11:19:09 kernel: pcib9: <acpi pci-pci="" bridge=""> at device 21.6 on pci0 Nov 10 11:19:09 kernel: pci9: <acpi pci="" bus=""> on pcib9 Nov 10 11:19:09 kernel: pcib10: <acpi pci-pci="" bridge=""> at device 21.7 on pci0 Nov 10 11:19:09 kernel: pci10: <acpi pci="" bus=""> on pcib10 Nov 10 11:19:09 kernel: pcib11: <acpi pci-pci="" bridge=""> at device 22.0 on pci0 Nov 10 11:19:09 kernel: pci11: <acpi pci="" bus=""> on pcib11 Nov 10 11:19:09 kernel: pcib12: <acpi pci-pci="" bridge=""> at device 22.1 on pci0 Nov 10 11:19:09 kernel: pci12: <acpi pci="" bus=""> on pcib12 Nov 10 11:19:09 kernel: pcib13: <acpi pci-pci="" bridge=""> at device 22.2 on pci0 Nov 10 11:19:09 kernel: pci13: <acpi pci="" bus=""> on pcib13 Nov 10 11:19:09 kernel: pcib14: <acpi pci-pci="" bridge=""> at device 22.3 on pci0 Nov 10 11:19:09 kernel: pci14: <acpi pci="" bus=""> on pcib14 Nov 10 11:19:09 kernel: pcib15: <acpi pci-pci="" bridge=""> at device 22.4 on pci0 Nov 10 11:19:09 kernel: pci15: <acpi pci="" bus=""> on pcib15 Nov 10 11:19:09 kernel: pcib16: <acpi pci-pci="" bridge=""> at device 22.5 on pci0 Nov 10 11:19:09 kernel: pci16: <acpi pci="" bus=""> on pcib16 Nov 10 11:19:09 kernel: pcib17: <acpi pci-pci="" bridge=""> at device 22.6 on pci0 Nov 10 11:19:09 kernel: pci17: <acpi pci="" bus=""> on pcib17 Nov 10 11:19:09 kernel: pcib18: <acpi pci-pci="" bridge=""> at device 22.7 on pci0 Nov 10 11:19:09 kernel: pci18: <acpi pci="" bus=""> on pcib18 Nov 10 11:19:09 kernel: pcib19: <acpi pci-pci="" bridge=""> at device 23.0 on pci0 Nov 10 11:19:09 kernel: pci19: <acpi pci="" bus=""> on pcib19 Nov 10 11:19:09 kernel: pcib20: <acpi pci-pci="" bridge=""> at device 23.1 on pci0 Nov 10 11:19:09 kernel: pci20: <acpi pci="" bus=""> on pcib20 Nov 10 11:19:09 kernel: pcib21: <acpi pci-pci="" bridge=""> at device 23.2 on pci0 Nov 10 11:19:09 kernel: pci21: <acpi pci="" bus=""> on pcib21 Nov 10 11:19:09 kernel: pcib22: <acpi pci-pci="" bridge=""> at device 23.3 on pci0 Nov 10 11:19:09 kernel: pci22: <acpi pci="" bus=""> on pcib22 Nov 10 11:19:09 kernel: pcib23: <acpi pci-pci="" bridge=""> at device 23.4 on pci0 Nov 10 11:19:09 kernel: pci23: <acpi pci="" bus=""> on pcib23 Nov 10 11:19:09 kernel: pcib24: <acpi pci-pci="" bridge=""> at device 23.5 on pci0 Nov 10 11:19:09 kernel: pci24: <acpi pci="" bus=""> on pcib24 Nov 10 11:19:09 kernel: pcib25: <acpi pci-pci="" bridge=""> at device 23.6 on pci0 Nov 10 11:19:09 kernel: pci25: <acpi pci="" bus=""> on pcib25 Nov 10 11:19:09 kernel: pcib26: <acpi pci-pci="" bridge=""> at device 23.7 on pci0 Nov 10 11:19:09 kernel: pci26: <acpi pci="" bus=""> on pcib26 Nov 10 11:19:09 kernel: pcib27: <acpi pci-pci="" bridge=""> at device 24.0 on pci0 Nov 10 11:19:09 kernel: pci27: <acpi pci="" bus=""> on pcib27 Nov 10 11:19:09 kernel: pcib28: <acpi pci-pci="" bridge=""> at device 24.1 on pci0 Nov 10 11:19:09 kernel: pci28: <acpi pci="" bus=""> on pcib28 Nov 10 11:19:09 kernel: pcib29: <acpi pci-pci="" bridge=""> at device 24.2 on pci0 Nov 10 11:19:09 kernel: pci29: <acpi pci="" bus=""> on pcib29 Nov 10 11:19:09 kernel: pcib30: <acpi pci-pci="" bridge=""> at device 24.3 on pci0 Nov 10 11:19:09 kernel: pci30: <acpi pci="" bus=""> on pcib30 Nov 10 11:19:09 kernel: pcib31: <acpi pci-pci="" bridge=""> at device 24.4 on pci0 Nov 10 11:19:09 kernel: pci31: <acpi pci="" bus=""> on pcib31 Nov 10 11:19:09 kernel: pcib32: <acpi pci-pci="" bridge=""> at device 24.5 on pci0 Nov 10 11:19:09 kernel: pci32: <acpi pci="" bus=""> on pcib32 Nov 10 11:19:09 kernel: pcib33: <acpi pci-pci="" bridge=""> at device 24.6 on pci0 Nov 10 11:19:09 kernel: pci33: <acpi pci="" bus=""> on pcib33 Nov 10 11:19:09 kernel: pcib34: <acpi pci-pci="" bridge=""> at device 24.7 on pci0 Nov 10 11:19:09 kernel: pci34: <acpi pci="" bus=""> on pcib34 Nov 10 11:19:09 kernel: acpi_acad0: <ac adapter=""> on acpi0 Nov 10 11:19:09 kernel: atrtc0: <at realtime="" clock=""> port 0x70-0x71 irq 8 on acpi0 Nov 10 11:19:09 kernel: atkbdc0: <keyboard controller="" (i8042)=""> port 0x60,0x64 irq 1 on acpi0 Nov 10 11:19:09 kernel: atkbd0: <at keyboard=""> irq 1 on atkbdc0 Nov 10 11:19:09 kernel: kbd0 at atkbd0 Nov 10 11:19:09 kernel: atkbd0: [GIANT-LOCKED] Nov 10 11:19:09 kernel: atkbd0: [ITHREAD] Nov 10 11:19:09 kernel: psm0: <ps 2="" mouse=""> irq 12 on atkbdc0 Nov 10 11:19:09 kernel: psm0: [GIANT-LOCKED] Nov 10 11:19:09 kernel: psm0: [ITHREAD] Nov 10 11:19:09 kernel: psm0: model IntelliMouse, device ID 3 Nov 10 11:19:09 kernel: ppc0: <parallel port=""> port 0x378-0x37f irq 7 on acpi0 Nov 10 11:19:09 kernel: ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode Nov 10 11:19:09 kernel: ppc0: [ITHREAD] Nov 10 11:19:09 kernel: ppbus0: <parallel port="" bus=""> on ppc0 Nov 10 11:19:09 kernel: plip0: <plip network="" interface=""> on ppbus0 Nov 10 11:19:09 kernel: plip0: [ITHREAD] Nov 10 11:19:09 kernel: lpt0: <printer> on ppbus0 Nov 10 11:19:09 kernel: lpt0: [ITHREAD] Nov 10 11:19:09 kernel: lpt0: Interrupt-driven port Nov 10 11:19:09 kernel: ppi0: <parallel i="" o=""> on ppbus0 Nov 10 11:19:09 kernel: uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 Nov 10 11:19:09 kernel: uart0: [FILTER] Nov 10 11:19:09 kernel: uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 Nov 10 11:19:09 kernel: uart1: [FILTER] Nov 10 11:19:09 kernel: fdc0: <floppy drive="" controller=""> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 Nov 10 11:19:09 kernel: fdc0: [FILTER] Nov 10 11:19:09 kernel: fd0: <1440-KB 3.5" drive> on fdc0 drive 0 Nov 10 11:19:09 kernel: orm0: <isa option="" roms=""> at iomem 0xc0000-0xc7fff,0xca000-0xcafff,0xcb000-0xcbfff,0xdc000-0xdffff,0xe0000-0xe3fff on isa0 Nov 10 11:19:09 kernel: sc0: <system console=""> at flags 0x100 on isa0 Nov 10 11:19:09 kernel: sc0: VGA <16 virtual consoles, flags=0x300> Nov 10 11:19:09 kernel: vga0: <generic isa="" vga=""> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Nov 10 11:19:09 kernel: acpi_throttle0: <acpi cpu="" throttling=""> on cpu0 Nov 10 11:19:09 kernel: acpi_throttle1: <acpi cpu="" throttling=""> on cpu1 Nov 10 11:19:09 kernel: acpi_throttle1: failed to attach P_CNT Nov 10 11:19:09 kernel: device_attach: acpi_throttle1 attach returned 6 Nov 10 11:19:09 kernel: acpi_throttle2: <acpi cpu="" throttling=""> on cpu2 Nov 10 11:19:09 kernel: acpi_throttle2: failed to attach P_CNT Nov 10 11:19:09 kernel: device_attach: acpi_throttle2 attach returned 6 Nov 10 11:19:09 kernel: acpi_throttle3: <acpi cpu="" throttling=""> on cpu3 Nov 10 11:19:09 kernel: acpi_throttle3: failed to attach P_CNT Nov 10 11:19:09 kernel: device_attach: acpi_throttle3 attach returned 6 Nov 10 11:19:09 kernel: Timecounters tick every 10.000 msec Nov 10 11:19:09 kernel: IPsec: Initialized Security Association Processing. Nov 10 11:19:09 kernel: acd0: DVDR <vmware virtual="" ide="" cdrom="" drive="" 00000001=""> at ata1-master UDMA33 Nov 10 11:19:09 kernel: da0 at mpt0 bus 0 scbus0 target 0 lun 0 Nov 10 11:19:09 kernel: da0: <vmware virtual="" disk="" 1.0=""> Fixed Direct Access SCSI-2 device Nov 10 11:19:09 kernel: da0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit) Nov 10 11:19:09 kernel: da0: Command Queueing enabled Nov 10 11:19:09 kernel: da0: 8192MB (16777216 512 byte sectors: 255H 63S/T 1044C) Nov 10 11:19:09 kernel: SMP: AP CPU #2 Launched! Nov 10 11:19:09 kernel: SMP: AP CPU #3 Launched! Nov 10 11:19:09 kernel: SMP: AP CPU #1 Launched! Nov 10 11:19:09 kernel: Trying to mount root from ufs:/dev/da0s1a Nov 10 11:19:09 kernel: WARNING: / was not properly dismounted Nov 10 11:19:09 kernel: ZFS WARNING: Recommended minimum kmem_size is 512MB; expect unstable behavior. Nov 10 11:19:09 kernel: Consider tuning vm.kmem_size and vm.kmem_size_max Nov 10 11:19:09 kernel: in /boot/loader.conf. Nov 10 11:19:09 kernel: ZFS filesystem version 5 Nov 10 11:19:09 kernel: ZFS storage pool version 28 Nov 10 11:19:09 php: rc.bootup: Resyncing OpenVPN instances. Nov 10 11:19:09 kernel: pflog0: promiscuous mode enabled Nov 10 11:19:09 sshd[14433]: Server listening on :: port 35222. Nov 10 11:19:09 sshd[14433]: Server listening on 0.0.0.0 port 35222. Nov 10 11:19:10 sshlockout[14501]: sshlockout/webConfigurator v3.0 starting up Nov 10 11:19:14 php: rc.bootup: ROUTING: setting default route to 177.154.137.1 Nov 10 11:19:14 check_reload_status: Updating all dyndns Nov 10 15:07:12 check_reload_status: updating dyndns GW_WAN Nov 10 15:07:12 check_reload_status: Restarting ipsec tunnels Nov 10 15:07:12 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 10 15:07:12 check_reload_status: Reloading filter Nov 10 15:07:12 check_reload_status: updating dyndns SPODCFW Nov 10 15:07:12 check_reload_status: Restarting ipsec tunnels Nov 10 15:07:12 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 10 15:07:12 check_reload_status: Reloading filter Nov 10 15:07:12 check_reload_status: updating dyndns GW_WAN Nov 10 15:07:12 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 10 15:07:12 check_reload_status: updating dyndns SPODCFW Nov 10 15:07:12 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 10 15:07:28 check_reload_status: Restarting ipsec tunnels Nov 10 15:07:28 check_reload_status: Restarting ipsec tunnels Nov 10 15:07:30 snmpd[40726]: disk_OS_get_disks: device 'da0' not in device list Nov 10 15:07:31 php: rc.bootup: Creating rrd update script Nov 10 15:07:31 syslogd: exiting on signal 15 Nov 10 15:07:31 syslogd: kernel boot file is /boot/kernel/kernel Nov 10 15:07:55 check_reload_status: Reloading filter Nov 10 15:07:56 php: rc.start_packages: Restarting/Starting all packages. Nov 10 15:08:10 kernel: VMware memory control driver initialized Nov 10 15:08:11 login: login on ttyv0 as root Nov 10 15:08:11 sshlockout[88843]: sshlockout/webConfigurator v3.0 starting up Nov 11 03:07:38 check_reload_status: updating dyndns GW_WAN Nov 11 03:07:38 check_reload_status: Restarting ipsec tunnels Nov 11 03:07:38 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 11 03:07:38 check_reload_status: Reloading filter Nov 11 03:07:38 check_reload_status: updating dyndns SPODCFW Nov 11 03:07:38 check_reload_status: Restarting ipsec tunnels Nov 11 03:07:38 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 11 03:07:38 check_reload_status: Reloading filter Nov 11 03:07:38 check_reload_status: updating dyndns GW_WAN Nov 11 03:07:38 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 11 03:07:38 check_reload_status: updating dyndns SPODCFW Nov 11 03:07:38 check_reload_status: Restarting OpenVPN tunnels/interfaces Nov 11 03:08:07 php: rc.newipsecdns: IPSEC: One or more IPsec tunnel endpoints has changed its IP. Refreshing. Nov 11 03:08:07 php: rc.newipsecdns: IPSEC: One or more IPsec tunnel endpoints has changed its IP. Refreshing. Nov 11 03:08:07 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 11 03:08:07 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 11 03:08:33 lighttpd[20271]: (connections.c.137) (warning) close: 14 Connection reset by peer Nov 11 03:08:55 lighttpd[20271]: (connections.c.137) (warning) close: 16 Connection reset by peer Nov 11 03:09:43 lighttpd[20271]: (connections.c.137) (warning) close: 18 Connection reset by peer Nov 11 03:10:52 lighttpd[20271]: (connections.c.137) (warning) close: 17 Connection reset by peer Nov 11 03:11:04 lighttpd[20271]: (connections.c.137) (warning) close: 15 Connection reset by peer Nov 11 03:12:31 php: /vpn_ipsec.php: Removing SPDs from tunnel gw 'vantixrjo8.dyndns.org'. Local Subnet '10.130.0.0/16' and Remote Subnet '10.133.15.0/24'. Reloading policy Nov 11 03:12:37 php: /vpn_ipsec.php: The command '/usr/local/sbin/setkey -f /tmp/spd.conf.reload.1447218751.KrYbBC 2>&1' returned exit code '1', the output was 'libipsec: invalid IP address while parsing "vantixrjo8.dyndns.org" line 1: hostname nor servname provided, or not known at [ out ipsec esp/tunnel/177.154.137.25-vantixrjo8.dyndns.org/unique] parse failed, line 1.' Nov 11 03:13:02 check_reload_status: Syncing firewall Nov 11 03:13:02 check_reload_status: Reloading filter Nov 11 03:13:41 check_reload_status: Syncing firewall Nov 11 03:14:16 php: /system_routes.php: ROUTING: setting default route to 177.154.137.1 Nov 11 03:14:16 check_reload_status: Reloading filter Nov 11 03:18:21 check_reload_status: Syncing firewall Nov 11 03:19:03 check_reload_status: Syncing firewall Nov 11 03:19:45 php: /vpn_ipsec_phase2.php: Reloading IPsec tunnel 'rjo8'. Previous IP '177.11.4.34', current IP '177.11.4.34'. Reloading policy Nov 11 03:19:46 check_reload_status: Syncing firewall Nov 11 03:20:21 check_reload_status: Reloading filter Nov 11 03:20:21 check_reload_status: Restarting ipsec tunnels Nov 11 03:20:39 php: rc.newipsecdns: IPSEC: One or more IPsec tunnel endpoints has changed its IP. Refreshing. Nov 10 15:57:49 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 10 15:57:49 php: /index.php: Successful login for user 'admin' from: 187.11.239.192 Nov 10 15:58:14 lighttpd[20271]: (connections.c.137) (warning) close: 18 Connection reset by peer Nov 10 16:03:05 php: /index.php: Successful login for user 'admin' from: 191.181.30.76 Nov 10 16:03:05 php: /index.php: Successful login for user 'admin' from: 191.181.30.76 Nov 10 16:03:25 lighttpd[20271]: (connections.c.137) (warning) close: 15 Connection reset by peer Nov 10 16:03:32 lighttpd[20271]: (connections.c.137) (warning) close: 18 Connection reset by peer Nov 10 16:04:21 lighttpd[20271]: (connections.c.137) (warning) close: 16 Connection reset by peer Nov 10 16:06:44 lighttpd[20271]: (connections.c.137) (warning) close: 18 Connection reset by peer Nov 10 16:06:51 lighttpd[20271]: (connections.c.137) (warning) close: 17 Connection reset by peer Nov 10 16:07:10 check_reload_status: Syncing firewall Nov 10 16:07:11 syslogd: exiting on signal 15 Nov 10 16:07:11 syslogd: kernel boot file is /boot/kernel/kernel Nov 10 16:07:11 kernel: pflog0: promiscuous mode disabled Nov 10 16:07:11 kernel: pflog0: promiscuous mode enabled Nov 10 16:18:13 lighttpd[20271]: (connections.c.137) (warning) close: 19 Connection reset by peer Nov 10 16:20:39 kernel: pflog0: promiscuous mode disabled Nov 10 16:20:39 kernel: pflog0: promiscuous mode enabled</vmware></vmware></acpi></acpi></acpi></acpi></generic></system></isa></floppy></parallel></printer></plip></parallel></parallel></ps></at></keyboard></at></ac></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></intel(r)></intel(r)></acpi></acpi></lsilogic></vga-compatible></bridge></ata></ata></intel></isa></pci-isa></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></high></intel></software></version></ptltd></lahf></syscall,nx,lm></sse3,ssse3,cx16,hv></fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,dts,acpi,mmx,fxsr,sse,sse2,ss,htt>Any guesses? Any other log I should take a look?
Thanks a lot in advance,
Rafael
-
https://forum.pfsense.org/index.php?topic=54206.0
have you tried this fix / patch ?
it solved my random crashes.
also, remove the virtual-cd-drive from the VM -
Am in a similar state. I have a pfsense box C2578 model. I reset it to factory default settings and as it was trying to reboot it got stuck at
"trying to mount root from ufs:/dev/ufsid/5548bb3f61b43ef3 [rw]…. "
The only thing I can do is reboot the device which ends up here.
One more thing, there is a beep sound at boot process
Any assistance will be highly appreciated.
Thanks in Advance :) :)
-
@mike254:
Am in a similar state. I have a pfsense box C2578 model. I reset it to factory default settings and as it was trying to reboot it got stuck at
"trying to mount root from ufs:/dev/ufsid/5548bb3f61b43ef3 [rw]…. "
That's where it switches over to serial console up until the boot process is complete. It's probably stopping at an interface assignment prompt which is only visible on the serial console. Connect a null modem cable to the serial port and console into it and you should be able to assign the NICs and continue. Get in touch with us via support if you need further help with that.
-
That's where it switches over to serial console up until the boot process is complete. It's probably stopping at an interface assignment prompt which is only visible on the serial console. Connect a null modem cable to the serial port and console into it and you should be able to assign the NICs and continue. Get in touch with us via support if you need further help with that.
Thanks cmb
Does this mean the hardware is not faulty?
-
@mike254:
That's where it switches over to serial console up until the boot process is complete. It's probably stopping at an interface assignment prompt which is only visible on the serial console. Connect a null modem cable to the serial port and console into it and you should be able to assign the NICs and continue. Get in touch with us via support if you need further help with that.
Thanks cmb
Does this mean the hardware is not faulty?
Are there any commands i need to enter on my terminal to access the Serial console?
Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.