PFSense hangs and needs to reboot



  • Hey guys,

    Wonder if anyone can help in this issue.

    PFSense 2.1.5, running on VMWare ESXi 5.0. 8GB RAM, 8 vCPUs. The box is used to receive about 90 IPSec VPNs connection from SonicWall firewalls. No fancy ACLs or anything, basically just IPSec tunnels configured.

    PFSense once in a while (like 1 time perf month or two) suddenly looses the Web GUI and SSH access. IPsec tunnels that eventually disconnects can't connect anymore, and after a few hours is completely stops. After a reboot, it comes back to work.

    System log shows nothings suspecious:

    Nov 9 18:09:06	php: rc.newipsecdns: Reloading IPsec tunnel 'CORP13'. Previous IP '187.113.189.163', current IP '187.59.169.165'. Reloading policy
    Nov 10 08:20:26	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 10 08:20:26	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 10 08:21:22	php: /vpn_ipsec_phase1.php: Reload RJO8 tunnel(s)
    Nov 10 08:21:22	php: /vpn_ipsec_phase1.php: Reloading IPsec tunnel 'RJO8'. Previous IP '177.11.4.34', current IP '177.11.4.34'. Reloading policy
    Nov 10 08:21:23	check_reload_status: Syncing firewall
    Nov 10 08:21:48	check_reload_status: Reloading filter
    Nov 10 08:21:48	check_reload_status: Restarting ipsec tunnels
    Nov 10 08:22:06	php: rc.newipsecdns: IPSEC: One or more IPsec tunnel endpoints has changed its IP. Refreshing.
    Nov 10 10:43:03	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 10 10:43:03	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 10 10:44:10	php: /vpn_ipsec_phase2.php: Reloading IPsec tunnel 'RJO8'. Previous IP '177.11.4.34', current IP '177.11.4.34'. Reloading policy
    Nov 10 10:44:11	check_reload_status: Syncing firewall
    Nov 10 10:44:30	check_reload_status: Reloading filter
    Nov 10 10:49:26	php: /vpn_ipsec.php: Removing SPDs from tunnel gw 'vantixrjo8.dyndns.org'. Local Subnet '10.130.0.0/16' and Remote Subnet '10.133.15.0/24'. Reloading policy
    Nov 10 10:49:26	php: /vpn_ipsec.php: The command '/usr/local/sbin/setkey -f /tmp/spd.conf.reload.1447159766.OfwldA 2>&1' returned exit code '1', the output was 'libipsec: invalid IP address while parsing "vantixrjo8.dyndns.org" line 1: hostname nor servname provided, or not known at [ out ipsec esp/tunnel/177.154.137.25-vantixrjo8.dyndns.org/unique] parse failed, line 1.'
    Nov 10 10:49:26	check_reload_status: Syncing firewall
    Nov 10 10:49:26	check_reload_status: Reloading filter
    Nov 10 10:49:26	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 10 10:49:26	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 10 10:49:26	check_reload_status: Syncing firewall
    Nov 10 10:49:26	php: /vpn_ipsec_phase2.php: Reloading IPsec tunnel 'RJO8'. Previous IP '177.11.4.34', current IP '177.11.4.34'. Reloading policy
    Nov 10 10:49:26	check_reload_status: Reloading filter
    Nov 10 10:49:26	check_reload_status: Restarting ipsec tunnels
    Nov 10 10:52:19	check_reload_status: updating dyndns GW_WAN
    Nov 10 10:52:19	check_reload_status: Restarting ipsec tunnels
    Nov 10 10:52:19	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 10 10:52:19	check_reload_status: updating dyndns SPODCFW
    Nov 10 10:52:19	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 10 10:52:19	check_reload_status: updating dyndns GW_WAN
    Nov 10 10:52:19	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 10 10:52:19	check_reload_status: updating dyndns SPODCFW
    Nov 10 10:52:19	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 10 11:19:09	syslogd: kernel boot file is /boot/kernel/kernel
    Nov 10 11:19:09	kernel: Copyright (c) 1992-2012 The FreeBSD Project.
    Nov 10 11:19:09	kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
    Nov 10 11:19:09	kernel: The Regents of the University of California. All rights reserved.
    Nov 10 11:19:09	kernel: FreeBSD is a registered trademark of The FreeBSD Foundation.
    Nov 10 11:19:09	kernel: FreeBSD 8.3-RELEASE-p16 #0: Mon Aug 25 08:27:11 EDT 2014
    Nov 10 11:19:09	kernel: root@pf2_1_1_amd64.pfsense.org:/usr/obj.amd64/usr/pfSensesrc/src/sys/pfSense_SMP.8 amd64
    Nov 10 11:19:09	kernel: Timecounter "i8254" frequency 1193182 Hz quality 0
    Nov 10 11:19:09	kernel: CPU: Intel(R) Xeon(R) CPU E5320 @ 1.86GHz (1861.54-MHz K8-class CPU)
    Nov 10 11:19:09	kernel: Origin = "GenuineIntel" Id = 0x6f1 Family = 6 Model = f Stepping = 1
    Nov 10 11:19:09	kernel: Features=0x1fe3fbff <fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,dts,acpi,mmx,fxsr,sse,sse2,ss,htt>Nov 10 11:19:09	kernel: Features2=0x80002201 <sse3,ssse3,cx16,hv>Nov 10 11:19:09	kernel: AMD Features=0x20100800 <syscall,nx,lm>Nov 10 11:19:09	kernel: AMD Features2=0x1 <lahf>Nov 10 11:19:09	kernel: TSC: P-state invariant
    Nov 10 11:19:09	kernel: real memory = 8589934592 (8192 MB)
    Nov 10 11:19:09	kernel: avail memory = 8244641792 (7862 MB)
    Nov 10 11:19:09	kernel: ACPI APIC Table: <ptltd apic="">
    Nov 10 11:19:09	kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
    Nov 10 11:19:09	kernel: FreeBSD/SMP: 1 package(s) x 4 core(s)
    Nov 10 11:19:09	kernel: cpu0 (BSP): APIC ID: 0
    Nov 10 11:19:09	kernel: cpu1 (AP): APIC ID: 1
    Nov 10 11:19:09	kernel: cpu2 (AP): APIC ID: 2
    Nov 10 11:19:09	kernel: cpu3 (AP): APIC ID: 3
    Nov 10 11:19:09	kernel: MADT: Forcing active-low polarity and level trigger for SCI
    Nov 10 11:19:09	kernel: ioapic0 <version 1.1=""> irqs 0-23 on motherboard
    Nov 10 11:19:09	kernel: wlan: mac acl policy registered
    Nov 10 11:19:09	kernel: ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
    Nov 10 11:19:09	kernel: ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
    Nov 10 11:19:09	kernel: module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff804abaf0, 0) error 1
    Nov 10 11:19:09	kernel: ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
    Nov 10 11:19:09	kernel: ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
    Nov 10 11:19:09	kernel: module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff804abb90, 0) error 1
    Nov 10 11:19:09	kernel: ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
    Nov 10 11:19:09	kernel: ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
    Nov 10 11:19:09	kernel: module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff804abc30, 0) error 1
    Nov 10 11:19:09	kernel: kbd1 at kbdmux0
    Nov 10 11:19:09	kernel: cryptosoft0: <software crypto=""> on motherboard
    Nov 10 11:19:09	kernel: padlock0: No ACE support.
    Nov 10 11:19:09	kernel: acpi0: <intel 440bx=""> on motherboard
    Nov 10 11:19:09	kernel: acpi0: [ITHREAD]
    Nov 10 11:19:09	kernel: acpi0: Power Button (fixed)
    Nov 10 11:19:09	kernel: acpi_hpet0: <high precision="" event="" timer=""> iomem 0xfed00000-0xfed003ff on acpi0
    Nov 10 11:19:09	kernel: Timecounter "HPET" frequency 14318180 Hz quality 900
    Nov 10 11:19:09	kernel: Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
    Nov 10 11:19:09	kernel: acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
    Nov 10 11:19:09	kernel: cpu0: <acpi cpu=""> on acpi0
    Nov 10 11:19:09	kernel: cpu1: <acpi cpu=""> on acpi0
    Nov 10 11:19:09	kernel: cpu2: <acpi cpu=""> on acpi0
    Nov 10 11:19:09	kernel: cpu3: <acpi cpu=""> on acpi0
    Nov 10 11:19:09	kernel: pcib0: <acpi host-pci="" bridge=""> port 0xcf8-0xcff on acpi0
    Nov 10 11:19:09	kernel: pci0: <acpi pci="" bus=""> on pcib0
    Nov 10 11:19:09	kernel: pcib1: <acpi pci-pci="" bridge=""> at device 1.0 on pci0
    Nov 10 11:19:09	kernel: pci1: <acpi pci="" bus=""> on pcib1
    Nov 10 11:19:09	kernel: isab0: <pci-isa bridge=""> at device 7.0 on pci0
    Nov 10 11:19:09	kernel: isa0: <isa bus=""> on isab0
    Nov 10 11:19:09	kernel: atapci0: <intel piix4="" udma33="" controller=""> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x10c0-0x10cf at device 7.1 on pci0
    Nov 10 11:19:09	kernel: ata0: <ata channel=""> at channel 0 on atapci0
    Nov 10 11:19:09	kernel: ata0: [ITHREAD]
    Nov 10 11:19:09	kernel: ata1: <ata channel=""> at channel 1 on atapci0
    Nov 10 11:19:09	kernel: ata1: [ITHREAD]
    Nov 10 11:19:09	kernel: pci0: <bridge> at device 7.3 (no driver attached)
    Nov 10 11:19:09	kernel: pci0: <base peripheral=""> at device 7.7 (no driver attached)
    Nov 10 11:19:09	kernel: vgapci0: <vga-compatible display=""> port 0x10d0-0x10df mem 0xd8000000-0xdbffffff,0xd0800000-0xd0ffffff irq 16 at device 15.0 on pci0
    Nov 10 11:19:09	kernel: mpt0: <lsilogic 1030="" ultra4="" adapter=""> port 0x1400-0x14ff mem 0xd0040000-0xd005ffff,0xd0020000-0xd003ffff irq 17 at device 16.0 on pci0
    Nov 10 11:19:09	kernel: mpt0: [ITHREAD]
    Nov 10 11:19:09	kernel: mpt0: MPI Version=1.2.0.0
    Nov 10 11:19:09	kernel: pcib2: <acpi pci-pci="" bridge=""> at device 17.0 on pci0
    Nov 10 11:19:09	kernel: pci2: <acpi pci="" bus=""> on pcib2
    Nov 10 11:19:09	kernel: em0: <intel(r) 1000="" pro="" legacy="" network="" connection="" 1.0.6=""> port 0x2000-0x203f mem 0xd1020000-0xd103ffff,0xd1000000-0xd100ffff irq 18 at device 0.0 on pci2
    Nov 10 11:19:09	kernel: em0: [FILTER]
    Nov 10 11:19:09	kernel: em1: <intel(r) 1000="" pro="" legacy="" network="" connection="" 1.0.6=""> port 0x2040-0x207f mem 0xd1040000-0xd105ffff,0xd1010000-0xd101ffff irq 19 at device 1.0 on pci2
    Nov 10 11:19:09	kernel: em1: [FILTER]
    Nov 10 11:19:09	kernel: pcib3: <acpi pci-pci="" bridge=""> at device 21.0 on pci0
    Nov 10 11:19:09	kernel: pci3: <acpi pci="" bus=""> on pcib3
    Nov 10 11:19:09	kernel: pcib4: <acpi pci-pci="" bridge=""> at device 21.1 on pci0
    Nov 10 11:19:09	kernel: pci4: <acpi pci="" bus=""> on pcib4
    Nov 10 11:19:09	kernel: pcib5: <acpi pci-pci="" bridge=""> at device 21.2 on pci0
    Nov 10 11:19:09	kernel: pci5: <acpi pci="" bus=""> on pcib5
    Nov 10 11:19:09	kernel: pcib6: <acpi pci-pci="" bridge=""> at device 21.3 on pci0
    Nov 10 11:19:09	kernel: pci6: <acpi pci="" bus=""> on pcib6
    Nov 10 11:19:09	kernel: pcib7: <acpi pci-pci="" bridge=""> at device 21.4 on pci0
    Nov 10 11:19:09	kernel: pci7: <acpi pci="" bus=""> on pcib7
    Nov 10 11:19:09	kernel: pcib8: <acpi pci-pci="" bridge=""> at device 21.5 on pci0
    Nov 10 11:19:09	kernel: pci8: <acpi pci="" bus=""> on pcib8
    Nov 10 11:19:09	kernel: pcib9: <acpi pci-pci="" bridge=""> at device 21.6 on pci0
    Nov 10 11:19:09	kernel: pci9: <acpi pci="" bus=""> on pcib9
    Nov 10 11:19:09	kernel: pcib10: <acpi pci-pci="" bridge=""> at device 21.7 on pci0
    Nov 10 11:19:09	kernel: pci10: <acpi pci="" bus=""> on pcib10
    Nov 10 11:19:09	kernel: pcib11: <acpi pci-pci="" bridge=""> at device 22.0 on pci0
    Nov 10 11:19:09	kernel: pci11: <acpi pci="" bus=""> on pcib11
    Nov 10 11:19:09	kernel: pcib12: <acpi pci-pci="" bridge=""> at device 22.1 on pci0
    Nov 10 11:19:09	kernel: pci12: <acpi pci="" bus=""> on pcib12
    Nov 10 11:19:09	kernel: pcib13: <acpi pci-pci="" bridge=""> at device 22.2 on pci0
    Nov 10 11:19:09	kernel: pci13: <acpi pci="" bus=""> on pcib13
    Nov 10 11:19:09	kernel: pcib14: <acpi pci-pci="" bridge=""> at device 22.3 on pci0
    Nov 10 11:19:09	kernel: pci14: <acpi pci="" bus=""> on pcib14
    Nov 10 11:19:09	kernel: pcib15: <acpi pci-pci="" bridge=""> at device 22.4 on pci0
    Nov 10 11:19:09	kernel: pci15: <acpi pci="" bus=""> on pcib15
    Nov 10 11:19:09	kernel: pcib16: <acpi pci-pci="" bridge=""> at device 22.5 on pci0
    Nov 10 11:19:09	kernel: pci16: <acpi pci="" bus=""> on pcib16
    Nov 10 11:19:09	kernel: pcib17: <acpi pci-pci="" bridge=""> at device 22.6 on pci0
    Nov 10 11:19:09	kernel: pci17: <acpi pci="" bus=""> on pcib17
    Nov 10 11:19:09	kernel: pcib18: <acpi pci-pci="" bridge=""> at device 22.7 on pci0
    Nov 10 11:19:09	kernel: pci18: <acpi pci="" bus=""> on pcib18
    Nov 10 11:19:09	kernel: pcib19: <acpi pci-pci="" bridge=""> at device 23.0 on pci0
    Nov 10 11:19:09	kernel: pci19: <acpi pci="" bus=""> on pcib19
    Nov 10 11:19:09	kernel: pcib20: <acpi pci-pci="" bridge=""> at device 23.1 on pci0
    Nov 10 11:19:09	kernel: pci20: <acpi pci="" bus=""> on pcib20
    Nov 10 11:19:09	kernel: pcib21: <acpi pci-pci="" bridge=""> at device 23.2 on pci0
    Nov 10 11:19:09	kernel: pci21: <acpi pci="" bus=""> on pcib21
    Nov 10 11:19:09	kernel: pcib22: <acpi pci-pci="" bridge=""> at device 23.3 on pci0
    Nov 10 11:19:09	kernel: pci22: <acpi pci="" bus=""> on pcib22
    Nov 10 11:19:09	kernel: pcib23: <acpi pci-pci="" bridge=""> at device 23.4 on pci0
    Nov 10 11:19:09	kernel: pci23: <acpi pci="" bus=""> on pcib23
    Nov 10 11:19:09	kernel: pcib24: <acpi pci-pci="" bridge=""> at device 23.5 on pci0
    Nov 10 11:19:09	kernel: pci24: <acpi pci="" bus=""> on pcib24
    Nov 10 11:19:09	kernel: pcib25: <acpi pci-pci="" bridge=""> at device 23.6 on pci0
    Nov 10 11:19:09	kernel: pci25: <acpi pci="" bus=""> on pcib25
    Nov 10 11:19:09	kernel: pcib26: <acpi pci-pci="" bridge=""> at device 23.7 on pci0
    Nov 10 11:19:09	kernel: pci26: <acpi pci="" bus=""> on pcib26
    Nov 10 11:19:09	kernel: pcib27: <acpi pci-pci="" bridge=""> at device 24.0 on pci0
    Nov 10 11:19:09	kernel: pci27: <acpi pci="" bus=""> on pcib27
    Nov 10 11:19:09	kernel: pcib28: <acpi pci-pci="" bridge=""> at device 24.1 on pci0
    Nov 10 11:19:09	kernel: pci28: <acpi pci="" bus=""> on pcib28
    Nov 10 11:19:09	kernel: pcib29: <acpi pci-pci="" bridge=""> at device 24.2 on pci0
    Nov 10 11:19:09	kernel: pci29: <acpi pci="" bus=""> on pcib29
    Nov 10 11:19:09	kernel: pcib30: <acpi pci-pci="" bridge=""> at device 24.3 on pci0
    Nov 10 11:19:09	kernel: pci30: <acpi pci="" bus=""> on pcib30
    Nov 10 11:19:09	kernel: pcib31: <acpi pci-pci="" bridge=""> at device 24.4 on pci0
    Nov 10 11:19:09	kernel: pci31: <acpi pci="" bus=""> on pcib31
    Nov 10 11:19:09	kernel: pcib32: <acpi pci-pci="" bridge=""> at device 24.5 on pci0
    Nov 10 11:19:09	kernel: pci32: <acpi pci="" bus=""> on pcib32
    Nov 10 11:19:09	kernel: pcib33: <acpi pci-pci="" bridge=""> at device 24.6 on pci0
    Nov 10 11:19:09	kernel: pci33: <acpi pci="" bus=""> on pcib33
    Nov 10 11:19:09	kernel: pcib34: <acpi pci-pci="" bridge=""> at device 24.7 on pci0
    Nov 10 11:19:09	kernel: pci34: <acpi pci="" bus=""> on pcib34
    Nov 10 11:19:09	kernel: acpi_acad0: <ac adapter=""> on acpi0
    Nov 10 11:19:09	kernel: atrtc0: <at realtime="" clock=""> port 0x70-0x71 irq 8 on acpi0
    Nov 10 11:19:09	kernel: atkbdc0: <keyboard controller="" (i8042)=""> port 0x60,0x64 irq 1 on acpi0
    Nov 10 11:19:09	kernel: atkbd0: <at keyboard=""> irq 1 on atkbdc0
    Nov 10 11:19:09	kernel: kbd0 at atkbd0
    Nov 10 11:19:09	kernel: atkbd0: [GIANT-LOCKED]
    Nov 10 11:19:09	kernel: atkbd0: [ITHREAD]
    Nov 10 11:19:09	kernel: psm0: <ps 2="" mouse=""> irq 12 on atkbdc0
    Nov 10 11:19:09	kernel: psm0: [GIANT-LOCKED]
    Nov 10 11:19:09	kernel: psm0: [ITHREAD]
    Nov 10 11:19:09	kernel: psm0: model IntelliMouse, device ID 3
    Nov 10 11:19:09	kernel: ppc0: <parallel port=""> port 0x378-0x37f irq 7 on acpi0
    Nov 10 11:19:09	kernel: ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
    Nov 10 11:19:09	kernel: ppc0: [ITHREAD]
    Nov 10 11:19:09	kernel: ppbus0: <parallel port="" bus=""> on ppc0
    Nov 10 11:19:09	kernel: plip0: <plip network="" interface=""> on ppbus0
    Nov 10 11:19:09	kernel: plip0: [ITHREAD]
    Nov 10 11:19:09	kernel: lpt0: <printer> on ppbus0
    Nov 10 11:19:09	kernel: lpt0: [ITHREAD]
    Nov 10 11:19:09	kernel: lpt0: Interrupt-driven port
    Nov 10 11:19:09	kernel: ppi0: <parallel i="" o=""> on ppbus0
    Nov 10 11:19:09	kernel: uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
    Nov 10 11:19:09	kernel: uart0: [FILTER]
    Nov 10 11:19:09	kernel: uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
    Nov 10 11:19:09	kernel: uart1: [FILTER]
    Nov 10 11:19:09	kernel: fdc0: <floppy drive="" controller=""> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
    Nov 10 11:19:09	kernel: fdc0: [FILTER]
    Nov 10 11:19:09	kernel: fd0: <1440-KB 3.5" drive> on fdc0 drive 0
    Nov 10 11:19:09	kernel: orm0: <isa option="" roms=""> at iomem 0xc0000-0xc7fff,0xca000-0xcafff,0xcb000-0xcbfff,0xdc000-0xdffff,0xe0000-0xe3fff on isa0
    Nov 10 11:19:09	kernel: sc0: <system console=""> at flags 0x100 on isa0
    Nov 10 11:19:09	kernel: sc0: VGA <16 virtual consoles, flags=0x300>
    Nov 10 11:19:09	kernel: vga0: <generic isa="" vga=""> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
    Nov 10 11:19:09	kernel: acpi_throttle0: <acpi cpu="" throttling=""> on cpu0
    Nov 10 11:19:09	kernel: acpi_throttle1: <acpi cpu="" throttling=""> on cpu1
    Nov 10 11:19:09	kernel: acpi_throttle1: failed to attach P_CNT
    Nov 10 11:19:09	kernel: device_attach: acpi_throttle1 attach returned 6
    Nov 10 11:19:09	kernel: acpi_throttle2: <acpi cpu="" throttling=""> on cpu2
    Nov 10 11:19:09	kernel: acpi_throttle2: failed to attach P_CNT
    Nov 10 11:19:09	kernel: device_attach: acpi_throttle2 attach returned 6
    Nov 10 11:19:09	kernel: acpi_throttle3: <acpi cpu="" throttling=""> on cpu3
    Nov 10 11:19:09	kernel: acpi_throttle3: failed to attach P_CNT
    Nov 10 11:19:09	kernel: device_attach: acpi_throttle3 attach returned 6
    Nov 10 11:19:09	kernel: Timecounters tick every 10.000 msec
    Nov 10 11:19:09	kernel: IPsec: Initialized Security Association Processing.
    Nov 10 11:19:09	kernel: acd0: DVDR <vmware virtual="" ide="" cdrom="" drive="" 00000001=""> at ata1-master UDMA33
    Nov 10 11:19:09	kernel: da0 at mpt0 bus 0 scbus0 target 0 lun 0
    Nov 10 11:19:09	kernel: da0: <vmware virtual="" disk="" 1.0=""> Fixed Direct Access SCSI-2 device
    Nov 10 11:19:09	kernel: da0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit)
    Nov 10 11:19:09	kernel: da0: Command Queueing enabled
    Nov 10 11:19:09	kernel: da0: 8192MB (16777216 512 byte sectors: 255H 63S/T 1044C)
    Nov 10 11:19:09	kernel: SMP: AP CPU #2 Launched!
    Nov 10 11:19:09	kernel: SMP: AP CPU #3 Launched!
    Nov 10 11:19:09	kernel: SMP: AP CPU #1 Launched!
    Nov 10 11:19:09	kernel: Trying to mount root from ufs:/dev/da0s1a
    Nov 10 11:19:09	kernel: WARNING: / was not properly dismounted
    Nov 10 11:19:09	kernel: ZFS WARNING: Recommended minimum kmem_size is 512MB; expect unstable behavior.
    Nov 10 11:19:09	kernel: Consider tuning vm.kmem_size and vm.kmem_size_max
    Nov 10 11:19:09	kernel: in /boot/loader.conf.
    Nov 10 11:19:09	kernel: ZFS filesystem version 5
    Nov 10 11:19:09	kernel: ZFS storage pool version 28
    Nov 10 11:19:09	php: rc.bootup: Resyncing OpenVPN instances.
    Nov 10 11:19:09	kernel: pflog0: promiscuous mode enabled
    Nov 10 11:19:09	sshd[14433]: Server listening on :: port 35222.
    Nov 10 11:19:09	sshd[14433]: Server listening on 0.0.0.0 port 35222.
    Nov 10 11:19:10	sshlockout[14501]: sshlockout/webConfigurator v3.0 starting up
    Nov 10 11:19:14	php: rc.bootup: ROUTING: setting default route to 177.154.137.1
    Nov 10 11:19:14	check_reload_status: Updating all dyndns
    Nov 10 15:07:12	check_reload_status: updating dyndns GW_WAN
    Nov 10 15:07:12	check_reload_status: Restarting ipsec tunnels
    Nov 10 15:07:12	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 10 15:07:12	check_reload_status: Reloading filter
    Nov 10 15:07:12	check_reload_status: updating dyndns SPODCFW
    Nov 10 15:07:12	check_reload_status: Restarting ipsec tunnels
    Nov 10 15:07:12	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 10 15:07:12	check_reload_status: Reloading filter
    Nov 10 15:07:12	check_reload_status: updating dyndns GW_WAN
    Nov 10 15:07:12	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 10 15:07:12	check_reload_status: updating dyndns SPODCFW
    Nov 10 15:07:12	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 10 15:07:28	check_reload_status: Restarting ipsec tunnels
    Nov 10 15:07:28	check_reload_status: Restarting ipsec tunnels
    Nov 10 15:07:30	snmpd[40726]: disk_OS_get_disks: device 'da0' not in device list
    Nov 10 15:07:31	php: rc.bootup: Creating rrd update script
    Nov 10 15:07:31	syslogd: exiting on signal 15
    Nov 10 15:07:31	syslogd: kernel boot file is /boot/kernel/kernel
    Nov 10 15:07:55	check_reload_status: Reloading filter
    Nov 10 15:07:56	php: rc.start_packages: Restarting/Starting all packages.
    Nov 10 15:08:10	kernel: VMware memory control driver initialized
    Nov 10 15:08:11	login: login on ttyv0 as root
    Nov 10 15:08:11	sshlockout[88843]: sshlockout/webConfigurator v3.0 starting up
    Nov 11 03:07:38	check_reload_status: updating dyndns GW_WAN
    Nov 11 03:07:38	check_reload_status: Restarting ipsec tunnels
    Nov 11 03:07:38	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 11 03:07:38	check_reload_status: Reloading filter
    Nov 11 03:07:38	check_reload_status: updating dyndns SPODCFW
    Nov 11 03:07:38	check_reload_status: Restarting ipsec tunnels
    Nov 11 03:07:38	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 11 03:07:38	check_reload_status: Reloading filter
    Nov 11 03:07:38	check_reload_status: updating dyndns GW_WAN
    Nov 11 03:07:38	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 11 03:07:38	check_reload_status: updating dyndns SPODCFW
    Nov 11 03:07:38	check_reload_status: Restarting OpenVPN tunnels/interfaces
    Nov 11 03:08:07	php: rc.newipsecdns: IPSEC: One or more IPsec tunnel endpoints has changed its IP. Refreshing.
    Nov 11 03:08:07	php: rc.newipsecdns: IPSEC: One or more IPsec tunnel endpoints has changed its IP. Refreshing.
    Nov 11 03:08:07	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 11 03:08:07	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 11 03:08:33	lighttpd[20271]: (connections.c.137) (warning) close: 14 Connection reset by peer
    Nov 11 03:08:55	lighttpd[20271]: (connections.c.137) (warning) close: 16 Connection reset by peer
    Nov 11 03:09:43	lighttpd[20271]: (connections.c.137) (warning) close: 18 Connection reset by peer
    Nov 11 03:10:52	lighttpd[20271]: (connections.c.137) (warning) close: 17 Connection reset by peer
    Nov 11 03:11:04	lighttpd[20271]: (connections.c.137) (warning) close: 15 Connection reset by peer
    Nov 11 03:12:31	php: /vpn_ipsec.php: Removing SPDs from tunnel gw 'vantixrjo8.dyndns.org'. Local Subnet '10.130.0.0/16' and Remote Subnet '10.133.15.0/24'. Reloading policy
    Nov 11 03:12:37	php: /vpn_ipsec.php: The command '/usr/local/sbin/setkey -f /tmp/spd.conf.reload.1447218751.KrYbBC 2>&1' returned exit code '1', the output was 'libipsec: invalid IP address while parsing "vantixrjo8.dyndns.org" line 1: hostname nor servname provided, or not known at [ out ipsec esp/tunnel/177.154.137.25-vantixrjo8.dyndns.org/unique] parse failed, line 1.'
    Nov 11 03:13:02	check_reload_status: Syncing firewall
    Nov 11 03:13:02	check_reload_status: Reloading filter
    Nov 11 03:13:41	check_reload_status: Syncing firewall
    Nov 11 03:14:16	php: /system_routes.php: ROUTING: setting default route to 177.154.137.1
    Nov 11 03:14:16	check_reload_status: Reloading filter
    Nov 11 03:18:21	check_reload_status: Syncing firewall
    Nov 11 03:19:03	check_reload_status: Syncing firewall
    Nov 11 03:19:45	php: /vpn_ipsec_phase2.php: Reloading IPsec tunnel 'rjo8'. Previous IP '177.11.4.34', current IP '177.11.4.34'. Reloading policy
    Nov 11 03:19:46	check_reload_status: Syncing firewall
    Nov 11 03:20:21	check_reload_status: Reloading filter
    Nov 11 03:20:21	check_reload_status: Restarting ipsec tunnels
    Nov 11 03:20:39	php: rc.newipsecdns: IPSEC: One or more IPsec tunnel endpoints has changed its IP. Refreshing.
    Nov 10 15:57:49	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 10 15:57:49	php: /index.php: Successful login for user 'admin' from: 187.11.239.192
    Nov 10 15:58:14	lighttpd[20271]: (connections.c.137) (warning) close: 18 Connection reset by peer
    Nov 10 16:03:05	php: /index.php: Successful login for user 'admin' from: 191.181.30.76
    Nov 10 16:03:05	php: /index.php: Successful login for user 'admin' from: 191.181.30.76
    Nov 10 16:03:25	lighttpd[20271]: (connections.c.137) (warning) close: 15 Connection reset by peer
    Nov 10 16:03:32	lighttpd[20271]: (connections.c.137) (warning) close: 18 Connection reset by peer
    Nov 10 16:04:21	lighttpd[20271]: (connections.c.137) (warning) close: 16 Connection reset by peer
    Nov 10 16:06:44	lighttpd[20271]: (connections.c.137) (warning) close: 18 Connection reset by peer
    Nov 10 16:06:51	lighttpd[20271]: (connections.c.137) (warning) close: 17 Connection reset by peer
    Nov 10 16:07:10	check_reload_status: Syncing firewall
    Nov 10 16:07:11	syslogd: exiting on signal 15
    Nov 10 16:07:11	syslogd: kernel boot file is /boot/kernel/kernel
    Nov 10 16:07:11	kernel: pflog0: promiscuous mode disabled
    Nov 10 16:07:11	kernel: pflog0: promiscuous mode enabled
    Nov 10 16:18:13	lighttpd[20271]: (connections.c.137) (warning) close: 19 Connection reset by peer
    Nov 10 16:20:39	kernel: pflog0: promiscuous mode disabled
    Nov 10 16:20:39	kernel: pflog0: promiscuous mode enabled</vmware></vmware></acpi></acpi></acpi></acpi></generic></system></isa></floppy></parallel></printer></plip></parallel></parallel></ps></at></keyboard></at></ac></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></intel(r)></intel(r)></acpi></acpi></lsilogic></vga-compatible></bridge></ata></ata></intel></isa></pci-isa></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></high></intel></software></version></ptltd></lahf></syscall,nx,lm></sse3,ssse3,cx16,hv></fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,dts,acpi,mmx,fxsr,sse,sse2,ss,htt>
    

    Any guesses? Any other log I should take a look?

    Thanks a lot in advance,

    Rafael



  • https://forum.pfsense.org/index.php?topic=54206.0

    have you tried this fix / patch ?
    it solved my random crashes.
    also, remove the virtual-cd-drive from the VM



  • Am in a similar state. I have a pfsense box C2578 model. I reset it to factory default settings and as it was trying to reboot it got stuck at

    "trying to mount root from ufs:/dev/ufsid/5548bb3f61b43ef3 [rw]…. "

    The only thing I can do is reboot the device which ends up here.

    One more thing, there is a beep sound at boot process

    Any assistance will be highly appreciated.

    Thanks in Advance  :) :)



  • @mike254:

    Am in a similar state. I have a pfsense box C2578 model. I reset it to factory default settings and as it was trying to reboot it got stuck at

    "trying to mount root from ufs:/dev/ufsid/5548bb3f61b43ef3 [rw]…. "

    That's where it switches over to serial console up until the boot process is complete. It's probably stopping at an interface assignment prompt which is only visible on the serial console. Connect a null modem cable to the serial port and console into it and you should be able to assign the NICs and continue. Get in touch with us via support if you need further help with that.



  • That's where it switches over to serial console up until the boot process is complete. It's probably stopping at an interface assignment prompt which is only visible on the serial console. Connect a null modem cable to the serial port and console into it and you should be able to assign the NICs and continue. Get in touch with us via support if you need further help with that.

    Thanks cmb

    Does this mean the hardware is not faulty?



  • @mike254:

    That's where it switches over to serial console up until the boot process is complete. It's probably stopping at an interface assignment prompt which is only visible on the serial console. Connect a null modem cable to the serial port and console into it and you should be able to assign the NICs and continue. Get in touch with us via support if you need further help with that.

    Thanks cmb

    Does this mean the hardware is not faulty?

    Are there any commands i need to enter on my terminal to access the Serial console?


Log in to reply