Power outage then pfsense not working
-
Hewdy,
I've been testing out pfsense 2.0. In this case embedded/nano. I am not sure of the exact build but could figure it out if needed although not sure this problem is specific to a certain build. I do know it was from the last few weeks for sure as I've only been testing pfsense for that long.The power went out here for about 5 seconds & I had not yet plugged my pfsense box into a UPS battery backup so it powered off. It was set to power back on automatically so when power came back on I assume it did so. A few minutes later the power went out again for like 5 seconds so I assume the pfsense box went down again. After the power came back on I waited & waited & waited for my desktop to have internet access but after 10 minutes or more I tried pinging the pfsense box but no response. Grabbed my lappy & headed to the basement. Plugged in the serial cable, opened up hyperterminal & hit enter. I got a # prompt not the normal menu. Pressed the power button briefly & it said pfsense was shutting down & it did. Powered it back on & let it boot, watching the serial console output. It booted to the menu but one of my PPPoE WAN's showed no connection. I checked & I could not ping the pfsense box. I chose assign interfaces & it showed only 3 of my 4 NIC's! For some reason one of the 3 NIC's on the daughterboard was MIA.. So I chose the reboot menu option & watched it boot again. To my dismay it said interfaces had changed or something along those lines as if it forgot which NIC's I had even though I had changed nothing. GRRR. I powered it off & back on & chose the backup slice & let it boot. I got an error about using a newer config but it did assign all 4 NIC's properly & everything was up & running again. Could ping the box, all 3 WAN's came up, could access internet again. PHEW! But WTH is going on?!? Can I trust pfsense??
My hardware is a Jetway JNC92-330-LF (Atom 330) with 1 onboard RTL8111C NIC + Jetway AD3INLANG 3 port daugherboard with "Intel 82541PI Gigabit Ethernet Controller". I am using a 4GB Kingston CF card in IDE->CF adapter with DMA/UDMA disabled and I believe pfSense-2.0-RC1-2g-i386-20110226-1633-nanobsd.img.gz although I am not 100% certain I believe I had done at least 1 upgrade from the web admin.
If helpful this is how I have the interfaces assigned:
WAN em1 (static IP)
LAN em0 (10. range)
OPT1 em2 (PPPoE static)
OPT2 re0 (PPPoE dynamic)Any input on this would be appreciated. I'd really like to use pfsense but stuff like this is scary to say the least. Luckily I was able to boot to the backup slice or I would have been SOL. Luckily I was here when it happened & not off somewhere else or I wold have been SOL with no access from the outside. I got the pfsense box plugged into a UPS now and would like to backup the working slice to the other area but didn't want overwrite logs/config files that might be useful to track down wth happened.
Thanks,
Bill -
Nadda? Was hoping for some input.. Should I consider it a 1 in 1,000,000 fluke that might never happen again? Do I need to take closer look at my hardware? Is something like this normal when using pfsense? This specific to nano build in how things are not written right away? Could it be a bug in pfsense?
I can't imagine this is super common/likely or I wouldn't be alone here on this but then again I find it hard to believe pfsense is that unreliable/unstable that it'd no longer boot after a power outage either.. Power is not 100% anywhere. :D
Anyway, if the developers want/need any info off the bad/crashed slice please let me know soon or i'll be backing up the working one over top of it in case it happens again I don't want to be SOL. (I've been making backups of the config so I suppose I could always install 2.0RC fresh & restore but I'd end up being down longer than I'd really like)
Thx
Bill -
I just had the same.
This is the log from bootup:BIOS drive C: is disk0 BIOS 640kB/261120kB available memory FreeBSD/i386 bootstrap loader, Revision 1.1 (sullrich@FreeBSD_8.0_pfSense_2.0-snaps.pfsense.org, Fri Apr 15 15:02:47 EDT 201 1) Loading /boot/defaults/loader.conf /boot/kernel/kernel text=0x89a110 data=0x3c9c54+0x9b6a0 syms=[0x4+0x93b80+0x4+0x ca86f] / Hit [Enter] to boot immediately, or any other key for command prompt. Booting [/boot/kernel/kernel]... Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.1-RELEASE-p2 #0: Fri Apr 15 15:18:24 EDT 2011 sullrich@FreeBSD_8.0_pfSense_2.0-snaps.pfsense.org:/usr/obj.pfSense/usr/pfSe nsesrc/src/sys/pfSense_wrap.8.i386 i386 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Geode(TM) Integrated Processor by AMD PCS (498.05-MHz 586-class CPU) Origin = "AuthenticAMD" Id = 0x5a2 Family = 5 Model = a Stepping = 2 Features=0x88a93d <fpu,de,pse,tsc,msr,cx8,sep,pge,cmov,clflush,mmx>AMD Features=0xc0400000 <mmx+,3dnow!+,3dnow!>real memory = 268435456 (256 MB) avail memory = 243433472 (232 MB) pnpbios: Bad PnP BIOS data checksum wlan: mac acl policy registered ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/. ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /bo ot/loader.conf. module_register_init: MOD_LOAD (ipw_bss_fw, 0xc0708960, 0) error 1 ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/. ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /b oot/loader.conf. module_register_init: MOD_LOAD (ipw_ibss_fw, 0xc0708a00, 0) error 1 wpi: You need to read the LICENSE file in /usr/share/doc/legal/intel_wpi/. wpi: If you agree with the license, set legal.intel_wpi.license_ack=1 in /boot/l oader.conf. module_register_init: MOD_LOAD (wpi_fw, 0xc087b6b0, 0) error 1 ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw /. ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. module_register_init: MOD_LOAD (ipw_monitor_fw, 0xc0708aa0, 0) error 1 K6-family MTRR support enabled (2 registers) ACPI Error: A valid RSDP was not found (20100331/tbxfroot-309) ACPI: Table initialisation failed: AE_NOT_FOUND ACPI: Try disabling either ACPI or apic support. cryptosoft0: <software crypto=""> on motherboard padlock0: No ACE support. pcib0: <host to="" pci="" bridge=""> pcibus 0 on motherboard pci0: <pci bus=""> on pcib0 Geode LX: PC Engines ALIX.2 v0.99h tinyBIOS V1.4a (C)1997-2007 pci0: <encrypt decrypt,="" entertainment="" crypto=""> at device 1.2 (no driver attached) vr0: <via 10="" vt6105m="" rhine="" iii="" 100basetx=""> port 0x1000-0x10ff mem 0xe0000000-0xe0 0000ff irq 10 at device 9.0 on pci0 vr0: Quirks: 0x2 vr0: Revision: 0x96 miibus0: <mii bus=""> on vr0 ukphy0: <generic ieee="" 802.3u="" media="" interface=""> PHY 1 on miibus0 ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto vr0: [ITHREAD] vr1: <via 10="" vt6105m="" rhine="" iii="" 100basetx=""> port 0x1400-0x14ff mem 0xe0040000-0xe0 0400ff irq 11 at device 10.0 on pci0 vr1: Quirks: 0x2 vr1: Revision: 0x96 miibus1: <mii bus=""> on vr1 ukphy1: <generic ieee="" 802.3u="" media="" interface=""> PHY 1 on miibus1 ukphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto vr1: [ITHREAD] ath0: <atheros 2413=""> mem 0xe0080000-0xe008ffff irq 9 at device 12.0 on pci0 ath0: [ITHREAD] ath0: AR2413 mac 7.8 RF2413 phy 4.5 isab0: <pci-isa bridge=""> port 0x6000-0x6007,0x6100-0x61ff,0x6200-0x623f,0x9d00-0x 9d7f,0x9c00-0x9c3f at device 15.0 on pci0 isa0: <isa bus=""> on isab0 atapci0: <amd cs5536="" udma100="" controller=""> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x37 6,0xff00-0xff0f at device 15.2 on pci0 ata0: <ata 0="" channel=""> on atapci0 ata0: [ITHREAD] ata1: <ata 1="" channel=""> on atapci0 ata1: [ITHREAD] ohci0: <ohci (generic)="" usb="" controller=""> mem 0xefffe000-0xefffefff irq 12 at devic e 15.4 on pci0 ohci0: [ITHREAD] usbus0: <ohci (generic)="" usb="" controller=""> on ohci0 ehci0: <amd cs5536="" (geode)="" usb="" 2.0="" controller=""> mem 0xefffd000-0xefffdfff irq 12 at device 15.5 on pci0 ehci0: [ITHREAD] usbus1: EHCI version 1.0 usbus1: <amd cs5536="" (geode)="" usb="" 2.0="" controller=""> on ehci0 cpu0 on motherboard orm0: <isa option="" rom=""> at iomem 0xe0000-0xea7ff pnpid ORM0000 on isa0 atrtc0: <at real="" time="" clock=""> at port 0x70 irq 8 on isa0 ppc0: parallel port not found. uart0: <16550 or compatible> at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 uart0: [FILTER] uart0: console (9600,n,8,1) uart1: <16550 or compatible> at port 0x2f8-0x2ff irq 3 on isa0 uart1: [FILTER] RTC BIOS diagnostic error 80 <clock_battery>Timecounter "TSC" frequency 498052753 Hz quality 800 Timecounters tick every 10.000 msec IPsec: Initialized Security Association Processing. usbus0: 12Mbps Full Speed USB v1.0 usbus1: 480Mbps High Speed USB v2.0 ugen0.1: <amd> at usbus0 uhub0: <amd 1="" 9="" ohci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr=""> on usbus0 ugen1.1: <amd> at usbus1 uhub1: <amd 1="" 9="" ehci="" root="" hub,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr=""> on usbus1 ad0: 967MB <cf 20090819="" 1gb=""> at ata0-master PIO4 Root mount waiting for: usbus1 usbus0 uhub0: 4 ports with 4 removable, self powered Root mount waiting for: usbus1 uhub1: 4 ports with 4 removable, self powered Trying to mount root from ufs:/dev/ufs/pfsense1 WARNING: / was not properly dismounted Configuring crash dumps... Mounting filesystems... Setting up embedded specific environment... done. WARNING: R/W mount of / denied. Filesystem is not clean - run fsck mount: /dev/ufs/pfsense1 : Operation not permitted ** /dev/ufs/pfsense1 ** Last Mounted on / ** Root file system ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 6054 files, 308406 used, 598249 free (561 frags, 74711 blocks, 0.1% fragmentatio n) ***** FILE SYSTEM MARKED CLEAN ***** ** /dev/ufs/cf ** Last Mounted on /cf ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 20 files, 2988 used, 98067 free (43 frags, 12253 blocks, 0.0% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** ___ ___/ f \ / p \___/ Sense \___/ \ \___/ Welcome to pfSense 2.0-RC1 ... Creating symlinks......done. PHP Warning: PHP Startup: Unable to load dynamic library '/usr/local/lib/php/20 060613/pcre.so' - /usr/local/lib/php/20060613/pcre.so: Undefined symbol "pcre_fr ee" in Unknown on line 0 External config loader 1.0 is now starting... ad0s3 appending output to nohup.out Launching the init system... done. Initializing............................ Fatal error: Call to undefined function preg_match_all() in /etc/inc/util.inc on line 1203 Starting CRON... done. Syncing packages: Avahi Fatal error: Call to undefined function preg_match() in /etc/inc/interfaces.inc on line 3517 Executing rc.d items... Starting /usr/local/etc/rc.d/avahi-daemon.sh...done. Bootup complete grep: /var/log/dmesg.boot: No such file or directory [: -gt: unexpected operator FreeBSD/i386 (Amnesiac) (console) *** Welcome to pfSense 2.0-RC1-nanobsd (i386) on pfsense *** Fatal error: Call to undefined function preg_match() in /etc/inc/interfaces.inc on line 3517 0) Logout (SSH only) 8) Shell 1) Assign Interfaces 9) pfTop 2) Set interface(s) IP address 10) Filter Logs 3) Reset webConfigurator password 11) Restart webConfigurator 4) Reset to factory defaults 12) pfSense Developer Shell 5) Reboot system 13) Upgrade from console 6) Halt system 14) Enable Secure Shell (sshd) 7) Ping host Enter an option: [/code] I switched slice back to working state.</cf></amd></amd></amd></amd></clock_battery></at></isa></amd></amd></ohci></ohci></ata></ata></amd></isa></pci-isa></atheros></generic></mii></via></generic></mii></via></encrypt></pci></host></software></mmx+,3dnow!+,3dnow!></fpu,de,pse,tsc,msr,cx8,sep,pge,cmov,clflush,mmx> -
Hey GruensFroeschli,
Wow stinks you had it happen but good as means I might not be crazy. lol I scanned thru your log to compare to my memory of when it happened to me & do recall various errors but not sure exactly. I might have to see if I can get to the log files on the disabled slice to compare..
Thx,
Bill
