SG-8860-1U File System Corruption
-
So if I apply a configuration to this SG-8860-1U, after reboot everything is just fine. However, after it gets powered down and then powered back up, here is the output:
SeaBIOS (version SageBIOS-20160122_083040-localhost.localdomain)
iPXE (http://ipxe.org) 00:14.0 C100 PCI2.10 PnP PMM+7FB7AF80+7FADAF80 C100
iPXE (http://ipxe.org) 00:14.1 C200 PCI2.10 PnP PMM 7FB7AF80 7FADAF80 C200
iPXE (http://ipxe.org) 00:14.2 C300 PCI2.10 PnP PMM 7FB7AF80 7FADAF80 C300
iPXE (http://ipxe.org) 00:14.3 C400 PCI2.10 PnP PMM 7FB7AF80 7FADAF80 C400
Press F12 for boot menu.
F1 pfSense
F6 PXE
Boot: F1__ ____
_ __ / / | ___ _ __ ___ ___
| ' | |_ \ / _ \ '_ / |/ _
| |) | |) | / | | _ \ /
| ./|| |___/ _|| ||/_|
||+============Welcome to pfSense===========+
| | ______
| 1. Boot Multi User [Enter] | /
| 2. Boot ~~ingle User | / f
| 3. [Esc]ape to loader prompt | / \ /
| 4. Reboot | / p _/ Sense
| | \ /
| Options: | _____/
| 5. [K]ernel: kernel (1 of 2) | \ /
| 6. Configure Boot [O]ptions… | ______/
| |
| |
| |
+=========================================+/boot/kernel/kernel text=0x1292d98 data=0x8a1bb0+0x23ec10 syms=[0x8+0x177720+0x8+0x173eef]
Booting…
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1992-2016 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.3-RELEASE-p5 #0 7307492(RELENG_2_3_2): Tue Jul 19 13:29:18 CDT 2016
root@factory23-amd64-builder:/builder/factory-232/tmp/obj/builder/factory-232/tmp/FreeBSD-src/sys/pfSense amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: Intel(R) Atom(TM) CPU C2758 @ 2.40GHz (2400.06-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x406d8 Family=0x6 Model=0x4d Stepping=8
Features=0xbfebfbff <fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>Features2=0x43d8e3bf <sse3,pclmulqdq,dtes64,mon,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,sse4.1,sse4.2,movbe,popcnt,tscdlt,aesni,rdrand>AMD Features=0x28100800 <syscall,nx,rdtscp,lm>AMD Features2=0x101 <lahf,prefetch>Structured Extended Features=0x2282 <tscadj,smep,erms,nfpusg>VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
TSC: P-state invariant, performance statistics
real memory = 10737418240 (10240 MB)
avail memory = 8220663808 (7839 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <core coreboot="">FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 2
cpu2 (AP): APIC ID: 4
cpu3 (AP): APIC ID: 6
cpu4 (AP): APIC ID: 8
cpu5 (AP): APIC ID: 10
cpu6 (AP): APIC ID: 12
cpu7 (AP): APIC ID: 14
random: <software, yarrow="">initialized
ioapic0 <version 2.0="">irqs 0-23 on motherboard
wlan: mac acl policy registered
ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff806208f0, 0) error 1
ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff806209a0, 0) error 1
ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80620a50, 0) error 1
iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi/.
iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80647bf0, 0) error 1
iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi/.
iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80647ca0, 0) error 1
iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi/.
iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff80647d50, 0) error 1
netmap: loaded module
kbd0 at kbdmux0
module_register_init: MOD_LOAD (vesa, 0xffffffff81016b90, 0) error 19
cryptosoft0: <software crypto="">on motherboard
padlock0: No ACE support.
acpi0: <core coreboot="">on motherboard
acpi0: Power Button (fixed)
hpet0: invalid period
device_attach: hpet0 attach returned 6
cpu0: <acpi cpu="">on acpi0
cpu1: <acpi cpu="">on acpi0
cpu2: <acpi cpu="">on acpi0
cpu3: <acpi cpu="">on acpi0
cpu4: <acpi cpu="">on acpi0
cpu5: <acpi cpu="">on acpi0
cpu6: <acpi cpu="">on acpi0
cpu7: <acpi cpu="">on acpi0
hpet0: invalid period
device_attach: hpet0 attach returned 6
atrtc0: <at realtime="" clock="">port 0x70-0x77 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <at timer="">port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <acpi host-pci="" bridge="">port 0xcf8-0xcff on acpi0
pci0: <acpi pci="" bus="">on pcib0
pcib1: <acpi pci-pci="" bridge="">mem 0xdfe00000-0xdfe1ffff irq 16 at device 1.0 on pci0
pci1: <acpi pci="" bus="">on pcib1
pcib2: <acpi pci-pci="" bridge="">mem 0xdfe20000-0xdfe3ffff irq 19 at device 2.0 on pci0
pci2: <acpi pci="" bus="">on pcib2
pcib3: <acpi pci-pci="" bridge="">mem 0xdfe40000-0xdfe5ffff irq 20 at device 3.0 on pci0
pci3: <acpi pci="" bus="">on pcib3
igb0: <intel(r) 1000="" pro="" network="" connection,="" version="" -="" 2.5.3-k="">port 0x1000-0x101f mem 0xdfc00000-0xdfc1ffff,0xdfc20000-0xdfc23fff irq 18 at device 0.0 on pci3
igb0: Using MSIX interrupts with 3 vectors
igb0: Ethernet address: 00:08:a2:0a:bd:c8
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: netmap queues/slots: TX 2/1024, RX 2/1024
pcib4: <acpi pci-pci="" bridge="">mem 0xdfe60000-0xdfe7ffff irq 23 at device 4.0 on pci0
pci4: <acpi pci="" bus="">on pcib4
igb1: <intel(r) 1000="" pro="" network="" connection,="" version="" -="" 2.5.3-k="">port 0x2000-0x201f mem 0xdfd00000-0xdfd1ffff,0xdfd20000-0xdfd23fff irq 19 at device 0.0 on pci4
igb1: Using MSIX interrupts with 3 vectors
igb1: Ethernet address: 00:08:a2:0a:bd:c9
igb1: Bound queue 0 to cpu 2
igb1: Bound queue 1 to cpu 3
igb1: netmap queues/slots: TX 2/1024, RX 2/1024
pci0: <processor>at device 11.0 (no driver attached)
pci0: <base peripheral,="" iommu=""> at device 15.0 (no driver attached)
igb2: <intel(r) 1000="" pro="" network="" connection,="" version="" -="" 2.5.3-k="">port 0x3000-0x301f mem 0xdfea0000-0xdfebffff,0xdff24000-0xdff27fff irq 18 at device 20.0 on pci0
igb2: Using MSIX interrupts with 9 vectors
igb2: Ethernet address: 00:08:a2:0a:bd:c4
igb2: Bound queue 0 to cpu 4
igb2: Bound queue 1 to cpu 5
igb2: Bound queue 2 to cpu 6
igb2: Bound queue 3 to cpu 7
igb2: Bound queue 4 to cpu 0
igb2: Bound queue 5 to cpu 1
igb2: Bound queue 6 to cpu 2
igb2: Bound queue 7 to cpu 3
igb2: netmap queues/slots: TX 8/1024, RX 8/1024
igb3: <intel(r) 1000="" pro="" network="" connection,="" version="" -="" 2.5.3-k="">port 0x3020-0x303f mem 0xdfec0000-0xdfedffff,0xdff28000-0xdff2bfff irq 19 at device 20.1 on pci0
igb3: Using MSIX interrupts with 9 vectors
igb3: Ethernet address: 00:08:a2:0a:bd:c5
igb3: Bound queue 0 to cpu 4
igb3: Bound queue 1 to cpu 5
igb3: Bound queue 2 to cpu 6
igb3: Bound queue 3 to cpu 7
igb3: Bound queue 4 to cpu 0
igb3: Bound queue 5 to cpu 1
igb3: Bound queue 6 to cpu 2
igb3: Bound queue 7 to cpu 3
igb3: netmap queues/slots: TX 8/1024, RX 8/1024
igb4: <intel(r) 1000="" pro="" network="" connection,="" version="" -="" 2.5.3-k="">port 0x3040-0x305f mem 0xdfee0000-0xdfefffff,0xdff2c000-0xdff2ffff irq 20 at device 20.2 on pci0
igb4: Using MSIX interrupts with 9 vectors
igb4: Ethernet address: 00:08:a2:0a:bd:c6
igb4: Bound queue 0 to cpu 4
igb4: Bound queue 1 to cpu 5
igb4: Bound queue 2 to cpu 6
igb4: Bound queue 3 to cpu 7
igb4: Bound queue 4 to cpu 0
igb4: Bound queue 5 to cpu 1
igb4: Bound queue 6 to cpu 2
igb4: Bound queue 7 to cpu 3
igb4: netmap queues/slots: TX 8/1024, RX 8/1024
igb5: <intel(r) 1000="" pro="" network="" connection,="" version="" -="" 2.5.3-k="">port 0x3060-0x307f mem 0xdff00000-0xdff1ffff,0xdff30000-0xdff33fff irq 21 at device 20.3 on pci0
igb5: Using MSIX interrupts with 9 vectors
igb5: Ethernet address: 00:08:a2:0a:bd:c7
igb5: Bound queue 0 to cpu 4
igb5: Bound queue 1 to cpu 5
igb5: Bound queue 2 to cpu 6
igb5: Bound queue 3 to cpu 7
igb5: Bound queue 4 to cpu 0
igb5: Bound queue 5 to cpu 1
igb5: Bound queue 6 to cpu 2
igb5: Bound queue 7 to cpu 3
igb5: netmap queues/slots: TX 8/1024, RX 8/1024
ehci0: <intel avoton="" usb="" 2.0="" controller="">mem 0xdff35400-0xdff357ff irq 22 at device 22.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
ahci0: <intel avoton="" ahci="" sata="" controller="">port 0x30c0-0x30c7,0x30e0-0x30e3,0x30c8-0x30cf,0x30e4-0x30e7,0x3080-0x309f mem 0xdff34000-0xdff347ff irq 23 at device 23.0 on pci0
ahci0: AHCI v1.30 with 4 3Gbps ports, Port Multiplier not supported
ahcich0: <ahci channel="">at channel 0 on ahci0
ahcich1: <ahci channel="">at channel 1 on ahci0
ahcich2: <ahci channel="">at channel 2 on ahci0
ahcich3: <ahci channel="">at channel 3 on ahci0
ahci1: <intel avoton="" ahci="" sata="" controller="">port 0x30d0-0x30d7,0x30e8-0x30eb,0x30d8-0x30df,0x30ec-0x30ef,0x30a0-0x30bf mem 0xdff34800-0xdff34fff irq 16 at device 24.0 on pci0
ahci1: AHCI v1.30 with 2 6Gbps ports, Port Multiplier not supported
ahcich4: <ahci channel="">at channel 0 on ahci1
ahcich5: <ahci channel="">at channel 1 on ahci1
isab0: <pci-isa bridge="">at device 31.0 on pci0
isa0: <isa bus="">on isab0
orm0: <isa option="" rom="">at iomem 0xc0000-0xc0fff on isa0
ppc0: cannot reserve I/O port range
uart0: <16550 or compatible> at port 0x3f8-0x3ff irq 4 on isa0
uart1: <16550 or compatible> at port 0x2f8-0x2ff irq 3 flags 0x10 on isa0
uart1: console (115200,n,8,1)
est0: <enhanced speedstep="" frequency="" control="">on cpu0
est1: <enhanced speedstep="" frequency="" control="">on cpu1
est2: <enhanced speedstep="" frequency="" control="">on cpu2
est3: <enhanced speedstep="" frequency="" control="">on cpu3
est4: <enhanced speedstep="" frequency="" control="">on cpu4
est5: <enhanced speedstep="" frequency="" control="">on cpu5
est6: <enhanced speedstep="" frequency="" control="">on cpu6
est7: <enhanced speedstep="" frequency="" control="">on cpu7
Timecounters tick every 1.000 msec
random: unblocking device.
usbus0: 480Mbps High Speed USB v2.0
ugen0.1: <intel>at usbus0
uhub0: <intel 1="" 9="" ehci="" root="" hub,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr="">on usbus0
uhub0: 8 ports with 8 removable, self powered
ugen0.2: <vendor 0x8087="">at usbus0
uhub1: <vendor 2="" 9="" 0x8087="" product="" 0x07db,="" class="" 0,="" rev="" 2.00="" 0.02,="" addr="">on usbus0
uhub1: 4 ports with 4 removable, self powered
ugen0.3: <generic>at usbus0
umass0: <generic 0="" 3="" ultra="" fast="" media,="" class="" 0,="" rev="" 2.00="" 1.98,="" addr="">on usbus0
da0 at umass-sim0 bus 0 scbus6 target 0 lun 0
da0: <generic ultra="" hs-combo="" 1.98="">Removable Direct Access SCSI device
da0: Serial Number 000000225001
da0: 40.000MB/s transfers
da0: 58368MB (119537664 512 byte sectors)
da0: quirks=0x2 <no_6_byte>SMP: AP CPU #1 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #7 Launched!
Timecounter "TSC-low" frequency 1200029760 Hz quality 1000
Trying to mount root from ufs:/dev/ufsid/57acc16cf92063d6 [rw]…
WARNING: / was not properly dismounted
WARNING: /: mount pending error: blocks 1288 files 2
WARNING: /: TRIM flag on fs but disk does not support TRIM
Configuring crash dumps...
Using /dev/label/swap0 for dump device.
** SU+J Recovering /dev/ufsid/57acc16cf92063d6
** Reading 33554432 byte journal from inode 4.
** Building recovery table.
** Resolving unreferenced inode list.
** Processing journal entries.
fsck_ufs: Directory 642090 name not found
Stopping boot is recommended because filesystem manual action is needed, nevertheless automated repair of the filesystem will be attempted.
WARNING: Trying to recover filesystem from inconsistency...
** /dev/ufsid/57acc16cf92063d6USE JOURNAL? yes
** SU+J Recovering /dev/ufsid/57acc16cf92063d6
** Reading 33554432 byte journal from inode 4.RECOVER? yes
** Building recovery table.
** Resolving unreferenced inode list.
** Processing journal entries.
fsck_ufs: Directory 642090 name not found
** /dev/ufsid/57acc16cf92063d6USE JOURNAL? yes
** SU+J Recovering /dev/ufsid/57acc16cf92063d6
** Reading 33554432 byte journal from inode 4.RECOVER? yes
** Building recovery table.
** Resolving unreferenced inode list.
** Processing journal entries.
fsck_ufs: Directory 642090 name not found
** /dev/ufsid/57acc16cf92063d6USE JOURNAL? yes
** SU+J Recovering /dev/ufsid/57acc16cf92063d6
** Reading 33554432 byte journal from inode 4.RECOVER? yes
** Building recovery table.
** Resolving unreferenced inode list.
** Processing journal entries.
fsck_ufs: Directory 642090 name not found
** /dev/ufsid/57acc16cf92063d6USE JOURNAL? yes
** SU+J Recovering /dev/ufsid/57acc16cf92063d6
** Reading 33554432 byte journal from inode 4.RECOVER? yes
** Building recovery table.
** Resolving unreferenced inode list.
** Processing journal entries.
fsck_ufs: Directory 642090 name not found
Setting up memory disks... done.___
/ f
/ p _/ Sense
_/
__/Welcome to pfSense 2.3.2-RELEASE on the 'pfSense' platform...
Dump directory does not exist. Savecore not run.
Creating symlinks......ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/ipsec /usr/local/lib/perl5/5.20/mach/CORE
32-bit compatibility ldconfig path: /usr/lib32
done.
cap_mkdb: /etc/login.conf.db: Read-only file system
pkg: No packages installed
pkg: No packages installed
tee: /cf/conf/upgrade_log.txt: Read-only file system
ERROR: It was not possible to identify which pfSense kernel is installedExternal config loader 1.0 is now starting... da0s1 da0s1a da0s1b
Launching the init system...rm: /cf/conf/backup/backup.cache: Read-only file system
.... done.
Initializing.................. done.
Starting device manager (devd)...done.
Loading configuration......done.
Updating configuration...done.
Cleaning backup cache...done.
Setting up extended sysctls...done.
Setting timezone...done.
Configuring loopback interface...done.
Starting syslog...done.
Starting Secure Shell Services...done.
Setting up polling defaults...done.
Setting up interfaces microcode...done.
Configuring loopback interface...done.
Creating wireless clone interfaces...done.
Configuring LAGG interfaces...done.
Configuring VLAN interfaces...done.
Configuring QinQ interfaces...done.
Configuring WAN interface...done.
Configuring LAN interface...done.
Configuring VLAN11 interface...done.
Configuring VLAN12 interface...done.
Configuring LAB interface...done.
Configuring VLAN10 interface...done.
Configuring VLAN13 interface...done.
Configuring VLAN14 interface...done.
Configuring OFFICE interface...done.
Configuring VLAN15 interface...done.
Configuring MANAGEMENT interface...done.
Configuring RES0 interface...done.
Configuring CARP settings...done.
Syncing OpenVPN settings...done.
Configuring firewall......done.
Starting PFLOG...done.
Setting up gateway monitors...done.
Synchronizing user settings...done.
Starting webConfigurator...done.
Configuring CRON...done.
Starting DNS Resolver...done.
Starting NTP time client...done.
Starting DHCP service...done.
Configuring firewall......done.
Oct 23 01:50:28 syslogd: hostname nor servname provided, or not known
Starting SNMP daemon... done.
Generating RRD graphs...done.
Starting UPnP service... done.
Waiting for Internet connection to update pkg metadata and finish package reinstallationERROR!!! An error occurred on pkg execution (rc = 74) with parameters 'update -f':
pkg: mkdir(/root/var): Read-only file system.
ERROR!!! An error occurred on pkg execution (rc = 74) with parameters 'update -f':
pkg: mkdir(/root/var): Read-only file system.
ERROR!!! An error occurred on pkg execution (rc = 74) with parameters 'update -f':
pkg: mkdir(/root/var): Read-only file system.
ERROR: Error trying to get packages list. Aborting...
pkg: Unable to open remote repository catalogues. Try running 'pkg update' first.
Starting syslog...done.
Starting CRON... done.
Oct 23 01:50:33 syslogd: hostname nor servname provided, or not known
pkg: No packages installed
pkg: No packages installed
tee: /cf/conf/upgrade_log.txt: Read-only file system
ERROR: It was not possible to identify which pfSense kernel is installedAnyone have any ideas on how to avoid this? This is the 3rd confirmed instance of this occurring.</no_6_byte></generic></generic></generic></vendor></vendor></intel></intel></enhanced></enhanced></enhanced></enhanced></enhanced></enhanced></enhanced></enhanced></isa></isa></pci-isa></ahci></ahci></intel></ahci></ahci></ahci></ahci></intel></intel></intel(r)></intel(r)></intel(r)></intel(r)></processor></intel(r)></acpi></acpi></intel(r)></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></at></at></acpi></acpi></acpi></acpi></acpi></acpi></acpi></acpi></core></software></version></software,></core ></tscadj,smep,erms,nfpusg></lahf,prefetch></syscall,nx,rdtscp,lm></sse3,pclmulqdq,dtes64,mon,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,sse4.1,sse4.2,movbe,popcnt,tscdlt,aesni,rdrand></fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>~~
-
Okay, I booted it into single user and then ran through the fsck without using the journal. It made a series of recommendations that I agreed to by choosing y each time. After the first run through it still said that the system was dirty. So I ran through one more time without the journal. For the most part, it still booted the same as above, but this time it actually goes right into booting the config. Additionally, I am able to actually mount -w /, and make changes to necessary files. But the question still remains, how do we avoid this from occurring in the first place?