Firewall hard crash



  • So, we had a firewall die a hard death. Trying to log in gave us a 502 Gateway error from nginx. Upon reboot it never came back. We've replaced the firewall and I'm looking at the broken one. When I boot it up we get:

    AMD G-T40E Processor
    CPU MHz=1001
    Press F10 key now for boot menu:
    drive 0x000f2a90: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 s=117231408
    Booting from Hard Disk...
    
    F1  pfSense
    
    F6 PXE
    Boot:  F1
    //bboooott//ccoonnffiigg::  --SS111155220000  --DD
    
    Consoles: internal video/keyboard  serial port
    BIOS drive C: is disk0
    BIOS 639kB/3653944kB available memory
    
    FreeBSD/x86 bootstrap loader, Revision 1.1
    (Thu Oct 19 09:49:37 CDT 2017 root@buildbot2.netgate.com)
    Loading /boot/defaults/loader.conf
    /
    can't load 'kernel'
    

    If I just type "boot" I get:

    ***** FILE SYSTEM MARKED CLEAN *****
    Filesystems are clean, continuing...
    Mounting filesystems...
    uhub2: 5 ports with 5 removable, self powered
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Retrying command
    uhub4: 5 ports with 5 removable, self powered
    ugen6.2: <Generic Flash Card ReaderWriter> at usbus6
    umass0 on uhub1
    umass0: <Generic Flash Card ReaderWriter, class 0/0, rev 2.01/1.00, addr 2> on usbus6
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Retrying command
    da0 at umass-sim0 bus 0 scbus6 target 0 lun 0
    da0: <Multiple Card  Reader 1.00> Removable Direct Access SPC-2 SCSI device
    da0: Serial Number 058F63666485
    da0: 40.000MB/s transfers
    da0: Attempt to query device size failed: NOT READY, Medium not present
    da0: quirks=0x2<NO_6_BYTE>
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Retrying command
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Retrying command
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Error 5, Retries exhausted
    g_vfs_done():ufsid/57758f7e2e26ac75[READ(offset=45348175872, length=4096)]error = 5
    vnode_pager_generic_getpages_done: I/O read error 5
    vm_fault: pager read error, pid 56 (mdconfig)
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Retrying command
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Retrying command
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Retrying command
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Retrying command
    (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 08 6f 7b 47 40 05 00 00 00 00 00
    (ada0:ahcich0:0:0:0): CAM status: ATA Status Error
    (ada0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC )
    (ada0:ahcich0:0:0:0): RES: 51 40 6f 7b 47 40 05 00 00 77 7b
    (ada0:ahcich0:0:0:0): Error 5, Retries exhausted
    g_vfs_done():ufsid/57758f7e2e26ac75[READ(offset=45348175872, length=4096)]error = 5
    vnode_pager_generic_getpages_done: I/O read error 5
    vm_fault: pager read error, pid 56 (mdconfig)
    Failed to fully fault in a core file segment at VA 0x800c3e000 with size 0x1000 to be written at offset 0x10000 for process mdconfig
    pid 56 (mdconfig), uid 0: exited on signal 11 (core dumped)
    random: unblocking device.
    

    What could be the cause?


  • LAYER 8

    hard disk need to be changed
    UNC means uncorrectable data error. Either you have a cable going bad or that HD is failing


  • Netgate Administrator

    Yup that's a bad drive. If it's an APU you could run from SD card as an alternative.

    Steve



  • I put in another SSD and brought it back up. No big deal. Just trying to get some eyes to see if that really was the cause of the crash. Are the errors showing an issue with the card reader? Or are they just all intermingled so that it appears that way? It's a Kingston SSD popped into the mSATA port.


  • LAYER 8

    the "Generic Flash Card ReaderWriter" have nothing to do with your problem,
    the problem start the line before and after
    at boot it just discovered that you have an HD on ada0 and a flash card reader (umass0) connected on a usb port



  • @kiokoman Thanks. I didn't think so but they were showing intermingled like that so I wasn't sure.


Log in to reply