C2758 keeps failing. Real crisis on production system



  • My firewall is disconnecting over and over again.  The last data captured via syslog is below.  Is it a failing hard drive?

    Oct 23 07:06:14 Office_Paxio kernel:  ahcich4: Timeout on slot 18 port 0
    Oct 23 07:06:14 Office_Paxio kernel:  ahcich4: is 00000000 cs 001c0000 ss 001c0000 rs 001c0000 tfd c0 serr 00000000 cmd 0020d217
    Oct 23 07:06:14 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 cf 69 bb 40 05 00 00 00 00 00
    Oct 23 07:06:14 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:06:14 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): Retrying command
    Oct 23 07:06:45 Office_Paxio kernel:  ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
    Oct 23 07:07:15 Office_Paxio kernel:  ahcich4: Timeout on slot 21 port 0
    Oct 23 07:07:15 Office_Paxio kernel:  ahcich4: is 00000000 cs 00200000 ss 00000000 rs 00200000 tfd 80 serr 00000000 cmd 0020d517
    Oct 23 07:07:15 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
    Oct 23 07:07:15 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:07:15 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): Retrying command
    Oct 23 07:07:47 Office_Paxio kernel:  ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
    Oct 23 07:08:17 Office_Paxio kernel:  ahcich4: Timeout on slot 22 port 0
    Oct 23 07:08:17 Office_Paxio kernel:  ahcich4: is 00000000 cs 00400000 ss 00000000 rs 00400000 tfd 80 serr 00000000 cmd 0020d617
    Oct 23 07:08:17 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
    Oct 23 07:08:17 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:08:17 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): Error 5, Retries exhausted
    Oct 23 07:08:48 Office_Paxio kernel:  ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
    Oct 23 07:09:18 Office_Paxio kernel:  ahcich4: Timeout on slot 23 port 0
    Oct 23 07:09:18 Office_Paxio kernel:  ahcich4: is 00000000 cs 00800000 ss 00000000 rs 00800000 tfd 80 serr 00000000 cmd 0020d717
    Oct 23 07:09:18 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
    Oct 23 07:09:18 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:09:18 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): Error 5, Retry was blocked
    Oct 23 07:09:18 Office_Paxio kernel:  ada0 at ahcich4 bus 0 scbus4 target 0 lun 0
    Oct 23 07:09:18 Office_Paxio kernel:  ada0: <intel ssdsc2bw120h6="" rg21="">s/n CVTR541303EW120AGN detached
    Oct 23 07:09:49 Office_Paxio kernel:  ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
    Oct 23 07:10:16 Office_Paxio charon:  05[NET] <con3|2>received packet: from XXX.XXX.228.73[500] to XXX.XXX.176.2[500] (357 bytes)
    Oct 23 07:10:16 Office_Paxio charon:  05[ENC] <con3|2>parsed CREATE_CHILD_SA request 6 [ N(REKEY_SA) N(ESP_TFC_PAD_N) SA No KE TSi TSr ]
    Oct 23 07:10:16 Office_Paxio charon:  05[IKE] <con3|2>received ESP_TFC_PADDING_NOT_SUPPORTED, not using ESPv3 TFC padding
    Oct 23 07:10:16 Office_Paxio charon:  05[IKE] <con3|2>CHILD_SA con3{48} established with SPIs c41ac09c_i c30bf7ff_o and TS 10.0.0.0/24|/0 10.0.3.0/24|/0 === 10.0.4.0/24|/0
    Oct 23 07:10:16 Office_Paxio charon:  05[ENC] <con3|2>generating CREATE_CHILD_SA response 6 [ N(ESP_TFC_PAD_N) SA No KE TSi TSr ]
    Oct 23 07:10:16 Office_Paxio charon:  05[NET] <con3|2>sending packet: from XXX.XXX.176.2[500] to XXX.XXX.228.73[500] (345 bytes)
    Oct 23 07:10:16 Office_Paxio charon:  05[NET] <con3|2>received packet: from XXX.XXX.228.73[500] to XXX.XXX.176.2[500] (69 bytes)
    Oct 23 07:10:16 Office_Paxio charon:  05[ENC] <con3|2>parsed INFORMATIONAL request 7 [ D ]
    Oct 23 07:10:16 Office_Paxio charon:  05[IKE] <con3|2>received DELETE for ESP CHILD_SA with SPI c9e811e4
    Oct 23 07:10:16 Office_Paxio charon:  05[IKE] <con3|2>closing CHILD_SA con3{44} with SPIs c48723ce_i (475970 bytes) c9e811e4_o (926844 bytes) and TS 10.0.0.0/24|/0 10.0.3.0/24|/0 === 10.0.4.0/24|/0
    Oct 23 07:10:16 Office_Paxio charon:  05[IKE] <con3|2>sending DELETE for ESP CHILD_SA with SPI c48723ce
    Oct 23 07:10:16 Office_Paxio charon:  05[IKE] <con3|2>CHILD_SA closed
    Oct 23 07:10:16 Office_Paxio charon:  05[ENC] <con3|2>generating INFORMATIONAL response 7 [ D ]
    Oct 23 07:10:16 Office_Paxio charon:  05[NET] <con3|2>sending packet: from XXX.XXX.176.2[500] to XXX.XXX.228.73[500] (69 bytes)
    Oct 23 07:10:19 Office_Paxio kernel:  ahcich4: Timeout on slot 24 port 0
    Oct 23 07:10:19 Office_Paxio kernel:  ahcich4: is 00000000 cs 01000000 ss 00000000 rs 01000000 tfd 80 serr 00000000 cmd 0020d817
    Oct 23 07:10:19 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
    Oct 23 07:10:19 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:10:19 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): Retrying command
    Oct 23 07:10:51 Office_Paxio kernel:  ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
    Oct 23 07:11:21 Office_Paxio kernel:  ahcich4: Timeout on slot 25 port 0
    Oct 23 07:11:21 Office_Paxio kernel:  ahcich4: is 00000000 cs 02000000 ss 00000000 rs 02000000 tfd 80 serr 00000000 cmd 0020d917
    Oct 23 07:11:21 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
    Oct 23 07:11:21 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:11:21 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): Error 5, Retries exhausted
    Oct 23 07:12:08 Office_Paxio kernel:  ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
    Oct 23 07:12:08 Office_Paxio kernel:  ahcich4: Poll timeout on slot 26 port 0
    Oct 23 07:12:08 Office_Paxio kernel:  ahcich4: is 00000000 cs 04000000 ss 00000000 rs 04000000 tfd 80 serr 00000000 cmd 0020da17
    Oct 23 07:12:08 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
    Oct 23 07:12:08 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:12:08 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0):
    Oct 23 07:12:08 Office_Paxio kernel:  Error 5, Retries exhausted
    Oct 23 07:12:38 Office_Paxio kernel:  ahcich4: Timeout on slot 27 port 0
    Oct 23 07:12:38 Office_Paxio kernel:  ahcich4: is 00000000 cs 08000000 ss 00000000 rs 08000000 tfd 80 serr 00000000 cmd 0020db17
    Oct 23 07:12:38 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): SETFEATURES ENABLE RCACHE. ACB: ef aa 00 00 00 40 00 00 00 00 00 00
    Oct 23 07:12:38 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:12:38 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): Error 5, Periph was invalidated
    Oct 23 07:13:26 Office_Paxio kernel:  ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
    Oct 23 07:13:26 Office_Paxio kernel:  ahcich4: Poll timeout on slot 28 port 0
    Oct 23 07:13:26 Office_Paxio kernel:  ahcich4: is 00000000 cs 10000000 ss 00000000 rs 10000000 tfd 80 serr 00000000 cmd 0020dc17
    Oct 23 07:13:26 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
    Oct 23 07:13:26 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:13:26 Office_Paxio kernel:  (aprobe0:ahcich4:0:0:0): Error 5, Retries exhausted
    Oct 23 07:13:56 Office_Paxio kernel:  ahcich4: Timeout on slot 29 port 0
    Oct 23 07:13:56 Office_Paxio kernel:  ahcich4: is 00000000 cs e0000000 ss e0000000 rs e0000000 tfd 80 serr 00000000 cmd 0020dd17
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 cf 69 bb 40 05 00 00 00 00 00
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): CAM status: Command timeout
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): Error 5, Periph was invalidated
    Oct 23 07:13:56 Office_Paxio kernel:  g_vfs_done():ufsid/56f4f94196a6b11c[WRITE(offset=49238179840, length=32768)]error = 5
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 0f fd 52 40 09 00 00 00 00 00
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): CAM status: Unconditionally Re-queue Request
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): Error 5, Periph was invalidated
    Oct 23 07:13:56 Office_Paxio kernel:  g_vfs_done():ufsid/56f4f94196a6b11c[WRITE(offset=80094003200, length=32768)]error = 5
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 cf 56 51 40 0a 00 00 00 00 00
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): CAM status: Unconditionally Re-queue Request
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): Error 5, Periph was invalidated
    Oct 23 07:13:56 Office_Paxio kernel:  g_vfs_done():ufsid/56f4f94196a6b11c[WRITE(offset=88628592640, length=32768)]error = 5
    Oct 23 07:13:56 Office_Paxio snmpd:  disk_OS_get_disks: sysctl_2 kern.disks failed: No such file or directory
    Oct 23 07:13:56 Office_Paxio kernel:  (ada0:ahcich4:0:0:0): Periph destroyed</con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></intel>


  • Rebel Alliance Developer Netgate

    Yes, that's a failing disk.



  • Yup.  Drive finally gave out.  Odd.  Never had an SSD fail until now.