C2758 keeps failing. Real crisis on production system
-
My firewall is disconnecting over and over again. The last data captured via syslog is below. Is it a failing hard drive?
Oct 23 07:06:14 Office_Paxio kernel: ahcich4: Timeout on slot 18 port 0
Oct 23 07:06:14 Office_Paxio kernel: ahcich4: is 00000000 cs 001c0000 ss 001c0000 rs 001c0000 tfd c0 serr 00000000 cmd 0020d217
Oct 23 07:06:14 Office_Paxio kernel: (ada0:ahcich4:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 cf 69 bb 40 05 00 00 00 00 00
Oct 23 07:06:14 Office_Paxio kernel: (ada0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:06:14 Office_Paxio kernel: (ada0:ahcich4:0:0:0): Retrying command
Oct 23 07:06:45 Office_Paxio kernel: ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
Oct 23 07:07:15 Office_Paxio kernel: ahcich4: Timeout on slot 21 port 0
Oct 23 07:07:15 Office_Paxio kernel: ahcich4: is 00000000 cs 00200000 ss 00000000 rs 00200000 tfd 80 serr 00000000 cmd 0020d517
Oct 23 07:07:15 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
Oct 23 07:07:15 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:07:15 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): Retrying command
Oct 23 07:07:47 Office_Paxio kernel: ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
Oct 23 07:08:17 Office_Paxio kernel: ahcich4: Timeout on slot 22 port 0
Oct 23 07:08:17 Office_Paxio kernel: ahcich4: is 00000000 cs 00400000 ss 00000000 rs 00400000 tfd 80 serr 00000000 cmd 0020d617
Oct 23 07:08:17 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
Oct 23 07:08:17 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:08:17 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): Error 5, Retries exhausted
Oct 23 07:08:48 Office_Paxio kernel: ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
Oct 23 07:09:18 Office_Paxio kernel: ahcich4: Timeout on slot 23 port 0
Oct 23 07:09:18 Office_Paxio kernel: ahcich4: is 00000000 cs 00800000 ss 00000000 rs 00800000 tfd 80 serr 00000000 cmd 0020d717
Oct 23 07:09:18 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
Oct 23 07:09:18 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:09:18 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): Error 5, Retry was blocked
Oct 23 07:09:18 Office_Paxio kernel: ada0 at ahcich4 bus 0 scbus4 target 0 lun 0
Oct 23 07:09:18 Office_Paxio kernel: ada0: <intel ssdsc2bw120h6="" rg21="">s/n CVTR541303EW120AGN detached
Oct 23 07:09:49 Office_Paxio kernel: ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
Oct 23 07:10:16 Office_Paxio charon: 05[NET] <con3|2>received packet: from XXX.XXX.228.73[500] to XXX.XXX.176.2[500] (357 bytes)
Oct 23 07:10:16 Office_Paxio charon: 05[ENC] <con3|2>parsed CREATE_CHILD_SA request 6 [ N(REKEY_SA) N(ESP_TFC_PAD_N) SA No KE TSi TSr ]
Oct 23 07:10:16 Office_Paxio charon: 05[IKE] <con3|2>received ESP_TFC_PADDING_NOT_SUPPORTED, not using ESPv3 TFC padding
Oct 23 07:10:16 Office_Paxio charon: 05[IKE] <con3|2>CHILD_SA con3{48} established with SPIs c41ac09c_i c30bf7ff_o and TS 10.0.0.0/24|/0 10.0.3.0/24|/0 === 10.0.4.0/24|/0
Oct 23 07:10:16 Office_Paxio charon: 05[ENC] <con3|2>generating CREATE_CHILD_SA response 6 [ N(ESP_TFC_PAD_N) SA No KE TSi TSr ]
Oct 23 07:10:16 Office_Paxio charon: 05[NET] <con3|2>sending packet: from XXX.XXX.176.2[500] to XXX.XXX.228.73[500] (345 bytes)
Oct 23 07:10:16 Office_Paxio charon: 05[NET] <con3|2>received packet: from XXX.XXX.228.73[500] to XXX.XXX.176.2[500] (69 bytes)
Oct 23 07:10:16 Office_Paxio charon: 05[ENC] <con3|2>parsed INFORMATIONAL request 7 [ D ]
Oct 23 07:10:16 Office_Paxio charon: 05[IKE] <con3|2>received DELETE for ESP CHILD_SA with SPI c9e811e4
Oct 23 07:10:16 Office_Paxio charon: 05[IKE] <con3|2>closing CHILD_SA con3{44} with SPIs c48723ce_i (475970 bytes) c9e811e4_o (926844 bytes) and TS 10.0.0.0/24|/0 10.0.3.0/24|/0 === 10.0.4.0/24|/0
Oct 23 07:10:16 Office_Paxio charon: 05[IKE] <con3|2>sending DELETE for ESP CHILD_SA with SPI c48723ce
Oct 23 07:10:16 Office_Paxio charon: 05[IKE] <con3|2>CHILD_SA closed
Oct 23 07:10:16 Office_Paxio charon: 05[ENC] <con3|2>generating INFORMATIONAL response 7 [ D ]
Oct 23 07:10:16 Office_Paxio charon: 05[NET] <con3|2>sending packet: from XXX.XXX.176.2[500] to XXX.XXX.228.73[500] (69 bytes)
Oct 23 07:10:19 Office_Paxio kernel: ahcich4: Timeout on slot 24 port 0
Oct 23 07:10:19 Office_Paxio kernel: ahcich4: is 00000000 cs 01000000 ss 00000000 rs 01000000 tfd 80 serr 00000000 cmd 0020d817
Oct 23 07:10:19 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
Oct 23 07:10:19 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:10:19 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): Retrying command
Oct 23 07:10:51 Office_Paxio kernel: ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
Oct 23 07:11:21 Office_Paxio kernel: ahcich4: Timeout on slot 25 port 0
Oct 23 07:11:21 Office_Paxio kernel: ahcich4: is 00000000 cs 02000000 ss 00000000 rs 02000000 tfd 80 serr 00000000 cmd 0020d917
Oct 23 07:11:21 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
Oct 23 07:11:21 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:11:21 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): Error 5, Retries exhausted
Oct 23 07:12:08 Office_Paxio kernel: ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
Oct 23 07:12:08 Office_Paxio kernel: ahcich4: Poll timeout on slot 26 port 0
Oct 23 07:12:08 Office_Paxio kernel: ahcich4: is 00000000 cs 04000000 ss 00000000 rs 04000000 tfd 80 serr 00000000 cmd 0020da17
Oct 23 07:12:08 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
Oct 23 07:12:08 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:12:08 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0):
Oct 23 07:12:08 Office_Paxio kernel: Error 5, Retries exhausted
Oct 23 07:12:38 Office_Paxio kernel: ahcich4: Timeout on slot 27 port 0
Oct 23 07:12:38 Office_Paxio kernel: ahcich4: is 00000000 cs 08000000 ss 00000000 rs 08000000 tfd 80 serr 00000000 cmd 0020db17
Oct 23 07:12:38 Office_Paxio kernel: (ada0:ahcich4:0:0:0): SETFEATURES ENABLE RCACHE. ACB: ef aa 00 00 00 40 00 00 00 00 00 00
Oct 23 07:12:38 Office_Paxio kernel: (ada0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:12:38 Office_Paxio kernel: (ada0:ahcich4:0:0:0): Error 5, Periph was invalidated
Oct 23 07:13:26 Office_Paxio kernel: ahcich4: AHCI reset: device not ready after 31000ms (tfd = 00000080)
Oct 23 07:13:26 Office_Paxio kernel: ahcich4: Poll timeout on slot 28 port 0
Oct 23 07:13:26 Office_Paxio kernel: ahcich4: is 00000000 cs 10000000 ss 00000000 rs 10000000 tfd 80 serr 00000000 cmd 0020dc17
Oct 23 07:13:26 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
Oct 23 07:13:26 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:13:26 Office_Paxio kernel: (aprobe0:ahcich4:0:0:0): Error 5, Retries exhausted
Oct 23 07:13:56 Office_Paxio kernel: ahcich4: Timeout on slot 29 port 0
Oct 23 07:13:56 Office_Paxio kernel: ahcich4: is 00000000 cs e0000000 ss e0000000 rs e0000000 tfd 80 serr 00000000 cmd 0020dd17
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 cf 69 bb 40 05 00 00 00 00 00
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): CAM status: Command timeout
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): Error 5, Periph was invalidated
Oct 23 07:13:56 Office_Paxio kernel: g_vfs_done():ufsid/56f4f94196a6b11c[WRITE(offset=49238179840, length=32768)]error = 5
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 0f fd 52 40 09 00 00 00 00 00
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): CAM status: Unconditionally Re-queue Request
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): Error 5, Periph was invalidated
Oct 23 07:13:56 Office_Paxio kernel: g_vfs_done():ufsid/56f4f94196a6b11c[WRITE(offset=80094003200, length=32768)]error = 5
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 cf 56 51 40 0a 00 00 00 00 00
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): CAM status: Unconditionally Re-queue Request
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): Error 5, Periph was invalidated
Oct 23 07:13:56 Office_Paxio kernel: g_vfs_done():ufsid/56f4f94196a6b11c[WRITE(offset=88628592640, length=32768)]error = 5
Oct 23 07:13:56 Office_Paxio snmpd: disk_OS_get_disks: sysctl_2 kern.disks failed: No such file or directory
Oct 23 07:13:56 Office_Paxio kernel: (ada0:ahcich4:0:0:0): Periph destroyed</con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></con3|2></intel> -
Yes, that's a failing disk.
-
Yup. Drive finally gave out. Odd. Never had an SSD fail until now.