Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    SG-1100 eMMC failing? Solaris: WARNING: Pool 'pfSense" has encountered an uncorrectable I/O failure [...]

    Scheduled Pinned Locked Moved Official Netgate® Hardware
    21 Posts 2 Posters 2.7k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      Cabledude @Cabledude
      last edited by

      @stephenw10

      I tried flashing the firmware 3 more times with different USB thumb drives. Eventually the third one passed right through until the end and appears normal. Above output is from that third try.

      But the device still gets very hot, much hotter than my other SG-1100, which is running my network now, including pfBlocker IP and DNSBL blocklists.

      I tried to read the eMMC health by following these Netgate instructions but it doesn't provide the

      eMMC Life Time Estimation A [EXT_CSD_DEVICE_LIFE_TIME_EST_TYP_A]: 0x01
      eMMC Life Time Estimation B [EXT_CSD_DEVICE_LIFE_TIME_EST_TYP_B]: 0x02
      

      information. Instead I get:

      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[79]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[78]]: 0x72
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[77]]: 0x35
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[76]]: 0x35
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[75]]: 0x69
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[74]]: 0x32
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[73]]: 0x32
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[72]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[71]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[70]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[69]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[68]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[67]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[66]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[65]]: 0x00
      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[64]]: 0x00
      Native sector size [NATIVE_SECTOR_SIZE]: 0x00
      Sector size emulation [USE_NATIVE_SECTOR]: 0x00
      Sector size [DATA_SECTOR_SIZE]: 0x00
      1st initialization after disabling sector size emulation [INI_TIMEOUT_EMU]: 0x00
      Class 6 commands control [CLASS_6_CTRL]: 0x00
      Number of addressed group to be Released[DYNCAP_NEEDED]: 0x00
      Exception events control [EXCEPTION_EVENTS_CTRL]: 0x0000
      Exception events status[EXCEPTION_EVENTS_STATUS]: 0x0000
      Extended Partitions Attribute [EXT_PARTITIONS_ATTRIBUTE]: 0x0000
      Context configuration [CONTEXT_CONF[51]]: 0x00
      Context configuration [CONTEXT_CONF[50]]: 0x00
      Context configuration [CONTEXT_CONF[49]]: 0x00
      Context configuration [CONTEXT_CONF[48]]: 0x00
      Context configuration [CONTEXT_CONF[47]]: 0x00
      Context configuration [CONTEXT_CONF[46]]: 0x00
      Context configuration [CONTEXT_CONF[45]]: 0x00
      Context configuration [CONTEXT_CONF[44]]: 0x00
      Context configuration [CONTEXT_CONF[43]]: 0x00
      Context configuration [CONTEXT_CONF[42]]: 0x00
      Context configuration [CONTEXT_CONF[41]]: 0x00
      Context configuration [CONTEXT_CONF[40]]: 0x00
      Context configuration [CONTEXT_CONF[39]]: 0x00
      Context configuration [CONTEXT_CONF[38]]: 0x00
      Context configuration [CONTEXT_CONF[37]]: 0x00
      Packed command status [PACKED_COMMAND_STATUS]: 0x00
      Packed command failure index [PACKED_FAILURE_INDEX]: 0x00
      Power Off Notification [POWER_OFF_NOTIFICATION]: 0x00
      Control to turn the Cache ON/OFF [CACHE_CTRL]: 0x00
      [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: pkg install -y mmc-utils ; rehash
      

      Can you make anything out of that? Or is this eMMC not supported?

      Pete
      Home: SG-2100 + UniFi + Synology. SG-1100 retired
      Parents: SG-1100 + UniFi + Synology
      Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

      1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by

        That's only a fraction of the output, you should see:

        [23.05.1-RELEASE][admin@1100-3.stevew.lan]/root: mmc extcsd read /dev/mmcsd0rpmb 
        =============================================
          Extended CSD rev 1.8 (MMC 5.1)
        =============================================
        
        Card Supported Command sets [S_CMD_SET: 0x01]
        HPI Features [HPI_FEATURE: 0x01]: implementation based on CMD13
        Background operations support [BKOPS_SUPPORT: 0x01]
        Max Packet Read Cmd [MAX_PACKED_READS: 0x3f]
        Max Packet Write Cmd [MAX_PACKED_WRITES: 0x3f]
        Data TAG support [DATA_TAG_SUPPORT: 0x01]
        Data TAG Unit Size [TAG_UNIT_SIZE: 0x03]
        Tag Resources Size [TAG_RES_SIZE: 0x03]
        Context Management Capabilities [CONTEXT_CAPABILITIES: 0x05]
        Large Unit Size [LARGE_UNIT_SIZE_M1: 0x00]
        Extended partition attribute support [EXT_SUPPORT: 0x03]
        Generic CMD6 Timer [GENERIC_CMD6_TIME: 0x19]
        Power off notification [POWER_OFF_LONG_TIME: 0x19]
        Cache Size [CACHE_SIZE] is 512 KiB
        Background operations status [BKOPS_STATUS: 0x03]
        1st Initialisation Time after programmed sector [INI_TIMEOUT_AP: 0x5a]
        Power class for 52MHz, DDR at 3.6V [PWR_CL_DDR_52_360: 0x00]
        Power class for 52MHz, DDR at 1.95V [PWR_CL_DDR_52_195: 0xdd]
        Power class for 200MHz at 3.6V [PWR_CL_200_360: 0xdd]
        Power class for 200MHz, at 1.95V [PWR_CL_200_195: 0x00]
        Minimum Performance for 8bit at 52MHz in DDR mode:
         [MIN_PERF_DDR_W_8_52: 0x00]
         [MIN_PERF_DDR_R_8_52: 0x00]
        TRIM Multiplier [TRIM_MULT: 0x03]
        Secure Feature support [SEC_FEATURE_SUPPORT: 0x55]
        Boot Information [BOOT_INFO: 0x07]
         Device supports alternative boot method
         Device supports dual data rate during boot
         Device supports high speed timing during boot
        Boot partition size [BOOT_SIZE_MULTI: 0x20]
        Access size [ACC_SIZE: 0x08]
        High-capacity erase unit size [HC_ERASE_GRP_SIZE: 0x01]
         i.e. 512 KiB
        High-capacity erase timeout [ERASE_TIMEOUT_MULT: 0x03]
        Reliable write sector count [REL_WR_SEC_C: 0x01]
        High-capacity W protect group size [HC_WP_GRP_SIZE: 0x10]
         i.e. 8192 KiB
        Sleep current (VCC) [S_C_VCC: 0x05]
        Sleep current (VCCQ) [S_C_VCCQ: 0x07]
        Sleep/awake timeout [S_A_TIMEOUT: 0x12]
        Sector Count [SEC_COUNT: 0x00e90e80]
         Device is block-addressed
        Minimum Write Performance for 8bit:
         [MIN_PERF_W_8_52: 0x0a]
         [MIN_PERF_R_8_52: 0x0a]
         [MIN_PERF_W_8_26_4_52: 0x0a]
         [MIN_PERF_R_8_26_4_52: 0x0a]
        Minimum Write Performance for 4bit:
         [MIN_PERF_W_4_26: 0x0a]
         [MIN_PERF_R_4_26: 0x0a]
        Power classes registers:
         [PWR_CL_26_360: 0x00]
         [PWR_CL_52_360: 0x00]
         [PWR_CL_26_195: 0xdd]
         [PWR_CL_52_195: 0xdd]
        Partition switching timing [PARTITION_SWITCH_TIME: 0x03]
        Out-of-interrupt busy timing [OUT_OF_INTERRUPT_TIME: 0x0a]
        I/O Driver Strength [DRIVER_STRENGTH: 0x1f]
        Enhanced Strobe mode [STROBE_SUPPORT: 0x01]
        Card Type [CARD_TYPE: 0x57]
         HS400 Dual Data Rate eMMC @200MHz 1.8VI/O
         HS200 Single Data Rate eMMC @200MHz 1.8VI/O
         HS Dual Data Rate eMMC @52MHz 1.8V or 3VI/O
         HS eMMC @52MHz - at rated device voltage(s)
         HS eMMC @26MHz - at rated device voltage(s)
        CSD structure version [CSD_STRUCTURE: 0x02]
        Command set [CMD_SET: 0x00]
        Command set revision [CMD_SET_REV: 0x00]
        Power class [POWER_CLASS: 0x0d]
        High-speed interface timing [HS_TIMING: 0x01]
        Erased memory content [ERASED_MEM_CONT: 0x00]
        Boot configuration bytes [PARTITION_CONFIG: 0x03]
         Not boot enable
         R/W Replay Protected Memory Block (RPMB)
        Boot config protection [BOOT_CONFIG_PROT: 0x00]
        Boot bus Conditions [BOOT_BUS_CONDITIONS: 0x00]
        High-density erase group definition [ERASE_GROUP_DEF: 0x01]
        Boot write protection status registers [BOOT_WP_STATUS]: 0x00
        Boot Area Write protection [BOOT_WP]: 0x00
         Power ro locking: possible
         Permanent ro locking: possible
         partition 0 ro lock status: not locked
         partition 1 ro lock status: not locked
        User area write protection register [USER_WP]: 0x00
        FW configuration [FW_CONFIG]: 0x00
        RPMB Size [RPMB_SIZE_MULT]: 0x20
        Write reliability setting register [WR_REL_SET]: 0x1f
         user area: the device protects existing data if a power failure occurs during a write operation
         partition 1: the device protects existing data if a power failure occurs during a write operation
         partition 2: the device protects existing data if a power failure occurs during a write operation
         partition 3: the device protects existing data if a power failure occurs during a write operation
         partition 4: the device protects existing data if a power failure occurs during a write operation
        Write reliability parameter register [WR_REL_PARAM]: 0x15
         Device supports writing EXT_CSD_WR_REL_SET
         Device supports the enhanced def. of reliable write
        Enable background operations handshake [BKOPS_EN]: 0x02
        H/W reset function [RST_N_FUNCTION]: 0x00
        HPI management [HPI_MGMT]: 0x00
        Partitioning Support [PARTITIONING_SUPPORT]: 0x07
         Device support partitioning feature
         Device can have enhanced tech.
        Max Enhanced Area Size [MAX_ENH_SIZE_MULT]: 0x0001b5
         i.e. 3579904 KiB
        Partitions attribute [PARTITIONS_ATTRIBUTE]: 0x00
        Partitioning Setting [PARTITION_SETTING_COMPLETED]: 0x00
         Device partition setting NOT complete
        General Purpose Partition Size
         [GP_SIZE_MULT_4]: 0x000000
         [GP_SIZE_MULT_3]: 0x000000
         [GP_SIZE_MULT_2]: 0x000000
         [GP_SIZE_MULT_1]: 0x000000
        Enhanced User Data Area Size [ENH_SIZE_MULT]: 0x000000
         i.e. 0 KiB
        Enhanced User Data Start Address [ENH_START_ADDR]: 0x00000000
         i.e. 0 bytes offset
        Bad Block Management mode [SEC_BAD_BLK_MGMNT]: 0x00
        Periodic Wake-up [PERIODIC_WAKEUP]: 0x00
        Program CID/CSD in DDR mode support [PROGRAM_CID_CSD_DDR_SUPPORT]: 0x01
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[127]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[126]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[125]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[124]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[123]]: 0x01
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[122]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[121]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[120]]: 0x01
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[119]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[118]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[117]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[116]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[115]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[114]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[113]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[112]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[111]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[110]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[109]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[108]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[107]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[106]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[105]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[104]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[103]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[102]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[101]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[100]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[99]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[98]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[97]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[96]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[95]]: 0x02
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[94]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[93]]: 0x01
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[92]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[91]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[90]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[89]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[88]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[87]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[86]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[85]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[84]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[83]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[82]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[81]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[80]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[79]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[78]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[77]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[76]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[75]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[74]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[73]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[72]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[71]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[70]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[69]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[68]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[67]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[66]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[65]]: 0x00
        Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[64]]: 0x00
        Native sector size [NATIVE_SECTOR_SIZE]: 0x00
        Sector size emulation [USE_NATIVE_SECTOR]: 0x00
        Sector size [DATA_SECTOR_SIZE]: 0x00
        1st initialization after disabling sector size emulation [INI_TIMEOUT_EMU]: 0x0a
        Class 6 commands control [CLASS_6_CTRL]: 0x00
        Number of addressed group to be Released[DYNCAP_NEEDED]: 0x00
        Exception events control [EXCEPTION_EVENTS_CTRL]: 0x0000
        Exception events status[EXCEPTION_EVENTS_STATUS]: 0x0000
        Extended Partitions Attribute [EXT_PARTITIONS_ATTRIBUTE]: 0x0000
        Context configuration [CONTEXT_CONF[51]]: 0x00
        Context configuration [CONTEXT_CONF[50]]: 0x00
        Context configuration [CONTEXT_CONF[49]]: 0x00
        Context configuration [CONTEXT_CONF[48]]: 0x00
        Context configuration [CONTEXT_CONF[47]]: 0x00
        Context configuration [CONTEXT_CONF[46]]: 0x00
        Context configuration [CONTEXT_CONF[45]]: 0x00
        Context configuration [CONTEXT_CONF[44]]: 0x00
        Context configuration [CONTEXT_CONF[43]]: 0x00
        Context configuration [CONTEXT_CONF[42]]: 0x00
        Context configuration [CONTEXT_CONF[41]]: 0x00
        Context configuration [CONTEXT_CONF[40]]: 0x00
        Context configuration [CONTEXT_CONF[39]]: 0x00
        Context configuration [CONTEXT_CONF[38]]: 0x00
        Context configuration [CONTEXT_CONF[37]]: 0x00
        Packed command status [PACKED_COMMAND_STATUS]: 0x00
        Packed command failure index [PACKED_FAILURE_INDEX]: 0x00
        Power Off Notification [POWER_OFF_NOTIFICATION]: 0x00
        Control to turn the Cache ON/OFF [CACHE_CTRL]: 0x01
        eMMC Firmware Version: 09111317
        eMMC Life Time Estimation A [EXT_CSD_DEVICE_LIFE_TIME_EST_TYP_A]: 0x02
        eMMC Life Time Estimation B [EXT_CSD_DEVICE_LIFE_TIME_EST_TYP_B]: 0x04
        eMMC Pre EOL information [EXT_CSD_PRE_EOL_INFO]: 0x01
        Secure Removal Type [SECURE_REMOVAL_TYPE]: 0x08
         information is configured to be removed by an erase of the physical memory
         Supported Secure Removal Type:
          information removed using a vendor defined
        Command Queue Support [CMDQ_SUPPORT]: 0x01
        Command Queue Depth [CMDQ_DEPTH]: 32
        Command Enabled [CMDQ_MODE_EN]: 0x00
        
        C 1 Reply Last reply Reply Quote 0
        • C
          Cabledude @stephenw10
          last edited by Cabledude

          @stephenw10
          Yes I saw most of that when doing a screen recording, which is the only way for me to see what's flashing by because it goes too fast.

          But my output stops at

          Control to turn the Cache ON/OFF [CACHE_CTRL]: 0x00
          

          ...so it does not show:

          eMMC Firmware Version: 09111317
          eMMC Life Time Estimation A [EXT_CSD_DEVICE_LIFE_TIME_EST_TYP_A]: 0x02
          eMMC Life Time Estimation B [EXT_CSD_DEVICE_LIFE_TIME_EST_TYP_B]: 0x04
          eMMC Pre EOL information [EXT_CSD_PRE_EOL_INFO]: 0x01
          

          I notice you have the output in text. Is there an output file I can open?

          Thanks,

          Pete
          Home: SG-2100 + UniFi + Synology. SG-1100 retired
          Parents: SG-1100 + UniFi + Synology
          Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

          1 Reply Last reply Reply Quote 0
          • C
            Cabledude
            last edited by Cabledude

            Also tried the mmc command using other search strings:

            [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: mmc extcsd read /dev/mmcsd0rpmb | egrep 'PACKED'
            Max Packet Read Cmd [MAX_PACKED_READS: 0x3f]
            Max Packet Write Cmd [MAX_PACKED_WRITES: 0x3f]
            Packed command status [PACKED_COMMAND_STATUS]: 0x00
            Packed command failure index [PACKED_FAILURE_INDEX]: 0x00
            [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: mmc extcsd read /dev/mmcsd0rpmb | egrep 'Estimation'
            [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: mmc extcsd read /dev/mmcsd0rpmb | egrep 'EXT_CSD'
             Device supports writing EXT_CSD_WR_REL_SET
            [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: 
            
            [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: mmc extcsd read /dev/mmcsd0rpmb | egrep 'LIFE|EOL'
            [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: 
            

            The output simply doesn't contain the Life Time Estimation info.

            Pete
            Home: SG-2100 + UniFi + Synology. SG-1100 retired
            Parents: SG-1100 + UniFi + Synology
            Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              I just connected to it using SSH and copy and pasted it here. You can also scroll back through it and read exactly what is shown.

              You can also copy/paste out of putty (or any terminal emulator) if you're uisng the console directly. Putty can also be set to log all output to a file directly if needed.

              C 1 Reply Last reply Reply Quote 0
              • C
                Cabledude @stephenw10
                last edited by

                @stephenw10
                Okay I haven’t tried SSH. But I’m on macOS, not windows. So I use terminal and it won’t let me select all + copy the entire output, just the last screen.

                Bottom line is I don’t get the eMMC health output
                And I’m still puzzled why my usbrecovery output is so much different from what you showed, not 5 or 8 devices etc.
                And the heat and power draw also bothers me from a reliability point of view.

                Would you think, based on all of the information and output I provided above, that this unit is okay, or otherwise?

                Pete
                Home: SG-2100 + UniFi + Synology. SG-1100 retired
                Parents: SG-1100 + UniFi + Synology
                Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  Mmm, try SSH. The fact you are seeing unexpected output seems suspicious. You might not be seeing everything or it might getting overwritten.

                  C 2 Replies Last reply Reply Quote 0
                  • C
                    Cabledude @stephenw10
                    last edited by Cabledude

                    @stephenw10
                    Connected via SSH now. Exact same output, so no health est info, but now I can indeed copy/paste all output which is progress.

                    Suspicious is not just the lack of eMMC health info, but also the other missing output during usb recovery.

                    I can’t re-flash the firmware using SSH. All I could try is find a windows machine somewhere at a friends office to compare putty output. Maybe tomorrow, it’s 2:30 am.

                    In my head I have written off this unit, from the high power usage and the extreme heat it produces alone. The reason I am still trying to estimate if the eMMC is bad, is that this circumstance might explain some or all of the issues I’ve been having with it. And by such conclusion may restore my confidence in netgate.

                    Maybe you could bear with me a little longer and help me troubleshoot the output issues so as to determine if this unit is good or bad. That would really help.

                    Pete
                    Home: SG-2100 + UniFi + Synology. SG-1100 retired
                    Parents: SG-1100 + UniFi + Synology
                    Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

                    1 Reply Last reply Reply Quote 0
                    • C
                      Cabledude @stephenw10
                      last edited by

                      @stephenw10 said in SG-1100 eMMC failing? Solaris: WARNING: Pool 'pfSense" has encountered an uncorrectable I/O failure [...]:

                      Mmm, try SSH. The fact you are seeing unexpected output seems suspicious. You might not be seeing everything or it might getting overwritten.

                      I installed a "putty - equivalent" for macOS, the "Serial.app". Provides good output, can scroll back, copy, paste, etc. Here is the eMMC output, though it lacks the same essential parts as before:

                      [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: mmc extcsd read /dev/mmcsd0rpmb
                      =============================================
                       Extended CSD rev 1.6 (MMC 4.5)
                      =============================================
                      
                      Card Supported Command sets [S_CMD_SET: 0x01]
                      HPI Features [HPI_FEATURE: 0x01]: implementation based on CMD13
                      Background operations support [BKOPS_SUPPORT: 0x01]
                      Max Packet Read Cmd [MAX_PACKED_READS: 0x3f]
                      Max Packet Write Cmd [MAX_PACKED_WRITES: 0x3f]
                      Data TAG support [DATA_TAG_SUPPORT: 0x01]
                      Data TAG Unit Size [TAG_UNIT_SIZE: 0x03]
                      Tag Resources Size [TAG_RES_SIZE: 0x03]
                      Context Management Capabilities [CONTEXT_CAPABILITIES: 0x05]
                      Large Unit Size [LARGE_UNIT_SIZE_M1: 0x00]
                      Extended partition attribute support [EXT_SUPPORT: 0x00]
                      Generic CMD6 Timer [GENERIC_CMD6_TIME: 0x19]
                      Power off notification [POWER_OFF_LONG_TIME: 0x64]
                      Cache Size [CACHE_SIZE] is 0 KiB
                      Background operations status [BKOPS_STATUS: 0x00]
                      1st Initialisation Time after programmed sector [INI_TIMEOUT_AP: 0x0a]
                      Power class for 52MHz, DDR at 3.6V [PWR_CL_DDR_52_360: 0x22]
                      Power class for 52MHz, DDR at 1.95V [PWR_CL_DDR_52_195: 0x00]
                      Power class for 200MHz at 3.6V [PWR_CL_200_360: 0x00]
                      Power class for 200MHz, at 1.95V [PWR_CL_200_195: 0x00]
                      Minimum Performance for 8bit at 52MHz in DDR mode:
                      [MIN_PERF_DDR_W_8_52: 0x00]
                      [MIN_PERF_DDR_R_8_52: 0x00]
                      TRIM Multiplier [TRIM_MULT: 0x0e]
                      Secure Feature support [SEC_FEATURE_SUPPORT: 0x55]
                      Boot Information [BOOT_INFO: 0x07]
                      Device supports alternative boot method
                      Device supports dual data rate during boot
                      Device supports high speed timing during boot
                      Boot partition size [BOOT_SIZE_MULTI: 0x10]
                      Access size [ACC_SIZE: 0x08]
                      High-capacity erase unit size [HC_ERASE_GRP_SIZE: 0x04]
                      i.e. 2048 KiB
                      High-capacity erase timeout [ERASE_TIMEOUT_MULT: 0x0e]
                      Reliable write sector count [REL_WR_SEC_C: 0x01]
                      High-capacity W protect group size [HC_WP_GRP_SIZE: 0x08]
                      i.e. 16384 KiB
                      Sleep current (VCC) [S_C_VCC: 0x08]
                      Sleep current (VCCQ) [S_C_VCCQ: 0x07]
                      Sleep/awake timeout [S_A_TIMEOUT: 0x13]
                      Sector Count [SEC_COUNT: 0x00e90000]
                      Device is block-addressed
                      Minimum Write Performance for 8bit:
                      [MIN_PERF_W_8_52: 0x0a]
                      [MIN_PERF_R_8_52: 0x0a]
                      [MIN_PERF_W_8_26_4_52: 0x0a]
                      [MIN_PERF_R_8_26_4_52: 0x0a]
                      Minimum Write Performance for 4bit:
                      [MIN_PERF_W_4_26: 0x0a]
                      [MIN_PERF_R_4_26: 0x0a]
                      Power classes registers:
                      [PWR_CL_26_360: 0x22]
                      [PWR_CL_52_360: 0x22]
                      [PWR_CL_26_195: 0x00]
                      [PWR_CL_52_195: 0x00]
                      Partition switching timing [PARTITION_SWITCH_TIME: 0x03]
                      Out-of-interrupt busy timing [OUT_OF_INTERRUPT_TIME: 0x19]
                      I/O Driver Strength [DRIVER_STRENGTH: 0x01]
                      Enhanced Strobe mode [STROBE_SUPPORT: 0x00]
                      Card Type [CARD_TYPE: 0x07]
                      HS Dual Data Rate eMMC @52MHz 1.8V or 3VI/O
                      HS eMMC @52MHz - at rated device voltage(s)
                      HS eMMC @26MHz - at rated device voltage(s)
                      CSD structure version [CSD_STRUCTURE: 0x02]
                      Command set [CMD_SET: 0x00]
                      Command set revision [CMD_SET_REV: 0x00]
                      Power class [POWER_CLASS: 0x02]
                      High-speed interface timing [HS_TIMING: 0x01]
                      Erased memory content [ERASED_MEM_CONT: 0x00]
                      Boot configuration bytes [PARTITION_CONFIG: 0x03]
                      Not boot enable
                      R/W Replay Protected Memory Block (RPMB)
                      Boot config protection [BOOT_CONFIG_PROT: 0x00]
                      Boot bus Conditions [BOOT_BUS_CONDITIONS: 0x00]
                      High-density erase group definition [ERASE_GROUP_DEF: 0x01]
                      Boot write protection status registers [BOOT_WP_STATUS]: 0x00
                      Boot Area Write protection [BOOT_WP]: 0x00
                      Power ro locking: possible
                      Permanent ro locking: possible
                      partition 0 ro lock status: not locked
                      partition 1 ro lock status: not locked
                      User area write protection register [USER_WP]: 0x00
                      FW configuration [FW_CONFIG]: 0x00
                      RPMB Size [RPMB_SIZE_MULT]: 0x10
                      Write reliability setting register [WR_REL_SET]: 0x1f
                      user area: the device protects existing data if a power failure occurs during a write operation
                      partition 1: the device protects existing data if a power failure occurs during a write operation
                      partition 2: the device protects existing data if a power failure occurs during a write operation
                      partition 3: the device protects existing data if a power failure occurs during a write operation
                      partition 4: the device protects existing data if a power failure occurs during a write operation
                      Write reliability parameter register [WR_REL_PARAM]: 0x05
                      Device supports writing EXT_CSD_WR_REL_SET
                      Device supports the enhanced def. of reliable write
                      Enable background operations handshake [BKOPS_EN]: 0x00
                      H/W reset function [RST_N_FUNCTION]: 0x00
                      HPI management [HPI_MGMT]: 0x00
                      Partitioning Support [PARTITIONING_SUPPORT]: 0x01
                      Device support partitioning feature
                      Device cannot have enhanced tech.
                      Max Enhanced Area Size [MAX_ENH_SIZE_MULT]: 0x0000e9
                      i.e. 3817472 KiB
                      Partitions attribute [PARTITIONS_ATTRIBUTE]: 0x00
                      Partitioning Setting [PARTITION_SETTING_COMPLETED]: 0x00
                      Device partition setting NOT complete
                      General Purpose Partition Size
                      [GP_SIZE_MULT_4]: 0x000000
                      [GP_SIZE_MULT_3]: 0x000000
                      [GP_SIZE_MULT_2]: 0x000000
                      [GP_SIZE_MULT_1]: 0x000000
                      Enhanced User Data Area Size [ENH_SIZE_MULT]: 0x000000
                      i.e. 0 KiB
                      Enhanced User Data Start Address [ENH_START_ADDR]: 0x00000000
                      i.e. 0 bytes offset
                      Bad Block Management mode [SEC_BAD_BLK_MGMNT]: 0x00
                      Periodic Wake-up [PERIODIC_WAKEUP]: 0x00
                      Program CID/CSD in DDR mode support [PROGRAM_CID_CSD_DDR_SUPPORT]: 0x01
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[127]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[126]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[125]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[124]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[123]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[122]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[121]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[120]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[119]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[118]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[117]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[116]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[115]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[114]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[113]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[112]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[111]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[110]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[109]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[108]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[107]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[106]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[105]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[104]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[103]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[102]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[101]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[100]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[99]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[98]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[97]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[96]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[95]]: 0x02
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[94]]: 0x09
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[93]]: 0x04
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[92]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[91]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[90]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[89]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[88]]: 0x09
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[87]]: 0x08
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[86]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[85]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[84]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[83]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[82]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[81]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[80]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[79]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[78]]: 0x72
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[77]]: 0x35
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[76]]: 0x35
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[75]]: 0x69
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[74]]: 0x32
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[73]]: 0x32
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[72]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[71]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[70]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[69]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[68]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[67]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[66]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[65]]: 0x00
                      Vendor Specific Fields [VENDOR_SPECIFIC_FIELD[64]]: 0x00
                      Native sector size [NATIVE_SECTOR_SIZE]: 0x00
                      Sector size emulation [USE_NATIVE_SECTOR]: 0x00
                      Sector size [DATA_SECTOR_SIZE]: 0x00
                      1st initialization after disabling sector size emulation [INI_TIMEOUT_EMU]: 0x00
                      Class 6 commands control [CLASS_6_CTRL]: 0x00
                      Number of addressed group to be Released[DYNCAP_NEEDED]: 0x00
                      Exception events control [EXCEPTION_EVENTS_CTRL]: 0x0000
                      Exception events status[EXCEPTION_EVENTS_STATUS]: 0x0000
                      Extended Partitions Attribute [EXT_PARTITIONS_ATTRIBUTE]: 0x0000
                      Context configuration [CONTEXT_CONF[51]]: 0x00
                      Context configuration [CONTEXT_CONF[50]]: 0x00
                      Context configuration [CONTEXT_CONF[49]]: 0x00
                      Context configuration [CONTEXT_CONF[48]]: 0x00
                      Context configuration [CONTEXT_CONF[47]]: 0x00
                      Context configuration [CONTEXT_CONF[46]]: 0x00
                      Context configuration [CONTEXT_CONF[45]]: 0x00
                      Context configuration [CONTEXT_CONF[44]]: 0x00
                      Context configuration [CONTEXT_CONF[43]]: 0x00
                      Context configuration [CONTEXT_CONF[42]]: 0x00
                      Context configuration [CONTEXT_CONF[41]]: 0x00
                      Context configuration [CONTEXT_CONF[40]]: 0x00
                      Context configuration [CONTEXT_CONF[39]]: 0x00
                      Context configuration [CONTEXT_CONF[38]]: 0x00
                      Context configuration [CONTEXT_CONF[37]]: 0x00
                      Packed command status [PACKED_COMMAND_STATUS]: 0x00
                      Packed command failure index [PACKED_FAILURE_INDEX]: 0x00
                      Power Off Notification [POWER_OFF_NOTIFICATION]: 0x00
                      Control to turn the Cache ON/OFF [CACHE_CTRL]: 0x00
                      [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: mmc extcsd read /dev/mmcsd0rpmb | egrep "EOL"
                      [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root: mmc extcsd read /dev/mmcsd0rpmb | egrep "LIFE"
                      [23.05.1-RELEASE][root@pfSense-test-8sep23.home.arpa]/root:
                      

                      Pete
                      Home: SG-2100 + UniFi + Synology. SG-1100 retired
                      Parents: SG-1100 + UniFi + Synology
                      Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        I can certainly try. That is odd that it doesn't show all the output from mmcuntils. Though there have been several different eMMC chips used.
                        What does yours report for the MMC version at the top?

                        Extended CSD rev 1.8 (MMC 5.1)
                        
                        1 Reply Last reply Reply Quote 0
                        • stephenw10S
                          stephenw10 Netgate Administrator
                          last edited by

                          Oh cross posted. Yes you have an early version with the MMC 4.5 chip. That doesn't report lifetime data.

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post
                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.