Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Average writes to Disk

    Scheduled Pinned Locked Moved General pfSense Questions
    71 Posts 13 Posters 16.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • johnpozJ
      johnpoz LAYER 8 Global Moderator @fireodo
      last edited by johnpoz

      @fireodo what ssd are you using? Modern SSD even with 20GB a day you should still be like a 10 year lifespan..

      I just looked up a shit $20 128GB ssd from lexar the ns100, and it lists 60TB write life.. at 20GB a day your still looking at 8 some years..

      Off the cuff 20GB a day does seem like a lot... But even at that you should get decent life out of the SSD..

      An intelligent man is sometimes forced to be drunk to spend time with his fools
      If you get confused: Listen to the Music Play
      Please don't Chat/PM me for help, unless mod related
      SG-4860 24.11 | Lab VMs 2.8, 24.11

      fireodoF 1 Reply Last reply Reply Quote 0
      • fireodoF
        fireodo @johnpoz
        last edited by fireodo

        @johnpoz said in Average writes to Disk:

        what ssd are you using?

        See my signature :-)

        I already ordered some spare for ... just in case ;-)

        Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
        SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
        pfsense 2.8.0 CE
        Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

        johnpozJ 1 Reply Last reply Reply Quote 0
        • johnpozJ
          johnpoz LAYER 8 Global Moderator @fireodo
          last edited by

          @fireodo I don't see anything listed for 16GB size.. But the 64 is listed as

          36.5TBW (64GB)

          So you have to assume lower than that.. So yeah, prob not the best drives for lots of writes..

          Lets call it half that.. Your looking at like 2.5 years only..

          An intelligent man is sometimes forced to be drunk to spend time with his fools
          If you get confused: Listen to the Music Play
          Please don't Chat/PM me for help, unless mod related
          SG-4860 24.11 | Lab VMs 2.8, 24.11

          fireodoF 2 Replies Last reply Reply Quote 0
          • fireodoF
            fireodo @johnpoz
            last edited by

            @johnpoz said in Average writes to Disk:

            @fireodo I don't see anything listed for 16GB size.. But the 64 is listed as

            36.5TBW (64GB)

            So you have to assume lower than that.. So yeah, prob not the best drives for lots of writes..

            Lets call it half that.. Your looking at like 2.5 years only..

            Of course this all sounds reasonable but for me its strange that a older APU (that I have as quick replacement in case of hardware failure - i do much HomeOffice) with 2.4.5 shows insignificant writes to disk (also ZFS) far far away from 20GB/day.

            Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
            SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
            pfsense 2.8.0 CE
            Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

            1 Reply Last reply Reply Quote 0
            • AndyRHA
              AndyRH
              last edited by

              Extra space will get longer life, more room for TRIM to work with and at todays prices it is worth the investment IMHO.

              o||||o
              7100-1u

              fireodoF 1 Reply Last reply Reply Quote 0
              • fireodoF
                fireodo @AndyRH
                last edited by

                @andyrh said in Average writes to Disk:

                Extra space will get longer life, more room for TRIM to work with and at todays prices it is worth the investment IMHO.

                I understand that all very well - its the Researcher in me that wants to find out what the real cause of all that is! Eliminating the symptoms dont eliminate the ill (if it is one) ;-)

                Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                pfsense 2.8.0 CE
                Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

                1 Reply Last reply Reply Quote 0
                • AndyRHA
                  AndyRH
                  last edited by

                  @fireodo said in Average writes to Disk:

                  its the Researcher in me that wants to find out what the real cause of all that is!

                  Agreed.
                  Not everyone does that. I like to know how it works too.

                  o||||o
                  7100-1u

                  1 Reply Last reply Reply Quote 0
                  • fireodoF
                    fireodo @johnpoz
                    last edited by

                    @johnpoz Is this process telling you (or somebody else) something?

                    zpool-zroot{txg_thread_enter}

                    This process is doing very much writing when I use
                    top -SH -o write (and after that "m")

                    Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                    SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                    pfsense 2.8.0 CE
                    Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

                    johnpozJ 1 Reply Last reply Reply Quote 0
                    • johnpozJ
                      johnpoz LAYER 8 Global Moderator @fireodo
                      last edited by johnpoz

                      I see that pop up every few seconds on mine as well

                      zpool.png

                      But I have no idea what it is or does to be honest..

                      Maybe a zfs guru will chime in - that sure isn't me ;)

                      An intelligent man is sometimes forced to be drunk to spend time with his fools
                      If you get confused: Listen to the Music Play
                      Please don't Chat/PM me for help, unless mod related
                      SG-4860 24.11 | Lab VMs 2.8, 24.11

                      fireodoF 1 Reply Last reply Reply Quote 0
                      • fireodoF
                        fireodo @johnpoz
                        last edited by

                        @johnpoz said in Average writes to Disk:

                        But I have no idea what it is or does to be honest..

                        I googled about it but I did not find anything concludent - that's why I was asking.

                        Would you show me your output of iostat -d 5 6 ?

                        Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                        SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                        pfsense 2.8.0 CE
                        Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

                        johnpozJ 1 Reply Last reply Reply Quote 0
                        • johnpozJ
                          johnpoz LAYER 8 Global Moderator @fireodo
                          last edited by

                          here you go - but I don't have a ssd, this is on a netgate sg4860

                          output.png

                          An intelligent man is sometimes forced to be drunk to spend time with his fools
                          If you get confused: Listen to the Music Play
                          Please don't Chat/PM me for help, unless mod related
                          SG-4860 24.11 | Lab VMs 2.8, 24.11

                          fireodoF 1 Reply Last reply Reply Quote 0
                          • fireodoF
                            fireodo @johnpoz
                            last edited by

                            @johnpoz said in Average writes to Disk:

                            here you go - but I don't have a ssd, this is on a netgate sg4860

                            Thanks a lot - your values are similar to mine! You have also ZFS?

                            Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                            SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                            pfsense 2.8.0 CE
                            Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

                            johnpozJ 1 Reply Last reply Reply Quote 0
                            • johnpozJ
                              johnpoz LAYER 8 Global Moderator @fireodo
                              last edited by

                              Yeah zfs.. Like I said I agree that 20GB a day seems like a lot - if your doing your math right, etc. But even at that your typical ssd should have a long life anyway..

                              My desktop model sg4860 has eMMC not ssd.. Which also have limited life writes..

                              An intelligent man is sometimes forced to be drunk to spend time with his fools
                              If you get confused: Listen to the Music Play
                              Please don't Chat/PM me for help, unless mod related
                              SG-4860 24.11 | Lab VMs 2.8, 24.11

                              fireodoF 1 Reply Last reply Reply Quote 0
                              • fireodoF
                                fireodo @johnpoz
                                last edited by

                                @johnpoz said in Average writes to Disk:

                                My desktop model sg4860 has eMMC not ssd.. Which also have limited life writes..

                                Is that eMMC replaceable?

                                Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                pfsense 2.8.0 CE
                                Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

                                johnpozJ 1 Reply Last reply Reply Quote 0
                                • johnpozJ
                                  johnpoz LAYER 8 Global Moderator @fireodo
                                  last edited by johnpoz

                                  I don't think so - not easy... But I think there is something missing here on what is actually being written.

                                  So from my understanding zpool iostat shows total since boot..

                                  [21.05.1-RELEASE][admin@sg4860.local.lan]/: zpool iostat
                                                 capacity     operations    bandwidth
                                  pool        alloc   free   read  write   read  write
                                  ----------  -----  -----  -----  -----  -----  -----
                                  zroot        969M  25.1G      0     10    645   227K
                                  [21.05.1-RELEASE][admin@sg4860.local.lan]/: 
                                  

                                  My box has been up for days.. Since I updated it to 21.05.1

                                  Uptime 6 Days 02 Hours 12 Minutes 47 Seconds

                                  edit: Well that can not be since boot... Not exactly sure what that reads to be honest.. But if you have it report every 2 seconds.

                                  [21.05.1-RELEASE][admin@sg4860.local.lan]/: zpool iostat zroot 2
                                                 capacity     operations    bandwidth
                                  pool        alloc   free   read  write   read  write
                                  ----------  -----  -----  -----  -----  -----  -----
                                  zroot        970M  25.1G      0     10    645   227K
                                  zroot        970M  25.1G      0      0      0      0
                                  zroot        968M  25.1G      0     34      0   552K
                                  zroot        968M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0     35      0   624K
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0     38      0   532K
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0     33      0   602K
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0     34      0   520K
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0     33      0   618K
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0     33      0   531K
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0     33      0   621K
                                  zroot        967M  25.1G      0      0      0      0
                                  zroot        967M  25.1G      0      7      0   114K
                                  zroot        967M  25.1G      0     24      0   415K
                                  zroot        967M  25.1G      0      0      0      0
                                  

                                  An intelligent man is sometimes forced to be drunk to spend time with his fools
                                  If you get confused: Listen to the Music Play
                                  Please don't Chat/PM me for help, unless mod related
                                  SG-4860 24.11 | Lab VMs 2.8, 24.11

                                  fireodoF 1 Reply Last reply Reply Quote 0
                                  • fireodoF
                                    fireodo @johnpoz
                                    last edited by

                                    @johnpoz Here is my output - I'm also no ZFS expert!
                                    As far as I see not much different ...
                                    zpool iostat
                                    capacity operations bandwidth
                                    pool alloc free read write read write


                                    zroot 808M 11.7G 0 12 319 214K

                                    zpool iostat zroot 2
                                    capacity operations bandwidth
                                    pool alloc free read write read write


                                    zroot 807M 11.7G 0 12 319 214K
                                    zroot 808M 11.7G 0 35 0 623K
                                    zroot 808M 11.7G 0 30 0 432K
                                    zroot 808M 11.7G 0 1 0 8.00K
                                    zroot 808M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 36 0 535K
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 32 0 442K
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 2 0 28.0K
                                    zroot 807M 11.7G 0 35 0 618K
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 32 0 420K
                                    zroot 807M 11.7G 0 3 0 22.0K
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 35 0 486K
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 32 0 442K
                                    zroot 807M 11.7G 0 0 0 7.99K
                                    zroot 807M 11.7G 0 0 0 5.98K
                                    zroot 807M 11.7G 0 32 0 442K
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 806M 11.7G 0 1 0 14.0K
                                    zroot 806M 11.7G 0 2 0 28.0K
                                    zroot 806M 11.7G 0 1 0 14.0K
                                    zroot 807M 11.7G 0 33 0 442K
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 31 0 428K
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 0 0 0
                                    zroot 807M 11.7G 0 10 0 623K
                                    zroot 808M 11.7G 0 33 0 547K
                                    zroot 808M 11.7G 0 35 0 498K
                                    zroot 808M 11.7G 0 1 0 14.0K

                                    Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                    SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                    pfsense 2.8.0 CE
                                    Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

                                    M 1 Reply Last reply Reply Quote 0
                                    • M
                                      mcury Rebel Alliance @fireodo
                                      last edited by

                                      SG-3100 - 21.05.1 - pfblockerng dnsbl python mode enabled

                                      iostat -d 5 6
                                      6dd05033-bf0e-488b-816b-548dcdec0275-image.png

                                      dead on arrival, nowhere to be found.

                                      fireodoF keyserK 2 Replies Last reply Reply Quote 0
                                      • fireodoF
                                        fireodo @mcury
                                        last edited by

                                        @mcury I guess FS is UFS and not ZFS ...

                                        Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                        SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                        pfsense 2.8.0 CE
                                        Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

                                        M 1 Reply Last reply Reply Quote 0
                                        • M
                                          mcury Rebel Alliance @fireodo
                                          last edited by

                                          @fireodo said in Average writes to Disk:

                                          @mcury I guess FS is UFS and not ZFS ...

                                          Indeed, UFS here, noatime in fstab

                                          dead on arrival, nowhere to be found.

                                          fireodoF 1 Reply Last reply Reply Quote 0
                                          • fireodoF
                                            fireodo @mcury
                                            last edited by

                                            @mcury said in Average writes to Disk:

                                            @fireodo said in Average writes to Disk:

                                            @mcury I guess FS is UFS and not ZFS ...

                                            Indeed, UFS here, noatime in fstab

                                            So it seams to cristallise that ZFS is the problem ...

                                            Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                            SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                            pfsense 2.8.0 CE
                                            Packages: Apcupsd, Cron, Iftop, Iperf, LCDproc, Nmap, pfBlockerNG, RRD_Summary, Shellcmd, Snort, Speedtest, System_Patches.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.