Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Average writes to Disk

    Scheduled Pinned Locked Moved General pfSense Questions
    71 Posts 13 Posters 12.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • fireodoF
      fireodo @stephenw10
      last edited by

      @stephenw10 said in Average writes to Disk:

      What are you using to check the drive writes? What's the actual data it's giving you?

      On the one hand the smart value of LBA_written and on the other hand iostat -d 5 6.

      Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
      SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
      pfsense 2.7.2 CE
      Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

      1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by

        And what values are you actually seeing there?

        fireodoF 1 Reply Last reply Reply Quote 0
        • fireodoF
          fireodo @stephenw10
          last edited by stephenw10

          @stephenw10 said in Average writes to Disk:

          And what values are you actually seeing there?

          iostat -d 5 6
                       md0             ada0            pass0
            KB/t tps  MB/s   KB/t tps  MB/s   KB/t tps  MB/s
            0.00   0  0.00  15.55  14  0.21   0.38   0  0.00
            0.00   0  0.00  12.80  22  0.27   0.00   0  0.00
            0.00   0  0.00  14.67  15  0.21   0.00   0  0.00
            0.00   0  0.00  12.59  14  0.17   0.00   0  0.00
            0.00   0  0.00  14.67  14  0.20   0.00   0  0.00
            0.00   0  0.00  13.56  14  0.19   0.00   0  0.00
          

          Using mathematics it comes to about 20GB/day

          PS. On the LAB machine (the fresh 2.5.2 install) there are no other packages running. Basic pfsense.

          Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
          SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
          pfsense 2.7.2 CE
          Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

          1 Reply Last reply Reply Quote 0
          • S
            SteveITS Galactic Empire @stephenw10
            last edited by

            @stephenw10 said in Average writes to Disk:

            There was a bug at one time that was not mounting root as noatime

            I looked, as we have some older routers, and found a few.

            /dev/gptid/4eca01a4-9c0d-11e7-bbd9-0008a20cdf70 / ufs rw 1 1
            devfs /dev devfs rw 0 0
            /dev/md0 /var/run ufs rw 2 2
            devfs /var/dhcpd/dev devfs rw 0 0

            Just change rw to rw,noatime in /etc/fstab, and reboot?

            Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
            When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
            Upvote 👍 helpful posts!

            fireodoF 1 Reply Last reply Reply Quote 0
            • fireodoF
              fireodo @SteveITS
              last edited by fireodo

              @steveits said in Average writes to Disk:

              Just change rw to rw,noatime in /etc/fstab, and reboot?

              In /etc/fstab there is only that:

              "# Device Mountpoint FStype Options Dump Pass#
              /dev/ada0p2 none swap sw 0 0"

              And if you look in the beginning of the thread there is the output of mount -p - most every FS is mounted noatime.

              Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
              SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
              pfsense 2.7.2 CE
              Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

              stephenw10S 1 Reply Last reply Reply Quote 0
              • stephenw10S
                stephenw10 Netgate Administrator
                last edited by

                Yup, exactly, just edit the fstab if you have some that were created at that time.

                ZFS does write to the drive more than UFS by design. I'm not sure what might be done there.

                Enabling RAM disks reduces it significantly but you wouldn't want to do that with Snort and pfBlocker running.

                Steve

                fireodoF 2 Replies Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator @fireodo
                  last edited by

                  @fireodo said in Average writes to Disk:

                  In /etc/fstab there is only that:

                  Because you're running ZFS which doesn't use the fstab.

                  1 Reply Last reply Reply Quote 0
                  • fireodoF
                    fireodo @stephenw10
                    last edited by

                    @stephenw10 said in Average writes to Disk:

                    Enabling RAM disks reduces it significantly but you wouldn't want to do that with Snort and pfBlocker running.

                    That was my idea too but as you say - no way with snort&pfblockerNG ...

                    Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                    SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                    pfsense 2.7.2 CE
                    Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                    1 Reply Last reply Reply Quote 0
                    • fireodoF
                      fireodo @stephenw10
                      last edited by fireodo

                      @stephenw10 said in Average writes to Disk:

                      ZFS does write to the drive more than UFS by design.

                      Do you think that could be from ZFS? Because I have stopped most every service that can be stopped but the writings go on ...

                      On the other hand - is my installation so particular?

                      Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                      SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                      pfsense 2.7.2 CE
                      Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                      johnpozJ 1 Reply Last reply Reply Quote 0
                      • johnpozJ
                        johnpoz LAYER 8 Global Moderator @fireodo
                        last edited by johnpoz

                        @fireodo what ssd are you using? Modern SSD even with 20GB a day you should still be like a 10 year lifespan..

                        I just looked up a shit $20 128GB ssd from lexar the ns100, and it lists 60TB write life.. at 20GB a day your still looking at 8 some years..

                        Off the cuff 20GB a day does seem like a lot... But even at that you should get decent life out of the SSD..

                        An intelligent man is sometimes forced to be drunk to spend time with his fools
                        If you get confused: Listen to the Music Play
                        Please don't Chat/PM me for help, unless mod related
                        SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                        fireodoF 1 Reply Last reply Reply Quote 0
                        • fireodoF
                          fireodo @johnpoz
                          last edited by fireodo

                          @johnpoz said in Average writes to Disk:

                          what ssd are you using?

                          See my signature :-)

                          I already ordered some spare for ... just in case ;-)

                          Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                          SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                          pfsense 2.7.2 CE
                          Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                          johnpozJ 1 Reply Last reply Reply Quote 0
                          • johnpozJ
                            johnpoz LAYER 8 Global Moderator @fireodo
                            last edited by

                            @fireodo I don't see anything listed for 16GB size.. But the 64 is listed as

                            36.5TBW (64GB)

                            So you have to assume lower than that.. So yeah, prob not the best drives for lots of writes..

                            Lets call it half that.. Your looking at like 2.5 years only..

                            An intelligent man is sometimes forced to be drunk to spend time with his fools
                            If you get confused: Listen to the Music Play
                            Please don't Chat/PM me for help, unless mod related
                            SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                            fireodoF 2 Replies Last reply Reply Quote 0
                            • fireodoF
                              fireodo @johnpoz
                              last edited by

                              @johnpoz said in Average writes to Disk:

                              @fireodo I don't see anything listed for 16GB size.. But the 64 is listed as

                              36.5TBW (64GB)

                              So you have to assume lower than that.. So yeah, prob not the best drives for lots of writes..

                              Lets call it half that.. Your looking at like 2.5 years only..

                              Of course this all sounds reasonable but for me its strange that a older APU (that I have as quick replacement in case of hardware failure - i do much HomeOffice) with 2.4.5 shows insignificant writes to disk (also ZFS) far far away from 20GB/day.

                              Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                              SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                              pfsense 2.7.2 CE
                              Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                              1 Reply Last reply Reply Quote 0
                              • AndyRHA
                                AndyRH
                                last edited by

                                Extra space will get longer life, more room for TRIM to work with and at todays prices it is worth the investment IMHO.

                                o||||o
                                7100-1u

                                fireodoF 1 Reply Last reply Reply Quote 0
                                • fireodoF
                                  fireodo @AndyRH
                                  last edited by

                                  @andyrh said in Average writes to Disk:

                                  Extra space will get longer life, more room for TRIM to work with and at todays prices it is worth the investment IMHO.

                                  I understand that all very well - its the Researcher in me that wants to find out what the real cause of all that is! Eliminating the symptoms dont eliminate the ill (if it is one) ;-)

                                  Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                  SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                  pfsense 2.7.2 CE
                                  Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                                  1 Reply Last reply Reply Quote 0
                                  • AndyRHA
                                    AndyRH
                                    last edited by

                                    @fireodo said in Average writes to Disk:

                                    its the Researcher in me that wants to find out what the real cause of all that is!

                                    Agreed.
                                    Not everyone does that. I like to know how it works too.

                                    o||||o
                                    7100-1u

                                    1 Reply Last reply Reply Quote 0
                                    • fireodoF
                                      fireodo @johnpoz
                                      last edited by

                                      @johnpoz Is this process telling you (or somebody else) something?

                                      zpool-zroot{txg_thread_enter}

                                      This process is doing very much writing when I use
                                      top -SH -o write (and after that "m")

                                      Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                      SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                      pfsense 2.7.2 CE
                                      Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                                      johnpozJ 1 Reply Last reply Reply Quote 0
                                      • johnpozJ
                                        johnpoz LAYER 8 Global Moderator @fireodo
                                        last edited by johnpoz

                                        I see that pop up every few seconds on mine as well

                                        zpool.png

                                        But I have no idea what it is or does to be honest..

                                        Maybe a zfs guru will chime in - that sure isn't me ;)

                                        An intelligent man is sometimes forced to be drunk to spend time with his fools
                                        If you get confused: Listen to the Music Play
                                        Please don't Chat/PM me for help, unless mod related
                                        SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                                        fireodoF 1 Reply Last reply Reply Quote 0
                                        • fireodoF
                                          fireodo @johnpoz
                                          last edited by

                                          @johnpoz said in Average writes to Disk:

                                          But I have no idea what it is or does to be honest..

                                          I googled about it but I did not find anything concludent - that's why I was asking.

                                          Would you show me your output of iostat -d 5 6 ?

                                          Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                          SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                          pfsense 2.7.2 CE
                                          Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                                          johnpozJ 1 Reply Last reply Reply Quote 0
                                          • johnpozJ
                                            johnpoz LAYER 8 Global Moderator @fireodo
                                            last edited by

                                            here you go - but I don't have a ssd, this is on a netgate sg4860

                                            output.png

                                            An intelligent man is sometimes forced to be drunk to spend time with his fools
                                            If you get confused: Listen to the Music Play
                                            Please don't Chat/PM me for help, unless mod related
                                            SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                                            fireodoF 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.