@keyser said in NVME Wear Rate on 6100:

https://forum.netgate.com/topic/195990/another-netgate-with-storage-failure-6-in-total-so-far/38?_=1744872979707

I agree that thread contains an excellent analysis of the problem described in this thread together with solutions, so probably a better place to continue this conversations.

Starting near the end is easiest https://forum.netgate.com/topic/195990/another-netgate-with-storage-failure-6-in-total-so-far/

Depending on what your specific use case is, it may last about the same time-span, maybe a little longer since its newer. Larger the capacity you go, the more bits there are to wear and the longer it will last without needing replaced again. I run a 4 disk 2TB raid-10 on my 5100, nearly three years into wear and currently are all at 95% life remaining. Also, always good to make sure to have a battery-backup unit in place connected to the box and with either nut or apcupsd configured for it on pfSense to make sure voltage fluctuations or surges aren't whats frying it early, having graceful shutdowns when these kinda of times come up can be quite critical for storage devices to avoid corruption.

@andrew_cb said in Another Netgate with storage failure, 6 in total so far:

Based on this data, changing the default value of zfs_txg_timeout to 10 or 15 will double the lifespan of devices with eMMC storage without causing too much data loss in the event of an unclean shutdown.

This is a great write-up. Thanks

Hmm, I haven't heard anything like that. Yeah anything the one I have here makes couldn't be heard above cabinet vent fans.

@stephenw10
Appreciate it. I just logged in and checked out what happens when you tell it to be static. I see all of the settings. Notice I had to add the gateway and set the CIDR. Simple enough!! It should go smoothly ;-)

@bumperjeep The Netgate 1100 and 2100 does not do anywhere near Gigabit when doing NAT and having the Firewall enabled. They do not have enough CPU power to handle the interrupt/packet rate.
I have a lot of experience with those units, and depending on you setup the 1100 will do a maximum of up to 500mbps. The 2100 will go a little higher because of the two NIC’s compared to only one on the 1100. The 2100 tops out in the very best cases at about 640mbps, but generally will do about 540mbps. If you want anything higher you will need to go netgate 4200 or higher.

@Gertjan

You did put me in de right direction. Did retry mounting the NVMe and made sure de Internet connection was functional (pppoe) and re-install with NVMe succeeded.

Thank you!

@rcoleman612

Haven’t really tried yet. Had other things going on. I’ll let you know. Thanks!

@petesei nice - how well does it fit on the 4200, is it less bowed top than it seems in the pics?

edit: oh I still owed you a picture - I might still do it, planning on pulling the rack out here when my replacement dock for my work laptop gets here so I can run a wire to the dock. Got back from my trip and it had died. I got a cheap hub off amazon to hold me so could still use both my monitors vs just the laptop screen.

But in mean time - I noticed on the link I gave they show exactly how I have mine setup ;)

picture.jpg

Oh and didn't mention before - I have my pi sitting on top of the fan, so it does double duty.. Dropped my pi temp quite a bit as well

pi.jpg

The pi dropped a good 15 F with sitting on top of the fan ;) if not 20..

@stbellcom How did you remove the eMMC from the 6100? I have a dead 6100 and would like to do the same. Thanks.

@arri THANK YOU! I lack the reputation needed to upvote your comment, but THANK YOU! I never even thought about ripping that chip out.

Here's my story:

Dec 25: router died. (Merry Christmas! At least it didn't harm too many other people.) Serial console worked; diagnosed a bad eMMC w/ help from TAC. Found an M.2 drive that worked, and reinstalled the OS then restored settings from backup.

March 30: Died again! This time the console's dead. Tried "everything".
Found your post mentioning desoldering it. Found a chip labeled "Kingston" and decided that must be it (but looked up part# to confirm). Attacked the face of the chip with a flamethrower, er, butane utility lighter, while mercilessly gouging and stabbing it with a sharp little screwdriver. Continued punishment until it flew screaming off the PCB, carrying PCB traces with it. Regretted not using more flame and less physical force. Scraped off traces still hanging on, ensured that nothing left on the board was touching anything that it shouldn't.

Powered it up with fire extinguisher nearby (and video camera running in case it went up in a glorious ball of flame and made my son scream as it tried to do to him what I did to it) and...it booted! Replaced heat sink grease (even dabbed some on the RAM chips that were naked before), wadded up a ball of masking tape and set it on top of the battery to replace the retainer clip that we broke earlier, and screwed everything back together.

Back in operation! No data loss this time -- best outcome possible. Lesson learned: A bad eMMC that was "harmless" before can become "harmful" 3 months later!

What switch do you have on the LAN side currently? Is it linked at 2.5G to the pfSense LAN and 1G to the clients?

Try setting the LAN side link to 1G when the WAN at 2.5G so the bandwidth change is in pfSense not the switch.

If it's in the switch you pretty much need flowcontrol active to avoid buffer overruns.

@johndoe102 I know it is boring but please add a switch between pfSense and your PC on LAN2 (the 4200 does not have a built-in switch, in contrast to the 2100).

The log shows LAN2/opt2/igc1 going up/down a few times in half a minute or so. That triggers a whole lot of scripts each time, wan restart is one of them. Removes and adds the gateway and so on.

The new installer version will have options to set the zpool name which also avoids that.

@johndoe102 said in Netgate 4200 thermal question:

In my case , my Netgate 4200 is placed in the basement with ambient temperature of 16-18 C and I also had about 50 C of the CPU temperature. So I decided to place a 140mm fan running all the time on top of the Netgate 4200 and now I have about 20-24 C

Screenshot from 2025-03-17 12-25-36.png

I had a similar situation with mine. Sticking a fan to the top cut the temps to about half.