Safety of using SFP Transceivers

louis2

Thanks, note that my main problem always have been noise!!!

I own a very capable Mikrotik CRS317 switch, but with a IHMO disgusting thermal design. Noisy fans really cooling nothing and and SFP+ cases without heat sinks. I did replace the fans with Noctua fans, does not help enough. And later on using a big Noctua fan in the lid of the case (that helps).

It was not the CPU which did ramp up the fans, it where SFP+ to RJ45 modules!
With as additional issue that the fans air stream can not cool those modules at all !

At this moment, I am not using the CRS317 with as main reason 'noise' .
(I am using a less capable but good completely silent TP-link SX3008F at the moment)

However for certain connections where fiber is no option, I will perhaps use SFP+ to RJ45 modules yes or no in combination with the CRS in the future, however only if that is possible without fan noise!

patient0

@louis2 said in Safety of using SFP Transceivers:

At this moment, I am not using the CRS317 with as main reason 'noise'

It's a bit off topic but: I'm very, very picky about noise, everything in my office is fanless.
I do use a CRS309 (and a UniFi USW-Aggregation), that is only 8 ports but for the price of the CRS317 (I also got one but too loud with RJ45 adapters) you can get two CRS309 :). 3 of the eight ports are with 10G RJ45 adapters.

Your TP-Link looks good too (and cheaper), are you happy with it?

tman222

Another option would be to go with a SFP+ to RJ45 media converter, e.g. something like this perhaps:

https://www.fs.com/products/101476.html?now_cid=1038

Uses a bit more power than just a SFP+ to RJ45 transceiver, but heat wouldn't be an issue.

I have used lower power SFP+ to RJ45 transceivers as well (if I recall correctly power consumption was around 1.8 watts or so) and never felt like they got excessively hot during operation.

keyser

@louis2 I know how you feel. I have the same pickyness/sensitivity for noise and everything is completely fanless with me because of it.
The only thing that does have fans are my Arube CX-6100 switch (replaced with noctua fans).
For the very same reason I’m using fiber and DAC cables for 10Gbe interlinking, but if you have no SFP+ ports and only 10Gbe RJ45 on the other end, then I get your problem.

It might not be the temperature of the SFP+ module that causes the fans to spin like crazy - just as often it’s because its not a 100% supported SFP+ module by the switch (where it can’t read the operating parameters of the module). Just so you know….

louis2

@patient0

Yep! Very happy!
However only eight ports.

louis2

@keyser

I did pull fiber optic to my servers and to my room and migrated all 10G in my "server room to fiber" as well. And placed a 2.5G main switch next to my 10G switch (Zyxel XMG1915-10E) in favor of less important connections. That setup is silent

Also a home build pfSense version in there using a near silent PC-setup.

rentis

Ended up going with a mediaconverter as the temp solution. Stumbled on a shop locally that was selling them with a warranty and 30 day return window. Was hesitant on them given what most people say about them but the return window at least gives me time to decide.

rentis

@stephenw10 I was, my biggest concern was the transceiver burning out the 10g SFP port on the pfsense box. The 6100 was a bit of a splurge to future proof for 10g and worried about anything that might reduce the lifespan.

stephenw10

Hmm, well I've not heard of that happening on a 6100. But I couldn't vouch for all transceivers.

pwood999

We use lots of different 10G SFP+ at work. They do certainly vary, but rarely have over heating issues as long as they are in a high end switch/router such as Juniper, Cisco, etc.

We did have quite bad over-heating issues in a TP-Link SX3008 switch. The problem was the SFP cages, so we modified the switch adding cheap self-adhesive heatsinks. Attached pictures show the main board before & after. Approx 20degC SFP temperature reduction.

2022-08-12 13.59.18 TP-Link.jpg 2022-08-13 17.32.41 TP-Link.jpg

luckman212

@stephenw10 I too had been using a 10GTek SFP+ module in my 6100 but was concerned about the very hot temps. The GUI reported module temps exceeding 70C which is nuts.

I researched and found these new FS.com "low power" (1.5W) modules and ordered one. It arrived yesterday from China and I was excited to see if it ran cool. Maybe it does run cooler, but it's still too hot to touch for more than 2 seconds, and the module does not self-report temps like the other one did, so I honestly have no idea. My cheap IR temp gun says it's 52C right now, but it feels as hot as the 10GTek one did.

stephenw10

Mmm, well 52 is quite a lot less than 70. But those things just run hot. They are designed to run hot and mostly work fine like that. I wouldn't want my phone running that hot but....

pwood999

As I said above, it depends a lot on the SFP cage mechanics. I don't know what the internals of the 6100 are, so cannot comment on that.

For example, here's the vendor types & temperatures for a variety of SFP+ in a Juniper EX-4600. Ambient in the room is about 20degC.

PIC port information:
Fiber Port Cable type 0 10GBASE ER 1 10GBASE LR 2 10GBASE ER 3 10GBASE LR 4 SFP28-25G-BASE-CU-5M 5 SFP28-25G-BASE-CU-5M 6 GIGE 1000T 8 10GBASE USR 9 10GBASE LR 10 GIGE 1000T 11 10GBASE ER 12 10GBASE ER 13 10GBASE LR 14 10GBASE LR 15 GIGE 1000T 21 10GBASE LR 22 10GBASE SR 23 GIGE 1000T Xcvr vendor Wave- Xcvr JNPR
type Xcvr vendor part number length Firmware Rev
SM Arista Networks SFP-10G-ER 1550 nm 0.0 2
SM FS SFP-10GLR-31 1310 nm 0.0
SM MENARA NETWORKS 5ER0P2U-1310 1310 nm 0.0
SM FINISAR CORP. FTLX1370W4BTL-E7 1310 nm 0.0
n/a JUNIPER-1P1 1P153A n/a 0.0 REV 01
n/a JUNIPER-1P1 1P153A n/a 0.0 REV 01
n/a FINISAR CORP. FCLF8521P2BTL-TR n/a 0.0
MM TIBITCOM TXM-MPOLT-01EES 1577 nm 0.0
SM SumitomoElectric SPP5300LR-J6-M 1310 nm 0.0 REV 01
n/a OEM GLC-T n/a 0.0
SM HI-OPTEL ECI HSFP101541LECI 1550 nm 0.0
SM PROLABS ER-SFP10G-47-LGI 1470 nm 0.0
SM LG1 SFP-10GE-LR 1310 nm 0.0
SM Arista Networks SFP-10G-LR 1310 nm 0.0 7
n/a OEM GLC-T n/a 0.0 ^x
SM FINISAR CORP. FTLX1475D3BNL-TR 1310 nm 0.0
MM LG1 SFP-10GE-SR 850 nm 0.0
n/a WORLDWIDEPACKETS XCVR-000CRJ n/a 0.0

{master:0}
reading-sw-01> show interfaces diagnostics optics | match temp | except high | except low
Module temperature : 40 degrees C / 105 degrees F
Module temperature : 38 degrees C / 101 degrees F
Module temperature : 36 degrees C / 96 degrees F
Module temperature : 40 degrees C / 104 degrees F
Module temperature : 44 degrees C / 111 degrees F
Module temperature : 34 degrees C / 94 degrees F
Module temperature : 41 degrees C / 106 degrees F
Module temperature : 34 degrees C / 94 degrees F
Module temperature : 30 degrees C / 87 degrees F
Module temperature : 35 degrees C / 95 degrees F
Module temperature : 34 degrees C / 92 degrees F
Module temperature : 29 degrees C / 84 degrees F
Module temperature : 33 degrees C / 91 degrees F
Module temperature : 32 degrees C / 89 degrees F

{master:0}

reading-sw-01> show chassis environment
Class Item Status Measurement
Power FPC 0 Power Supply 0 OK
FPC 0 Power Supply 1 Present
Temp FPC 0 Sensor TopMiddle C OK 47 degrees C / 116 degrees F
FPC 0 Sensor TopRight I OK 31 degrees C / 87 degrees F
FPC 0 Sensor TopLeft C OK 41 degrees C / 105 degrees F
FPC 0 Sensor TopRight C OK 29 degrees C / 84 degrees F
FPC 0 Sensor CPURight C OK 38 degrees C / 100 degrees F
FPC 0 Sensor CPULeft E OK 35 degrees C / 95 degrees F
FPC 0 Sensor CPU Die Temp OK 49 degrees C / 120 degrees F
FPC 0 Sensor QIC0 OK 38 degrees C / 100 degrees F
Fans FPC 0 Fan Tray 0 OK Spinning at normal speed
FPC 0 Fan Tray 1 OK Spinning at normal speed
FPC 0 Fan Tray 2 OK Spinning at normal speed
FPC 0 Fan Tray 3 OK Spinning at normal speed
FPC 0 Fan Tray 4 OK Spinning at normal speed

{master:0}

luckman212

@stephenw10 Thanks. I've already somewhat wrecked the SFP cage of my 6100... somehow the old module got stuck in there, and no amount of jiggling would release it. I just kept pulling on it until it eventually came loose. Now the modules no longer lock/click in place they just sort of slip in and out.

The thermals on the CPU itself seem "ok" and tend to hover right around 50C:

louis2

@luckman212

I just would like to add here, that the thermal design of many switches is ... bad not to say very bad.

The cooling of SFP+ cases should be much much better !! And earflow of fans should be routed along things which have to be cooled and not just blowing towards ... nothing!

I general like MikroTik but it also an example of bad thermal design. Worse it is very hard if not impossible to correct that with extra coal fins.

So complain towards the switch designers and if possible ...

use fiber
or SFP+ to 1G utp
or at least use the latest sfp+ to 10G modules''

Personally:
I migrated all 10G connections to fiber in my server cabinet. And also to 10G connections in other rooms .... not so easy.

And replaced the small fans in my Miktotik CRS317 with a 12 inch fan in an home made lid :(

But as said it is ridiculous that that is necessary!!

luckman212

@louis2 Not sure what Mikrotik has to do with this conversation, but yes I know that all 10G SFP+ RJ45 modules run hot. That's why I dropped $150 for what I thought would be the coolest-running of the bunch, since it was a new design, rated at 1.5W vs >2W for most of the cheap-o Amazon stuff like 10Gtek, Hi-Fiber etc.

Also, the 6100 is fanless, and actually has a pretty neat and clever thermal design with that giant metal plate/heatsink as its base...

tman222

I have been down this road as well. Tried various SFP+ to RJ45 transceivers, including a more expensive lower power consumption one (around 1.8W as I recall). It's interesting to see that module power consumption has been able to be reduced further down to 1.5W since the last time I looked into these. In my case, I ultimately decided just to purchase a 10Gbit RJ45 expansion card since I had an expansion slot available on the firewall and didn't want to worry about any heat or compatibility issues. I used to have fiber inside the rack as well, but have since switched to all DAC cables as the runs are short enough (less parts needed and saves a few more Watts this way without compromising performance).

pwood999

We run quite a few 10G RJ45 SFP in various Juniper & Cisco & Allied Telesys switches in our work lab with no heat issues. Most of them are between 30-40 DegC in a room with 22 ambient.

It's definitely the SFP cages in lower end switches.

You can get refurbished Juniper QFX-5100 or similar on eBay for << £400 these days, and will have no more heat issues.