How to achieve 10G speeds?
-
@jknott said in How to achieve 10G speeds?:
I suspect you may have a hardware or configuration issue.
Yes indeed, but how to troubleshoot it and find the bottleneck?
kind regards
-
@gelcom said in How to achieve 10G speeds?:
run an iPerf3 from Win10 client to pfsense server
Netgate posts often to not run a test to pfSense itself as it's not optimized for processing. Run your test to something on the Internet.
Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
Upvote 👍 helpful posts! -
I got close to a full Gb here, so he's definitely got a problem with his connection somewhere.
-
Yes, that^. Try to test to something other than pfSense directly. Some other local host connected at 10G would be best.
I suspect you're hitting an issue in the NUC though with that sort of restriction. That hardware for pfSense will be capable of multi gigabit even when also running iperf.126Mbps is woefully low for that, there is something fundamentally wrong there.
Steve
-
@steveits said in How to achieve 10G speeds?:
Run your test to something on the Internet.
My internet link is 100/50 so I assume this wouldn't tell me much.
-
@stephenw10 said in How to achieve 10G speeds?:
Try to test to something other than pfSense directly. Some other local host connected at 10G would be best.
I have another port of my T540-CR connected to a Proxmox Host so I run a connection from my Proxmox Host to pfSense and this time with the following results:
[SUM] 0.00-10.00 sec 10.7 GBytes 9.22 Gbits/sec 0 sender
[SUM] 0.00-10.00 sec 10.7 GBytes 9.21 Gbits/sec receiverIt seems that my local PC is unable to get 10g speeds even when connection shows 10G.
I apologize since this is not a pfSense related issue.
kind regards and thanks for the prompt support.
-
@gelcom said in How to achieve 10G speeds?:
It seems that my local PC is unable to get 10g speeds even when connection shows 10G.
That's why I asked if the hardware is up to it. As I mentioned, 10G is a lot and I've only seen it in data centers over fibre. In fact, in between speeds, such as 2.5 and 5 Gb have been introduced, as 10 was too much of a jump.
-
I’m not convinced it’s a computer power problem as when I run iperf I get only 15% CPU utilization. It’s a 32Gb i7. O would bet it’s something related to network connection or setup as I’m doing a Thunderbolt 3 to sfp+ fiber from PC (Intel NUC) to pfsense. I updated to latest firmware but still no good.
Problem is I have no idea how to troubleshoot it.
Kind regards
-
Well, you apparently have a computer that can handle 10G. Try iperf against it from that Windows box and see how the performance is. You've already ruled out issues with pfsense and it's hardware.
-
@gelcom said in How to achieve 10G speeds?:
I would bet it’s something related to network connection or setup as I’m doing a Thunderbolt 3 to sfp+ fiber from PC
Yes, me too. 126Mbps over a 10G link is something fundamentally mismatched.
Can you swap the NIC in the TB adapter for a 1G device and test that?Steve
-
@stephenw10 said in How to achieve 10G speeds?:
Can you swap the NIC in the TB adapter for a 1G device and test that?
Changed both sides to 1G. Sames results:
[SUM] 0.00-10.01 sec 148 MBytes 124 Mbits/sec sender
[SUM] 0.00-10.01 sec 146 MBytes 123 Mbits/sec receiver -
Still over the same hardware though?
I'm not sure what sort of TB adapter you have. Like an external PCIe cage or a dedicated adapter NIC.I assume the NUC itself has a 1G NIC and that can get ~940Mbps?
Steve
-
@stephenw10 said in How to achieve 10G speeds?:
Still over the same hardware though?
Same hardware: from Intel NUC6i7KYK i7 6770hq to pfSense Xeon E5-2686 v4
I'm not sure what sort of TB adapter you have. Like an external PCIe cage or a dedicated adapter NIC.
It's a dedicated Thunderbolt to SFP+ adapter: QNAP T310G1S
I assume the NUC itself has a 1G NIC and that can get ~940Mbps?
You're right. NUC has a 1G NIC too. If I connect to pfSense from this NIC I also get same results:
[SUM] 0.00-10.00 sec 170 MBytes 142 Mbits/sec sender
[SUM] 0.00-10.00 sec 167 MBytes 140 Mbits/sec receiverIt seems problem is not with TB adapter as 1G NIC is also capped at <140Mbits/sec. Maybe a WIN10 config or hardware issue.
kind regards
-
Hmm, well that's good news, it implies the TB 10G adapter is not the cause so probably can be made to work. Unless you have some traffic shaping set in pfSense it's hard to see what might cause that. Something in Windows guess though I'm not sure what.
Steve
