Low speed download on Fiber internet
-
Hi,
Using Pfsense 2.6.0-RELEASE (amd64) on Dell R440 (bare metal) without virtualisation.
R440 has 10G/Fiber ethernet and directly connected to ISP's Fiber Switch, line is 5Gbps, i've 200+ clients and LAN is connected to second 10G Fiber ethernet, it's distrubting through fiber to rooms and clients are using LAN sockets in their rooms to connect. Captive portal is disabled we are distributing internet directly without authorization.When i run speedtest-cli through command line on pfsense it returns 560Mbps Download / 230Mbps upload (latest results - performing speed test while LAN is disabled to avoid user load) and clients are complaining about slow internet connection.
Talked with isp about the problem and they've replaced their fiber switch with new one + cables etc. when they test the switch with their device there is 4.95Gbps bandwith (through sw to server's cable) but somehow pfsense can not get even 1gbps.
Replaced server's 10G fiber ethernet with new one, disabled/enabled "Disable hardware checksum offload" option, disabled/enabled "Disable hardware TCP segmentation offload" + "Disable hardware large receive offload" options but didn't solve the problem.
There are no traffic shapers, re-installed the pfsense 2 times and last one without backup as fresh install but result was the same.
What could cause this and where else i must check or test to solve it ?
-
it seems like you tested pretty well but here are some other ideas.
do an iperf3 from wan interface to lan interface.
or hook another system up using the same network card to your wan and try speedtest there.
try another speedtest host other than speedtest.net
are you glass or copper between isp device and r440?
-
@ipeetables Using glass (fiber) cable between isp sw & R440 server, R440 also one 1Gb classic ethernet port, strangely i can see 930mbps down - 800mbps on that port through speedtest.net, very strange situation
copper port gives 930mbps download but the fiber one between 230-400mbps
-
What NICs are those 10G interfaces?
Do you see errors in Status > Interfaces?
-
@stephenw10 said in Low speed download on Fiber internet:
What NICs are those 10G interfaces?
Do you see errors in Status > Interfaces?
No errors on status->interfaces
-
When you were testing at full speed you were using bxe NICs on both sides?
The CLI speedtest from pfSense itself always shows low but I wouldn't expect it to be that low. Especially since a client behind it can pull 1G.
-
@stephenw10 said in Low speed download on Fiber internet:
When you were testing at full speed you were using bxe NICs on both sides?
Yes both nics are bxe and it drives me crazy, isp checked everything, today they made another test with fiber speedtest device it shows 4.98Mbps for download but with pfsense i'm getting 600Mbps top.
-
Almost certainly some bxe quirk. That's quite dramatic though. Really feels like it's not linking at 10G with that sort of throttling. I assume the switches show 10G?
-
@stephenw10 said in Low speed download on Fiber internet:
Almost certainly some bxe quirk. That's quite dramatic though. Really feels like it's not linking at 10G with that sort of throttling. I assume the switches show 10G?
Exactly, they've changed switch twice and both old and new one shows as 10G, also changed the cable 3 times and NIC but didn't solved, really depressed about this :)
-
And a used or refurbed Intel 10 GBit/s card will not be
able to get hands on from your side?- 2 Port HPE 10 GBit/s SFP+ ~49 €
- 2 Port HPE 10 GBIt/s Eth (GBe) ~39 €
Both will be based on Intel chips and gives you perhaps
a better performance like the old ones now. -
You have an internal switch too though I assume? Is that showing 10G?
Yeah, I would go to Intel NICs if you can.
