1Gb to 10Gb slow

Dredex

Hi there

Pfsense 2.4.4-RELEASE-p3
Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz
Supermicro X11SSL-F
Dual Port 1Gb I210-AT (2 x ISP 1000/500Mb)
Dual Port 10Gb X520-DA2 (1 x LAN with multiple vlans)
Packages
-acme
-bandwidthd
-haproxy
-iperf
-mailreport
-nmap
-ntopng
-snort
Only checksum offload is enable the rest are disabled.

Switch DLINK GDS1510-52

My problem is that when I try a speed test from a PC connected to the switch at 1Gb speed the download varies from 250 to 600Mb/s but if I try a speed test from a PC connected to 10Gb I can max one ISP, if I load balance the connections I can get 1.7Gb/s.

The problem is only for the PC`s connected at 1Gb/s.

Iperf 2
PC's connected to 1Gb/s can max out download 1Gb/s but only 700Mb/s for upload. (maxes one core on PC when uploading)
PC's connected to 10Gb/s can download with 3.5Gb/s and upload with 1.5Gb/s (sometimes upload is 3Gb/s dont know why not always...)

stephenw10

@Dredex said in 1Gb to 10Gb slow:

DLINK GDS1510-52

Testing via that switch in both cases? Both 10G ports to the switch?

How are you testing when you only see 250-600Mbps?

How are you testing using iperf2? Where to?

Steve

Dredex

"Testing via that switch in both cases? Both 10G ports to the switch?"
Yes, all connections are on the dlink switch

"How are you testing when you only see 250-600Mbps?"
Our ISP has an online speed test through browser

"How are you testing using iperf2? Where to?"
pfsense (iperf package) and PC

I know its not the best option to test but idk a better way...

stephenw10

Hmm, OK I would use iperf3 from the CLI if you have to test to/from pfSense itself.

pkg install iperf3
rehash

That's never a great test though. Test from a 1Gb connected client to some other device if you can. Something else connected at 10G would be best just to confirm there is no problem in the switch or cabling there.

There are public iperf servers you can test against that should be fine for 1G. Not sure about more though...

Steve

Dredex

with iperf3 I have

PC(1Gb) to pfsense(10Gb) 1Gb/s down and 1Gb/s up
PC(10Gb) to pfsense(10Gb) 3.5Gb/s down and 3.0Gb/s up

Checked switch statistics and there are no errors, pause frames on any interface.
On the 10Gb we have multiple DAC's and we changed them and did not see any difference.

stephenw10

Hmm, then I would be testing against an external iperf server next if you can.

Steve