NIC speed

maverick_slo

Hi!

I did a fresh install of 2.3 and restored config from previous 2.3 that was running on the same box.

Now the funny part.

Traffic between 2 em nics is limited to 100Mbit iperf below:

C:\iperf>iperf3 -c 172.16.16.245 -t 600
Connecting to host 172.16.16.245, port 5201
[  4] local 10.10.0.60 port 53618 connected to 172.16.16.245 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  11.5 MBytes  96.2 Mbits/sec
[  4]   1.00-2.01   sec  11.4 MBytes  94.4 Mbits/sec
[  4]   2.01-3.00   sec  11.1 MBytes  94.3 Mbits/sec
[  4]   3.00-4.00   sec  11.4 MBytes  95.3 Mbits/sec
[  4]   4.00-5.00   sec  11.2 MBytes  94.6 Mbits/sec
[  4]   5.00-6.01   sec  11.4 MBytes  94.6 Mbits/sec
[  4]   6.01-7.00   sec  11.1 MBytes  94.2 Mbits/sec
[  4]   7.00-8.00   sec  11.2 MBytes  94.2 Mbits/sec
[  4]   8.00-9.00   sec  11.4 MBytes  95.3 Mbits/sec
[  4]   9.00-10.00  sec  11.2 MBytes  94.5 Mbits/sec
[  4]  10.00-11.01  sec  11.4 MBytes  94.6 Mbits/sec
[  4]  11.01-12.01  sec  11.1 MBytes  93.7 Mbits/sec
[  4]  12.01-13.01  sec  11.4 MBytes  95.5 Mbits/sec
[  4]  13.01-14.00  sec  11.1 MBytes  93.6 Mbits/sec
[  4]  14.00-15.00  sec  11.4 MBytes  95.6 Mbits/sec
[  4]  15.00-16.01  sec  11.4 MBytes  94.6 Mbits/sec
[  4]  16.01-17.01  sec  11.2 MBytes  94.6 Mbits/sec
[  4]  17.01-18.00  sec  11.0 MBytes  92.8 Mbits/sec
[  4]  18.00-19.00  sec  11.5 MBytes  96.3 Mbits/sec
[  4]  19.00-20.00  sec  11.2 MBytes  94.6 Mbits/sec
[  4]  20.00-21.01  sec  11.4 MBytes  94.6 Mbits/sec
[  4]  21.01-22.00  sec  11.1 MBytes  94.1 Mbits/sec
[  4]  22.00-23.00  sec  11.2 MBytes  94.1 Mbits/sec
[  4]  23.00-24.00  sec  11.4 MBytes  95.5 Mbits/sec
[  4]  24.00-25.01  sec  11.4 MBytes  94.6 Mbits/sec
[  4]  25.01-26.00  sec  11.1 MBytes  94.2 Mbits/sec
[  4]  26.00-27.01  sec  11.4 MBytes  95.1 Mbits/sec
[  4]  27.01-28.01  sec  11.2 MBytes  94.2 Mbits/sec
[  4]  28.01-29.00  sec  11.2 MBytes  95.0 Mbits/sec
[  4]  29.00-30.01  sec  11.4 MBytes  94.6 Mbits/sec
[  4]  30.01-31.00  sec  11.1 MBytes  94.1 Mbits/sec
[  4]  31.00-32.01  sec  11.4 MBytes  95.1 Mbits/sec
[  4]  32.01-33.01  sec  11.2 MBytes  94.3 Mbits/sec
[  4]  33.01-34.00  sec  11.2 MBytes  94.6 Mbits/sec
[  4]  34.00-35.00  sec  11.1 MBytes  93.5 Mbits/sec
[  4]  35.00-36.00  sec  11.4 MBytes  95.1 Mbits/sec
[  4]  36.00-36.43  sec  4.75 MBytes  93.4 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-36.43  sec   411 MBytes  94.6 Mbits/sec                  sender
[  4]   0.00-36.43  sec  0.00 Bytes  0.00 bits/sec                  receiver

But this box is capable of 500 Mbits/sec and it already worked just fine when I first upgraded from 2.2.6 to 2.3

After clean install I have above situation.

Im confused :) Can anyone suggest something? I tried with offloading settings and it doesnt matter what I tick or untick, always the same 100 mbit speed :S

jimp

Perhaps you had some change to /boot/loader.conf or /boot/loader.conf.local that wouldn't have been backed up?

maverick_slo

Oh crap.
I have no idea what was there :S

jimp

Probably something from https://doc.pfsense.org/index.php/Tuning_and_Troubleshooting_Network_Cards#Intel_igb.284.29_and_em.284.29_Cards (or an older revision of the page), or who knows… could have been tweaks to the card queues, rx/tx queues/buffers, etc.

maverick_slo

It`s weird that limit is almost exactly 100Mbits :)
Everywhere it shows as gig ethernet…

maverick_slo

OMG Im such a dumbass. Why the hell Im working this on friday night geez.

OK, I tested on a virtual machine on server which has flaky DLINK NIC.

Sure, virtual machine was showing me 10Gig (default for Hyper-v guest) and after I checked actual NIC it was 100Mbit/s.

Tomorrow morning this NIC leaves for good.

Now speeds are OK again.

Sorry for the trouble.