SG-1100E LAN on iperf3 only 368 Mb/s

aselle

$ iperf3 -c 10.0.0.1
Connecting to host 10.0.0.1, port 5201
[  4] local 10.0.0.29 port 46516 connected to 10.0.0.1 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  38.8 MBytes   326 Mbits/sec    0    132 KBytes
[  4]   1.00-2.00   sec  40.9 MBytes   343 Mbits/sec    0    132 KBytes
[  4]   2.00-3.00   sec  42.0 MBytes   352 Mbits/sec    0    148 KBytes
[  4]   3.00-4.00   sec  42.0 MBytes   353 Mbits/sec    0    148 KBytes
[  4]   4.00-5.00   sec  41.5 MBytes   348 Mbits/sec    0    148 KBytes
[  4]   5.00-6.00   sec  44.1 MBytes   370 Mbits/sec    0    148 KBytes
[  4]   6.00-7.00   sec  40.9 MBytes   343 Mbits/sec    0    148 KBytes
[  4]   7.00-8.00   sec  38.0 MBytes   319 Mbits/sec    0    148 KBytes
[  4]   8.00-9.00   sec  38.8 MBytes   326 Mbits/sec    0    148 KBytes
[  4]   9.00-10.00  sec  41.7 MBytes   350 Mbits/sec    0    148 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   409 MBytes   343 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   409 MBytes   343 Mbits/sec                  receiver

I am running

2.4.5-RELEASE-p1 (arm64)
built on Tue Jun 02 17:44:41 EDT 2020
FreeBSD 11.3-STABLE

This seems to be slower than what others are getting to SG-1100E raw. This is on the same local subnet. I tried changing cables, simplifying my VLAN setup, etc. By comparison over the same switches between two machines, I get 800 Mbps

[  5] local 10.0.0.29 port 59504 connected to 10.0.0.39 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  71.3 MBytes   598 Mbits/sec
[  5]   1.00-2.00   sec  98.8 MBytes   828 Mbits/sec
[  5]   2.00-3.00   sec  97.5 MBytes   818 Mbits/sec
[  5]   3.00-4.00   sec   104 MBytes   873 Mbits/sec
[  5]   4.00-5.00   sec   101 MBytes   851 Mbits/sec
[  5]   5.00-6.00   sec  99.3 MBytes   833 Mbits/sec
[  5]   6.00-7.00   sec  79.7 MBytes   668 Mbits/sec
[  5]   7.00-8.00   sec  99.8 MBytes   837 Mbits/sec
[  5]   8.00-9.00   sec   106 MBytes   891 Mbits/sec
[  5]   9.00-10.00  sec   104 MBytes   870 Mbits/sec

Is there any optimizations to increase this throughput. Could it be performance has regressed since the original release of SG-1100E? I clearly don't expect to firewall at full gig-e. I don't have anything fancy turned on.

Rico

pfSense is not designed to act as (iperf) server or client, you need to test through pfSense, not as endpoint.

-Rico

aselle

Ok when testing between two Layer 3 subnets with packet filtering off I get
Packet filtering off: ~830+ Mbps
Packet filtering on: ~524 Mbps

So the value with packet filtering on still doesn't match this article
https://www.netgate.com/blog/netgates-new-sg-1100-punches-way-above-its-weight.html

Any optimization tunings that people typically use?

stephenw10

Between the two test machines directly on the same subnet you should be seeing at or very close to 941Mbps but it looks like you're not. Is there some other restriction there?

You might also try with 2 (or more) Parallel streams -P 2. The SG-1100 has a dual core CPU but is limited by using one NIC which can use only one queue.

Steve