Deleting the bond0 has left one interface intact with the correct IP address. So I was able to use the secondary interface to test speeds directly.
It seems pretty clear that pfsense is not the problem at all.
Getting the same speeds directly with a laptop directly connected to the NAS.
[image: 1639855781501-test.png]
Iperf3 test shows network is not the problem.
From Laptop to NAS
iperf 3.6
Linux nas 4.4.180+ #42218 SMP Mon Oct 18 19:16:01 CST 2021 aarch64
-----------------------------------------------------------
Server listening on 4444
-----------------------------------------------------------
Time: Sat, 18 Dec 2021 19:33:48 GMT
Accepted connection from 10.15.1.8, port 13951
Cookie: DESKTOP-VPJHHOI.1639856027.395816.51
TCP MSS: 0 (default)
[ 5] local 10.15.1.7 port 4444 connected to 10.15.1.8 port 13952
Starting Test: protocol: TCP, 1 streams, 131072 byte blocks, omitting 0 seconds, 10 second test, tos 0
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 106 MBytes 889 Mbits/sec
[ 5] 1.00-2.00 sec 111 MBytes 929 Mbits/sec
[ 5] 2.00-3.00 sec 110 MBytes 922 Mbits/sec
[ 5] 3.00-4.00 sec 111 MBytes 930 Mbits/sec
[ 5] 4.00-5.00 sec 111 MBytes 933 Mbits/sec
[ 5] 5.00-6.00 sec 110 MBytes 924 Mbits/sec
[ 5] 6.00-7.00 sec 109 MBytes 913 Mbits/sec
[ 5] 7.00-8.00 sec 110 MBytes 924 Mbits/sec
[ 5] 8.00-9.00 sec 109 MBytes 917 Mbits/sec
[ 5] 9.00-10.00 sec 112 MBytes 936 Mbits/sec
[ 5] 10.00-10.03 sec 3.90 MBytes 944 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval Transfer Bitrate
[ 5] (sender statistics not available)
[ 5] 0.00-10.03 sec 1.08 GBytes 922 Mbits/sec receiver
CPU Utilization: local/receiver 14.8% (0.6%u/14.1%s), remote/sender 0.0% (0.0%u/0.0%s)
rcv_tcp_congestion cubic
iperf 3.6
From NAS to Laptop
iperf 3.6
Linux nas 4.4.180+ #42218 SMP Mon Oct 18 19:16:01 CST 2021 aarch64
Control connection MSS 1460
Time: Sat, 18 Dec 2021 19:35:02 GMT
Connecting to host 10.15.1.8, port 4444
Cookie: yg6a4kxaczkaolqgasfxmaynim35ot3rbjro
TCP MSS: 1460 (default)
[ 5] local 10.15.1.7 port 32954 connected to 10.15.1.8 port 4444
Starting Test: protocol: TCP, 1 streams, 131072 byte blocks, omitting 0 seconds, 10 second test, tos 0
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 111 MBytes 934 Mbits/sec 0 211 KBytes
[ 5] 1.00-2.00 sec 108 MBytes 903 Mbits/sec 0 211 KBytes
[ 5] 2.00-3.00 sec 106 MBytes 887 Mbits/sec 0 211 KBytes
[ 5] 3.00-4.00 sec 107 MBytes 900 Mbits/sec 0 211 KBytes
[ 5] 4.00-5.00 sec 106 MBytes 891 Mbits/sec 0 211 KBytes
[ 5] 5.00-6.00 sec 104 MBytes 870 Mbits/sec 0 211 KBytes
[ 5] 6.00-7.00 sec 109 MBytes 911 Mbits/sec 0 211 KBytes
[ 5] 7.00-8.00 sec 107 MBytes 895 Mbits/sec 0 211 KBytes
[ 5] 8.00-9.00 sec 107 MBytes 901 Mbits/sec 0 211 KBytes
[ 5] 9.00-10.00 sec 107 MBytes 900 Mbits/sec 0 211 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.05 GBytes 899 Mbits/sec 0 sender
[ 5] 0.00-10.00 sec 1.05 GBytes 899 Mbits/sec receiver
CPU Utilization: local/sender 5.7% (0.4%u/5.3%s), remote/receiver 13.4% (6.5%u/6.9%s)
snd_tcp_congestion cubic
iperf Done.