pfSense on KVM slow network - upload speed

[nbnamp]

Need your help to figure out why upload speed passing through pfSense guest is not exceeding 4mbps on a 1G internet link.
I have a Centos 8 host with 2 network cards, 2 VMs: pfSense2.4.4 and ubuntu18.4

Setup:

ISP Router 192.168.2.1 --> Cisco SW Vlan 2 --> Centos8 BR0 192.168.2.241 (host NIC1) --> pfSense WAN NIC 192.168.2.242 (Source BR0 - Device model virtio)

pfSense LAN NIC 192.168.5.242 (Source BR1 - Device model virtio) -->Centos8 BR1 192.168.5.241 (host NIC2) -->Cisco SW Vlan5

Also on the same host running VM2 : Ubuntu 18.4 with 1x NIC on Vlan5
Ubuntu LAN NIC 192.168.5.102 (Source BR1 - Device model virtio) -->Centos8 BR1 192.168.5.241 (host NIC2)

Speed test:
CentOS has 2 1GB NICs and ISP internet speed 1GB up/down

Speed test from Centos -host
Testing download speed: Download: 918.25 Mbit/s
Testing upload speed: Upload: 710.98 Mbit/s

Speed test from pfSense KVM Guest1
Testing download speed: Download: 580.14 Mbit/s
Testing upload speed: Upload: 501.42 Mbit/s

Speed test from Ubuntu KVM Guest2
Testing download speed: Download: 859.21 Mbit/s
Testing upload speed: Upload: 4.06 Mbit/s

Pfsense is on out of box configuration : DHCP for Lan
Ubuntu is also out of box and DHCP client

Tried changing the KVM Device model to e1000e and rebooted everything - did not work

Any idea whats going on?

Thanks in advance

N

[kiokoman]

did you try iperf3 ? it may not be a kvm/ubuntu/pfsense problem

[nbnamp]

hi kiokoman
here are the iperf3 results:
from ubuntu to pfsense

ubuntu$ iperf3 -c 192.168.5.242
Connecting to host 192.168.5.242, port 5201
[ 4] local 192.168.5.102 port 48152 connected to 192.168.5.242 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 174 MBytes 1.46 Gbits/sec 0 950 KBytes
[ 4] 1.00-2.00 sec 149 MBytes 1.25 Gbits/sec 0 950 KBytes
[ 4] 2.00-3.00 sec 164 MBytes 1.37 Gbits/sec 0 950 KBytes
[ 4] 3.00-4.00 sec 149 MBytes 1.25 Gbits/sec 0 950 KBytes
[ 4] 4.00-5.00 sec 152 MBytes 1.28 Gbits/sec 0 1008 KBytes
[ 4] 5.00-6.00 sec 160 MBytes 1.34 Gbits/sec 0 1.20 MBytes
[ 4] 6.00-7.00 sec 180 MBytes 1.51 Gbits/sec 0 1.20 MBytes
[ 4] 7.00-8.00 sec 219 MBytes 1.83 Gbits/sec 0 1.20 MBytes
[ 4] 8.00-9.00 sec 191 MBytes 1.60 Gbits/sec 0 1.20 MBytes
[ 4] 9.00-10.00 sec 166 MBytes 1.39 Gbits/sec 0 1.20 MBytes

---

[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.66 GBytes 1.43 Gbits/sec 0 sender
[ 4] 0.00-10.00 sec 1.66 GBytes 1.42 Gbits/sec receiver

iperf Done
+++++++++++++++++++++++++
ubuntu$ speedtest
Testing download speed................................................................................
Download: 795.53 Mbit/s
Testing upload speed......................................................................................................
Upload: 4.12 Mbit/s

Thanks

[kiokoman]

iperf is working, try against some external services like
iperf3 -4 -c bouygues.iperf.fr

more servers here https://iperf.cc/

speedtest script never worked for me.

laboratorio@server:~$ speedtest
Retrieving speedtest.net configuration...
Testing from Wind Tre (151.xxx.xxx.xxx)...
Retrieving speedtest.net server list...
Selecting best server based on ping...
Hosted by E4A s.r.l. (Padova) [66.70 km]: 18.242 ms
Testing download speed................................................................................
Download: 42.92 Mbit/s
Testing upload speed......................................................................................................
Upload: 3.10 Mbit/s

upload is totaly wrong for me, download also is more less of what i have

[nbnamp]

Here are the iperf3 tests results:
Test#1
ubuntu:~$ iperf3 -4 -c bouygues.iperf.fr
Connecting to host bouygues.iperf.fr, port 5201
[ 4] local 192.168.5.102 port 45186 connected to 89.84.1.222 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 3.33 MBytes 27.9 Mbits/sec 55 260 KBytes
[ 4] 1.00-2.00 sec 2.72 MBytes 22.8 Mbits/sec 0 305 KBytes
[ 4] 2.00-3.00 sec 3.09 MBytes 25.9 Mbits/sec 0 335 KBytes
[ 4] 3.00-4.00 sec 3.65 MBytes 30.6 Mbits/sec 0 352 KBytes
[ 4] 4.00-5.00 sec 3.52 MBytes 29.5 Mbits/sec 0 360 KBytes
[ 4] 5.00-6.00 sec 3.52 MBytes 29.5 Mbits/sec 0 361 KBytes
[ 4] 6.00-7.00 sec 3.65 MBytes 30.6 Mbits/sec 0 361 KBytes
[ 4] 7.00-8.00 sec 3.71 MBytes 31.1 Mbits/sec 0 363 KBytes
[ 4] 8.00-9.00 sec 3.58 MBytes 30.1 Mbits/sec 0 368 KBytes
[ 4] 9.00-10.00 sec 3.83 MBytes 32.2 Mbits/sec 0 381 KBytes

---

[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 34.6 MBytes 29.0 Mbits/sec 55 sender
[ 4] 0.00-10.00 sec 32.9 MBytes 27.6 Mbits/sec receiver

iperf Done.

Test#2
ubuntu:~$ iperf3 -4 -c bouygues.iperf.fr
Connecting to host bouygues.iperf.fr, port 5201
[ 4] local 192.168.5.102 port 45206 connected to 89.84.1.222 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 4.95 MBytes 41.5 Mbits/sec 154 415 KBytes
[ 4] 1.00-2.00 sec 4.45 MBytes 37.3 Mbits/sec 0 481 KBytes
[ 4] 2.00-3.00 sec 4.88 MBytes 41.0 Mbits/sec 0 526 KBytes
[ 4] 3.00-4.00 sec 5.25 MBytes 44.1 Mbits/sec 0 557 KBytes
[ 4] 4.00-5.00 sec 5.50 MBytes 46.1 Mbits/sec 0 574 KBytes
[ 4] 5.00-6.00 sec 5.62 MBytes 47.2 Mbits/sec 0 584 KBytes
[ 4] 6.00-7.00 sec 5.87 MBytes 49.3 Mbits/sec 0 585 KBytes
[ 4] 7.00-8.00 sec 5.69 MBytes 47.7 Mbits/sec 0 585 KBytes
[ 4] 8.00-9.00 sec 5.81 MBytes 48.7 Mbits/sec 0 585 KBytes
[ 4] 9.00-10.00 sec 5.99 MBytes 50.3 Mbits/sec 0 592 KBytes

---

[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 54.0 MBytes 45.3 Mbits/sec 154 sender
[ 4] 0.00-10.00 sec 51.2 MBytes 42.9 Mbits/sec receiver

iperf Done.

Thanks
N