VLAN Network performance Green to Orange on ESXi setup
-
I have some strange issue with my PFSense setup, any hints welcome !
I run my PFSense 2.4.2 in an ESXi environment.
I use VLAN for all networks (Blue, Red, Green and Orange (DMZ))
Green network has Squid transparent proxy setupLets assume I have an ESXI setup with 5 VMs
PFSense, O1, O2, G1 and G2
PFSense use VMX3 network adapter type
Other VMs use e1000
All VMs connected to the same vSwitch (Red is on own vSwitch and own network card (identical))O1 to O2 I get 5 Gbits / s
G1 to G2 I get 5 Gbits / sG1 to Internet I get 950 Mbits / s (really good ! Have 1Gbps connection)
O1 to internet I get 600 Mbits / s download, and 5 Mbits / s upload (so really bad upload)G1 to O1 I get about 3 MBits / s (iperf, really bad)
O1 to G1 (with hole in firewall added) I get about 3 MBits / s (iperf, really bad)I do see a somewhat high %VMWAIT on esxtop (spike 22%, but not continous)
The CPU load in PFSense seems quite normal (low)
I seen no issues with e.g. %waI got no clue how to debug further
I use the following settings for my igb network card
(based on info from the forum)kern.ipc.nmbclusters="1000000"
hw.igb.num_queues=0
kern.cam.boot_delay=10000
hw.igb.rxd=2048
hw.igb.txd=2048
net.pf.states_hashsize=524288
net.pf.source_nodes_hashsize=524288
hw.igb.fc_setting=0
hw.igb.rx_process_limit="-1"
hw.igb.tx_process_limit="-1"
net.inet.tcp.syncache.hashsize="2048"
net.inet.tcp.syncache.bucketlimit="16"
net.inet.tcp.syncache.cachelimit="32768" -
You disabled offload in the Advanced Tab as suggested?
-
No, I did not - because I misunderstood the instructions
Works now, huge thanks !