I changed the vm settings and it seems to be all good now. :)
After reading the hardware requirements https://www.pfsense.org/hardware/:
501+ Mbps -> Multiple cores at > 2.0GHz are required. Server class hardware with PCI-e network adapters.
I ended up with more cores…
@johnpoz:
What are you hiding here, is that your pfsense setup? Why would its lan/wan be the same vswitch?
Well, yes… I am hiding the public dns/ip.
Arguably lan/wan on one vswitch doesn't make much sense and I will change that....
What are those other networks on each vswitch. I don't see more than 1 vm on those switches - so only pfsense?
So what is your Iperf THRU pfsense.. ie that is routing/firewalling.. Testing to pfsense IP is not a valid test of the performance of pfsense as a router/firewall its a test of how fast you could move a file to pfsense directly, etc.
I did a lot of file transfers and watched the traffic graph max out around 950 or something… I will do iperf through the pfsense as you recommend and report back tomorrow.
However I can mark the thread [SOLVED].
Thanks