Poor performance on igb driver
-
If we aren't talking about forwarding, but a client-server speed test, I can confirm igb does Gigabit fairly easy.
I just setup a spare port to test without forwarding, VLANs, firewall rules or netmap. Test done with iperf3, pfSense as server and I get an average of 936Mbits/sec both ways (-c -R).
loader.conf.local:
hw.igb.max_interrupt_rate="16000" hw.igb.rx_process_limit="-1" hw.igb.tx_process_limit="-1" hw.intr_storm_threshold="10000" net.link.ifqmaxlen="2048"
tunables:
dev.igb.0.eee_disabled 1 net.inet.tcp.hostcache.enable 0 - use this for tests only
-
@stephenw10 Did quite a bit of research with settings, tweaking them over and over again. Also installed other firewall/router OS distributions to isolate whether the problem was with PFSense itself, or is a hardware limitation on these boxes.
Long story short - I can safely say the Qotom J1900 cannot pass gigabit down/up in a practical, real world situation. The bottleneck isn't the CPU, but the PCIe lanes.
Having said that, I've no real practical application of a Gigabit up/down connection today - so putting this on the backburner and living with whatever >500mbps I'm getting, until I decide to upgrade this box.
-
Just to add in case people still have pppoe performance caps due to cpu power, make sure you enable powerd on units that support intel turbo.
Without powerd turbo clocks wont kick in. powerd isnt just for power saving.
Also it seems "some" igb chips do support rss properly with pppoe, I switched to a pppoe isp last month and see my rss is working properly on the igb driver. I have 2 queues for both isr and igb, the rx is almost a 50/50 split, and its tx thats lopsided at 90/10.
-
net.isr.dispatch=deferred
I just wanted to register and confirm that this worked really well for me after trawling for solutions online for days. I upgraded from 350/50 to 900/100 a few weeks back and it was bugging me that I couldn't access all the speed.
My setup is as follows:
BT Broadband Fibre 900 FTTP 900/100 (speed tests at 930-ish/120ish via BT Smart Hub 2)
PPPoE ONT
J1900 CPU - Asrock Q1900DC-ITX - 4gb ram
Intel i340-T4 Quad NIC (running in PCIe 2.0 x1 slot) (igb driver)Prior to using net.isr.dispatch=deferred, I was averaging 550-790/120 on Fast.com and Speedtest.net
I'm now getting full line speed. I'll never use it all but it was just bugging me that I couldn't access 100% of what I was paying for.
-
Finally, I've been looking for someone that has UK FTTP and runs a PFSense box that can keep up with the 900/100 service.
I have Zen and Fritzbox and whilst that keeps up I seem to have to reboot it now and again and I ideally want something a bit more secure and lets me monitor how my connection performs. Now I need to track down how I can re-create that setup.