Slow PPPoE on WAN
-
I've just been given a static IP from my new ISP, but it requires the use of PPPoE to obtain.
It's a fiber connection with 1gb speeds up/down. When I connected via DHCP from my PFSense box to my network, these were the average speedtest results I would see (give or take a few mb):
root@pve:~# speedtest-cli --secure Retrieving speedtest.net configuration... Testing from ... Retrieving speedtest.net server list... Selecting best server based on ping... Hosted by XMission (Salt Lake City, UT) [37.97 km]: 2.49 ms Testing download speed................................................................................ Download: 922.11 Mbit/s Testing upload speed...................................................................................................... Upload: 879.10 Mbit/s
However, when I changed my WAN IPv4 settings to PPPoE, I get this (or within single digits Mbit/s every time):
root@pve:~# speedtest-cli --secure Retrieving speedtest.net configuration... Testing from ... Retrieving speedtest.net server list... Selecting best server based on ping... Hosted by XMission (Salt Lake City, UT) [10.40 km]: 6.09 ms Testing download speed................................................................................ Download: 504.71 Mbit/s Testing upload speed...................................................................................................... Upload: 712.70 Mbit/s
Almost half. It sits at 498-507 down, every time. I have everything default, except for my username and password. Those are the only settings I entered after selecting PPPoE.
The kicker is, I have a laptop with Fedora 36/Gnome. I plugged that laptop right into the port on the ISP device (before PFSense). I setup DSL/PPPoE on my network settings. FAST. Almost exactly as the DHCP results above. Over 900 every time.
So what is my PFSense box doing differently? Is there some setting I need that is not the default? I've tried to compare the available settings with those of my Fedora laptop. I don't see anything I've got different.
Thanks!
P.S.: The box is quite powerful. CPU runs at about 2-5%, maybe spikes to 20% now and then, memory at 4-5%.
-
PPPoE is effectively single threaded so it's probably hitting a single core limit:
https://docs.netgate.com/pfsense/en/latest/hardware/tune.html#pppoe-with-multi-queue-nicsThough at 5% total that would have to be a lot of cores! What CPU is it? What NICs are you using?
Setting net.isr.dispatch to deferred as shown in that doc will help though.
Steve