download does not exceed 50Mbps on a 300Mbps line
-
Hi All,
I am a bit stuck and have spend a decent amount of time on this, maybe a second pair eyes and more experience folks can point me in the right direction.
I have PFSense 2.7.2 installed on a Mac Mini with the following:
Intel(R) Core(TM) i7-3615QM CPU @ 2.30GHz Current: 2300 MHz, Max: 2301 MHz 8 CPUs: 1 package(s) x 4 core(s) x 2 hardware threads AES-NI CPU Crypto: Yes (inactive) QAT Crypto: NoI have the following setup:
ATT Modem 2.5G --> ue0 2.5GB (USB3.1 Mac Mini)
LAN --> bge1 (1GB) --> HP Procurve (1GB)
VLAN --> On bge1The ATT Modem connects to Mac Mini via the USB 2.5G USB adapter, the ATT Modem detects as 2.5G and the PFSense appears to be also identifying as autoselect. From There bge1 sends all the VLAN to the HP Switch via bge1.
No matter what I do, the download speed on the PFSense does not go over 50Mbps. I tested the switch by plugging directly from the ATT Modem to the switch and I get 366Mbps up and down. The switch appears to be working as expected.
I also added all the tuneables for bge from [https://docs.netgate.com/pfsense/en/latest/hardware/tune.html#broadcom-bge-4-cards](link url)
I still get 50Mbps down. I also looked at the output of dmesg -a | grep bge1
bge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x57766001> mem 0xa0400000-0xa040ffff,0xa0410000-0xa041ffff irq 16 at device 0.0 on pci7 bge1: CHIP ID 0x57766001; ASIC REV 0x57766; CHIP REV 0x577660; PCI-E miibus1: <MII bus> on bge1 bge1: Using defaults for TSO: 65518/35/2048 bge1: Ethernet address: a8:20:66:1d:9b:e2 bge1: link state changed to DOWN bge1: link state changed to UPI looked at the CPU activity and only saw the following (stayed roughly the same when running the speed test):
last pid: 14312; load averages: 0.08, 0.08, 0.08 up 0+00:31:19 21:07:59 241 threads: 9 running, 198 sleeping, 34 waiting CPU: 0.3% user, 0.0% nice, 0.2% system, 0.0% interrupt, 99.5% idle Mem: 123M Active, 6740K Inact, 428M Wired, 126M Buf, 15G Free Swap: 16G Total, 16G Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 187 ki31 0B 128K CPU1 1 31:12 100.00% [idle{idle: cpu1}] 11 root 187 ki31 0B 128K CPU5 5 31:11 100.00% [idle{idle: cpu5}] 11 root 187 ki31 0B 128K CPU4 4 31:11 100.00% [idle{idle: cpu4}] 11 root 187 ki31 0B 128K RUN 6 31:10 100.00% [idle{idle: cpu6}] 11 root 187 ki31 0B 128K CPU3 3 31:10 100.00% [idle{idle: cpu3}] 11 root 187 ki31 0B 128K CPU7 7 31:09 100.00% [idle{idle: cpu7}] 11 root 187 ki31 0B 128K CPU2 2 31:07 100.00% [idle{idle: cpu2}] 11 root 187 ki31 0B 128K CPU0 0 31:10 99.37% [idle{idle: cpu0}] 0 root -16 - 0B 1024K swapin 6 0:48 0.00% [kernel{swapper}] 16 root -60 - 0B 256K - 7 0:02 0.00% [usb{usbus0}] 388 root 36 0 141M 42M piperd 3 0:01 0.00% php-fpm: pool nginx (php-fpm) 12 root -64 - 0B 416K WAIT 2 0:01 0.00% [intr{irq38: xhci0}] 387 root 68 0 141M 44M accept 3 0:01 0.00% php-fpm: pool nginx (php-fpm) 7 root -16 - 0B 16K pftm 0 0:01 0.00% [pf purge] 0 root -64 - 0B 1024K - 0 0:01 0.00% [kernel{bge1 taskq}] 2 root -60 - 0B 128K WAIT 0 0:01 0.00% [clock{clock (0)}] 12 root -60 - 0B 416K WAIT 3 0:01 0.00% [intr{swi1: netisr 5}] 12 root -60 - 0B 416K WAIT 2 0:01 0.00% [intr{swi1: netisr 4}] 12 root -60 - 0B 416K WAIT 5 0:00 0.00% [intr{swi1: netisr 7}] 12 root -60 - 0B 416K WAIT 2 0:00 0.00% [intr{swi1: netisr 1}] 12 root -60 - 0B 416K WAIT 5 0:00 0.00% [intr{swi1: netisr 6}] 16 root -60 - 0B 256K - 5 0:00 0.00% [usb{usbus2}] 16 root -60 - 0B 256K - 7 0:00 0.00% [usb{usbus1}] 52969 root 20 0 43M 22M select 4 0:00 0.00% /usr/local/sbin/kea-dhcp4 -c /usr/local/etc/kea/kea-dhcp4.conf{kea-dhcp4} 16 root -60 - 0B 256K - 7 0:00 0.00% [usb{usbus0}]I also reset the whole thing to factory defaults thinking it was a poor configuration and tuning on my end, after doing that I get the same speeds no improvement.
I plugged in directly to the ATT Modem and I get the 350Mbps, the same occurs when I use the StartTech 2.5G adapter the speed only drops to 50Mbps when I use the PFSense.
Does anyone have suggestions, thoughts, or recommendations? I would highly appreciate it!
-
@Unheated9118 Sure there’s not an old limiter set up? I know you said you reset to defaults but that’s often the answer.
-
Hi @SteveITS
Thanks for the help, I went back to double check: and this is what I had from the diagnostic:
Limiters: No limiters were found on this system.Any other suggestions or things I should try?
-
@Unheated9118 my next wild guess would be the USB NIC but I don’t really have info. I’d try to look up info on that chipset/device and FreeBSD. I found this which may or may not be helpful:
https://unix.stackexchange.com/questions/632301/ethernet-performance-through-asix-ax88179-in-freebsd-is-slow-with-1gbit-connecti -
Thanks for that I will look into that article. I forgot to mention that I also attempted to use bge1 and also bge0 as the WAN connector, but they both gave me the same problem. I appreciate the article, I will reply back once I get to test.
-
OK, so I had a chance to Look at the output of the USB I did see it was able to do 5GB
ugen0.2: <Realtek USB 10/100/1G/2.5G LAN> at usbus0, cfg=2 md=HOST spd=SUPER (5.0Gbps) pwr=ON (64mA)For the PCI-E I saw the following:
Handle 0x0033, DMI type 8, 9 bytes Port Connector Information Internal Reference Designator: None Internal Connector Type: None External Reference Designator: Ethernet External Connector Type: RJ-45 Port Type: Network PortI looked at the output of netstat -i and none of the interfaces have Ierrs
Based on all of that the summary appears to be:
USB WAN Adapter should be a problem
Limiter is not a problem as there is none
bge1 should be at 1GB Full Duplexbge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x57766001> mem 0xa0400000-0xa040ffff,0xa0410000-0xa041ffff irq 16 at device 0.0 on pci7 bge1: CHIP ID 0x57766001; ASIC REV 0x57766; CHIP REV 0x577660; PCI-EAfter I did some of the tuning, the download does not pass 50Mbps, but the upload burst to 190Mbps and then goes down to about 96.6Mbps. So I am at a loss given that everything is saying it 1000 full duplex.
tatus up MAC Address a8:20:66:1d:9b:e2 IPv4 Address 10.0.0.1 Subnet mask IPv4 255.255.255.0 IPv6 Link Local fe80::aa20:66ff:fe1d:9be2%bge1 MTU 1500 Media 1000baseT <full-duplex>Do you have any other thoughts or suggestions?
-
I have ue0 as a WAN and have a issues on 2.7.1 . On 2.7.0 it is OK. Are you able to test the same but with older 2.7.0?
-
Yeah I would try using one of the bge NICs as WAN and see if you get the expected bandwidth when both are linked at 1G
-
Not sure what did it, but I moved WAN to the native 1GB and it was stuck at 45-50Mbps. Then I removed the UE0 and moved the WAN to bge1 1GB. Rebooted the router and then I was exceeding the 300Mbps ~338Mbps.
Not sure what it was but now I am back in business!
Thank you all really appreciate it!
