Low Upload on ATT 2.5G plan
-
I recently upgraded from the 1G plan to the 2.5G plan. In doing so I also removed the att rg and now go through an azores ont instead. With my test pc I consistently get around 2.3 down and 6-800 up. When I tired connecting my test pc directly to the azores which managed around 2.6 and 1.1 respectively. Upload was still low, but clearly much better. I have poked at some basics like flow control and MTU sizing (no promise I instituted them properly) with no appreciable difference in speeds.
My test setup is pfsense 23.01 running an Intel X550-T2. ix0 is my wan, and ix1 is my lan. I have tested both on my test pc’s 2.5 Realtek port, and was as a mellanox card with a copper transceiver. My wan and lan ports both show 10Gbase-T full duplex when I am using the mellanox card on the test pc.
FW is running on an Intel 8700 with 16G ram. Nothing on the system seems stressed when running the tests. Any pointers on things to try or places to look?
-
It links at 10G to the ONT?
Do you see errors/collisions on either interface in Status > Interfaces?
-
Correct. There is a 10g rj45 connection on the ont (azores wag-d20).
I have done iperf tests between the FW and the test pc and I get 7-9 gbps consistently in both directions, so cabling issues shouldn’t be a problem.
There are no errors/collisions on any of my interfaces. However, I do see a insane number of interrupts on my wan and my multigig test lan only.
Wan 1050/s
Multigig lan 184/sSide note. Wan and multigig lan run on the x550. My other 5 or so vlans run off of a mellanox 10g fiber card. No errors, collisions, or interruptions exist on those interfaces.
-
Hmm, so you have both Mellanox and Intel X550 NICs in pfSense?
Mellanox NICs have always misbehaved for me whenever I've tested it. Though it shouldn't affect it if it's not either interface in-line.
Check the boot logs to make sure the X550 is getting the expected number of queue for Tx and Rx.
-
I currently have the mellanox x2 and the 550 in the system. The x2 runs one lan with an assortment of items, while the 550 runs my wan, and my test lan. I do get the same speed results regardless of which lan I test from currently. If I can get the 550 running right, the goal is to move my lan over to that and remove the mellanox from the system.
When looking through what I believe are the boot logs, I see this entry “ ix1: Using 6 RX queues 6 TX queues”. Is this what you are looking for, and is it correct?
Also, I see Intel released a new driver this February for FreeBSD. Is this something I should consider, and if so, can it be updated from within pfsense?
-
@frosty81 said in Low Upload on ATT 2.5G plan:
I see this entry “ ix1: Using 6 RX queues 6 TX queues”. Is this what you are looking for, and is it correct?
That would be expected for a system with 6 CPU cores. As long as both ix NIC shows that.
I wouldn't expect to see any difference but you could try a 2.7 snapshot with the latest available driver.
Steve
-
Both ix0 and ix1 show the 6x6 queues.
I will have to look into snapshots and see if I can figure out how to flip flop my installs.
-
You were correct. Swapping over to the latest 2.7 did not improve anything. I have rolled back to 23.01 at this point.
