High RTT latency on wan [SOLVED]
-
It really comes down to the stability of the bandwidth the ISP provides. I can set my upload bandwidth to 99% and my download to ~98% and get effective traffic shaping for both in/egress on the WAN. One may need to dramatically reduce their ingress rate limiting to get effective traffic shaping.
-
You can't hard-set one side only if the other side is auto-negotiate. You want to set that back to Default (no preference, typically autoselect).
As I understand it, codel doesn't do much unless it is implemented on the device that is actually doing the buffering. If that is your ISP then it won't do any good.
I would try implementing a quick way to limit how fast you send to the ISP. If you can upload 20Mbit/sec reliably but you get buffer bloat and high-latency, I would try a PRIQ like this on WAN.
If you are running 2.4 you can run a Limiter (dummynet) but you will probably tickle a bug with Limiters+NAT on 2.3 so I'd stick to ALTQ/PRIQ since it's the simplest ALTQ shaper and all you have to do is restrict how fast you send.
Adjust the 10Mbit/sec in the interface scheduler down until you can upload at will and not experience any buffer bloat.
I applied the adjustments to the wan interface and reduce it to PRIQ to14 mbits for testing but when i run a download test it stills get high latency then packet loss. In addition, the bandwidth is still reaching its peak at 20mbit. Nothing changed. It doenst get high latency when i reduce the arris modem to 100mbits full rather than autoselect, which brings it to 1gbps.
-
If your problem is on download:
1: Your ISP sucks - they should not be buffer-bloating downloads like that.
2: You need to limit downloads on LAN as well.
-
Download bufferbloat is a common problem. Most major ISPs do not do anything (useful) to prevent bufferbloat.
AQM in the form of PIE will come to cable modems, it's mandated in DOCSIS 3.1 because bufferbloat is such a ubiquitous problem.
A better statement would be, if you don't have bufferbloat problems on download with sub gigabit WAN, your ISP is exceptional!
-
If your problem is on download:
1: Your ISP sucks - they should not be buffer-bloating downloads like that.
2: You need to limit downloads on LAN as well.
Yes they do suck. Right now i am trying to setup openvpn to work and they have blocked the ports i am trying to use so i had to call them and request they remove the block. They said they would remove it within 24-48 hours.
-
Bullshit.
"Real" ISPs all understand that their customer bandwidth is less than their backbone bandwidth and it is incumbent upon them to eliminate bloat there.
It is preposterous to think that a customer with a 100Mbit/sec down needs to shape to make the connection work properly. A customer cannot affect how fast traffic is sent to him.
-
I am here trying to figure out why it gets high latency only when i set the wan interface to 1gbps. This doesn't happen when i set to 100mbits full. but the problem is i can't set the duplex on the other end which is the Arris modem. My ISP locks the duplex port settings.
-
Well, the modem is probably auto-neg so set the WAN interface to Default (no preference, typically autoselect) and stop screwing with it.
Give a grunt a knob to turn and he'll turn it.
Chattanooga, Tennessee, USA
A comprehensive network diagram is worth 10,000 words and 15 conference calls.
DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
Do Not Chat For Help! NO_WAN_EGRESS(TM) -
Double Bullshit, haha! Just look out there on the internets. ISP's are not eliminating bufferbloat for residential customers, up or down.
If "Real" ISP's don't include say - Cox, Comcast, TWC, AT&T…. then sure, maybe not. But if those are real ISP's, then yeah bufferbloat is a problem and it won't be solved by them.
"Get it to work properly" is pretty subjective. Most customers haven't a clue what bufferbloat is. It doesn't rear it's head on wired connections unless the link is saturated - most people don't do that often. When bufferbloat does arise - it's just (in some cases significantly) increased latency, it's not as if the connection goes down. Most people using most kinds of traffic won't even know it's taking place.
So, a problem that only fringe customers even know exists is exactly the kind of problem most ISP's aren't going to spend money on fixing.
Also, it isn't exactly difficult to make the problem go away on your end for those fringe customers who are aware of it.
-
I am here trying to figure out why it gets high latency only when i set the wan interface to 1gbps. This doesn't happen when i set to 100mbits full. but the problem is i can't set the duplex on the other end which is the Arris modem. My ISP locks the duplex port settings.
Yeah, +1 to Derelict just set it to auto negotiate and leave it alone.
-
the problem is when i set it to autoselect when i have alot of users downloading alot or if i start a downloading test the loss goes to 100% then the gateway goes offline. If that wasn't the problem then i would leave it alone.
I now have it set to autoselect but i have to disable gateway monitoring to let it stay up when the load is high.
-
It sounds like you have some weird glitch going on?
If it were me I would save the config and do a fresh install.
-
Check out dslreports if you believe bufferbloat is a myth. It will give you lots of examples and the majority of test results are less than optimal.
http://www.dslreports.com/speedtest/results/bufferbloat
-
Shaping downloads is non-trivial. Especially as the inside network gets more complex.
-
I certainly can't speak for pro networks, but on home networks with pfsense and fq_codel it takes just a few minutes.
two thumbs up for freebsd & pfsense for bringing in fq_codel!
-
@Derelict Hello, I have been struggling, with the high latency problem with one of my WAN of the two Wan connection and various attempt for traffic shaping, and reading this thread, I changed the problematic WAN interface speed from Default to Auto, which lead to first super slow WEBGUI interface of the pfsense, and now no access at all. Any recomendation ??
-
@tejas said in High RTT latency on wan [SOLVED]:
@Derelict Hello, I have been struggling, with the high latency problem with one of my WAN of the two Wan connection and various attempt for traffic shaping, and reading this thread, I changed the problematic WAN interface speed from Default to Auto, which lead to first super slow WEBGUI interface of the pfsense, and now no access at all. Any recomendation ??
Recovered Now after reboot, and again set to default.
-
You should start your own thread for this.
Please detail exactly what sort of latency you're seeing. Has it got much worse or always been bad?
It is only bad when passing traffic?
Steve
-
@derelict said in High RTT latency on wan [SOLVED]:
Give a grunt a knob to turn and he'll turn it.
This is TRUE WISDOM!!!
I am thankful for the necro on this old thread just for those words - I missed them when first posted..
They are true words to live buy - I would add them to my sig, but real close to the max characters ;)
-
@stephenw10 I have multi wan setup with one Lan. Wan 1 is 6mbps and wan 2 10 mbps plan. Problem is with the Wan2, with high load RTTsd increases upto >1500ms and status first Latency and then Offline. I go thru documentation for the traffic shaping, but no where there is any mentioned for the Multiwan setup and strangely the traffic shaper/by interface is showing just one Wan2 interface(why not second Wan and Lan). If I go with the Wizard, there is no Intenet access. That's in the short. If I could not solve this problem today, will start a Fresh Thread.
