Packet Loss and Latency/Jitter on PPPoE Interface.
-
Ooops, totally forgot about that! Doesn't seem to be showing anything now. Started again. The graph should appear here:
http://www.dslreports.com/r3/smokeping.cgi?target=network.e6c1442a6598dd4e26a0fa816f137954&r=33Steve
-
Thanks for your help. Do you mind if I add you IP / Domain to my monitoring? You can PM me if you wish, but I understand if you would rather not.
-
Moving this back to the forum where it could help others.
Your tests results seem to show this isn't an inherent pfSense/FreeBSD problem. Do you have the HG612 vdsl modem?Steve
-
For clarity for other users, here are the graphs.
My own, showing lots of packet loss/jitter-
stephenw10's graph, showing no packet loss and a steady connection-
I have the newer ECI B-FOCuS V-2FUb/R Rev.B VDSL2 FTTC modem, so I am unable to 'hack' it to get the line stats, but I intend on ordering a HG612 next week. I've asked my ISP (which funnily enough I work for) for the line stats, but our upstream provider is taking their time.
So far, it remains a mystery.
-
I've asked my ISP (which funnily enough I work for)
Ha, no excuses then. ;D
Interesting that your base ping time is lower than mine by quite a bit. Is your smoke ping test box within the ISPs network?Steve
-
Unfortunately we are essentially a reseller so I am still relying on a third-part for the info.
The smokeping box is indeed in the ISP's network, only a few hops away from the Broadband End Point (The 'LNS' I believe, I have to admit Im not an expert on the finer details). I have monitored another colleagues FTTC connection using the Technicolor TG582, and again, his connection looks fine.
I will push for the line stats tomorrow. Until then, there isn't much else I can try.
I find it bizarre the problem has been present on both the ADSL and VDSL service, as the wiring, modems, filters, and pfSense box have all been changed with no effect, hence my first hunch was it must of been pfSense's PPPoE implementation, but it doesn't look like that is the case.
-
I assume you aren't seeing any errors or collisions on the WAN NIC? Can you switch the pppoe connection to another NIC? Do you have another box you can load pfSense onto for a test?
Steve
-
Just re-reading this: http://forum.pfsense.org/index.php/topic,64786.msg354161.html#msg354161
Definitely check for a duplex mismatch between the modem and pfSense box.Steve
-
I assume you aren't seeing any errors or collisions on the WAN NIC? Can you switch the pppoe connection to another NIC? Do you have another box you can load pfSense onto for a test? Steve
There are currently 0 errors/collision on the WAN NIC. I've had the same issues with other NIC's / boxes with a variety of NICs
Just re-reading this: http://forum.pfsense.org/index.php/topic,64786.msg354161.html#msg354161
Definitely check for a duplex mismatch between the modem and pfSense box.
SteveI have forced the speed and duplex on the pfSense box but I am unable to force it on my OR modem unfortunately.
-
You should only force the speed/duplex if the modem-pfSense connection is not negotiating correctly. Was it negotiating to full speed full duplex? It seems this is not the first time it's happened with that modem:
http://forum.mikrotik.com/viewtopic.php?f=3&t=70166Try putting a switch between the modem and pfSense box. Return everything to auto-negotiation.
Steve
-
pfSense was auto-negotiating correctly, so I shall return it back to normal. The OR modem is currently hooked up to a switch, and then VLAN'd to the pfSense box, but I still get the same latency/jitter when connecting directly.
Im still waiting on the line stats from the upstream provider, I really need to get a 'hacked' box.
-
It looks like there are some hacking options for that box too but they involve soldering so it's really non-reversible. BT will know if they come round to fix it and charge you accordingly!
Since it's the modem that seems to be suspect in negotiating the connection speed/duplex can you find out if it's doing so correctly with the switch?
If it was just a line problem why does it not happen with the SOHO router you have? I suspect the line stats will show you nothing. :-\Steve
-
I have the newer hardware revision which has limited hacking options unfortunately. The Huawei HG612 seems to the most established hacked box, so I don't mind grabbing one off Ebay for modifications, as you say, BT will charge if I damage their supplied equipment.
Speed and Duplex is being correctly negotiated by the switch.
I also suspect the line stats will be inconclusive, but Its literally my last hope! I could do with taking my pfSense box to another location with FTTC, but they are few and far between in my area. I was the very first customer in my cabinet!
Thanks again for your help, even though it doesnt look as though a resoloution is in sight.
-
So, I tested some more scenarios, using the same hardware (except the iMac)-
pfSense
This graph shows the jitter and latency Im plagued with when using pfSense.
m0n0wall (BSD based, similar to pfSense)-
Jitter and Latency still present.
Ubuntu 12.04
Looks perfect!
iMac
again, looks perfect.
Ive not got any closer to solving this one, its a mystery at present.
-
So that's Ubuntu and m0n0wall running on the same hardware? Hmm. It seems like it must be a FreeBSD driver issue. You already tried moving the PPPoE connection to a different NIC I recall. They are Intel NICs anyway so it should be fine. :-\
Steve
-
My original graphs are using a physical box. More recently I have been using virtual machines on an idle host. I know this adds an extra element of latency/something to go wrong, but I can replicate the same issue on physical hardware, so it seems to work for testing this case, and minimizes disruption to my network.
I've added a recent graph using pfSense within a Virtual Machine above for clarity. Ubuntu and m0n0wall was also virtualized.
I may try raw FreeBSD next, but Ive not used it before.
-
Using VMs you are effectively using the same NIC/driver combination for every case but I guess that includes pfSense. Interesting that m0n0wall shows less latency. It's based on FreeBSD 8.2 last time I checked. pfSense 2.0.x is build on 8.1 and 2.1RC on 8.3 so all different versions. You could try an older pfSense, 1.2.3 was built on FreeBSD 7.3 (I think). It can only support one PPPoE session though so limited. You could try PC-BSD which is easy to setup. Various versions built on various FreeBSD versions are available. I agree though that testing a VM of FreeBSD 8.3 is probably the best test you could do. I've no idea how to setup a PPPoE session directly in FreeBSD though. ::)
Steve