Load balancing suddenly changed behavior
-
I had a 4-WAN setup with load balancing setup working correctly, then one of my ADSL2 lines was converted to VDSL2 so I cancelled one and converted to 3-WAN load balancing. This was working great, everything was setup correctly following instructions in the pfSense Book. Lately I noticed a sudden change in behavior though; pfSense insists on using only one of the DSL links, the first one no matter what I do. If I run a speedtest it'll use all the links but on normal use it'll use only one.
I signed up for a VPN service to switch content regions and I tried setting it up using independent L2TP interfaces and later aggregating them as a gateway group and also setting the link up as a MLPPP interface and in both cases the data will only go through the first WAN link.
Today I modified the MLPPP interface to NOT use the first WAN link and it will STILL use it even it I told it not to. My policy routing rules are not working, I tried demoting the interface to a lower tier in the gateway group and finally removing it altogether and data is still flowing through it even though it's not set as the default route and the policy routing rules that specify a single WAN are not even set to that WAN but to WAN2, the fastest one.
Just right now WAN1 is not active in the main gateway group yet traffic if still sent trough it and I'm starting to see a lot of buffering and pausing on devices; my download speed are as follows:
WAN1 10Mb/s, weight 1
WAN2 40Mb/s, weight 4
WAN3 20Mb/s, weight 2(DSL lines actually sync around 20% higher but my but those are the usable speeds. My ISP has this practice because of overheads.)
This is the MLPPP interface with the second and third WAN selected. WAN1 is re2.
MLPPP speeds.
Yet data goes through WAN1.The last attached screenshot are the floating rules. Previous to that are rules to the main network (HQ) and a private test network (VITA).
