How to split LAN into two? - Jikjik101's network

[stephenw10]

Your ISPs 1 and 3 both use a wireless connection. They are likely to have high latency. When you are trying to loadbalance all three what you see in the logs?
It's very possible that they are being removed from the loadbalancing gateway due to the latency becoming too high or packet loss.

Steve

[jikjik101]

All my ISPS are wireless.
ISP1 is using a grid antennae
ISP2 is using radio tower
ISP3 is using satellite dish

My syslog is clear of any disconnections from any ISP except if there is a high network utilization.

What I don't understand is for example I'm downloading a torrent, I can see all my ISPs as being used due to high traffic. The only difference is that my ISP2 has a steady traffic, but my ISP1 and ISP3 shows very minimal or "erratic" connection. See the attached picture please.

[stephenw10]

In your diagram you show some infrastructure in the network of ISP2 between you and the radio link section. I would guess that ISP2 is limiting your connection speed in that infrastructure such that you are never seeing the limit of what the radio link can achieve and hence any variation in speed. The other connections, ISP1 and 3, are subject to error checking and additional network overhead caused by a wireless connection.

Steve

[jikjik101]

I don't know if you're a magician or an x-men with telekinesis power but I think you got it right. :o
The diagram actually only showed a building with ISP2, but as a matter of fact, all my ISPs are in the same roof with 10-20meters in-between distance. The only difference is that ISP2 has a router in-between my pfsense box and the rest has none.

But I think you're right when you say that ISP2 is limiting my connection speed. It looks like ISP2 had put a cap on my download speed so it looks like very stable.

[jikjik101]

And I think I got my multiwan to work with loadbalance with squid.

What I did is just put floating rule and the manual NAT.
In the floating rule, I select WAN1 as the interface source, loadbalance gw as the gateway. And that's it.

• WAN1 address * * * LoadBalance none
  My loadbalance with squid is now working (I think) :o

I read this somewhere but I forgot the link. I don't know why it is needed to put WAN1 Address as the source and selecting WAN1 interface only in the floating rule.
I found the link: http://forum.pfsense.org/index.php/topic,38882.0.html


[jikjik101]

kernel: pid 26983 (imspector), uid 0: exited on signal 11 (core dumped)

What is this? This is with imspector-wip. I tried to reinstall but failed.
When I looked at my installed packages, imspector didn't show up. When I go to packages, I didn't find the package anymore. So I uninstall it and try the imspector, the other version.

[stephenw10]

@jikjik101:

I don't know if you're a magician or an x-men with telekinesis power

Hmmm, X-man!  ;D

I can't help you with imspector though.

Steve

[jikjik101]

I thought you can solve anything.  ;D

I have another problem, the loadbalance works. But sometimes when an ISP goes down, it doesn't reconnect. I have to edit its gateway and save just to "wake" it up. Any thoughts?

[jikjik101]

Now this make my head aches!  >:(

It seems that LoadBalance doesn't work properly.
Default GW: None
Unabled: Use sticky connections
Unabled: Allow default gateway switching

NAT: Manual
WAN1 * * * * * * NO
WAN2 * * * * * * NO
WAN3 * * * * * * NO

LoadBalanceGW is the gateway group for the 3 ISPs under same tier.

Firewall Rules
LAN:

• • • • • LoadBalanceGW None
          Floating:
• • • • • LoadBalanceGW None

Packages: squid, lusca-cache, squidguard, lightguard, havp, bandwidthd, vnstat2 and imspector
Squid is transparent mode.

WAN1 = Dynamic, 2 DNS
WAN2 = Static, 2 DNS
WAN3 = Static, 2 DNS - 1 is the Google DNS (8.8.8.8)

Problem1: It seems that round-robin doesn't work correctly. It seems that one ISP gets the heavy work while the other two are just simply "sleeping". But when I check the http://pfsense.org/ip.php, I get all the public IPs of the three ISPs. When I checked the firewall logs, it seems that an ISP gets a weight twice the other two. I can see that ISP1 for example is being used twice before it connects to ISP2 then ISP3 then goes back to ISP1 then another ISP1 then ISP2 and so on and so forth.

Problem2: If one ISP gets down, it doesn't reconnect. I manually edit the router page or unplug/plug the cable just to get it online. The status either stays OFFLINE or Gathering Data, it never goes back to ONLINE.

Please help again. TIA.

[stephenw10]

I assume you have made most of those settings because you are running Squid with loadbalancing? I've never tried to do that I'm afraid.
I think you would be better asking a new question in the loadbalancing section of the forum. This thread is now long enough to put people off reading it!  ::)

Steve

[jikjik101]

I cannot get the loadbalance to work so I go to policy routing with squid in transparent.

Although I am disappointed with my setup since I cannot fully utilize all my ISPs but I have to be contented with it.
I manually balance the load to the 3 different ISPs.

GroupA(high priority) - ISP1
GroupB(medium priority) - ISP2
GroupC(low priority) - ISP3

I just add the following in my custom options of squid to make it work (IPs are just for example):
acl GroupA src 192.168.100.1/24;
acl GroupB src 192.168.101.0/24;
acl GroupC src 192.168.102.0/24;

tcp_outgoing_address 10.10.10.1 GroupA;
tcp_outgoing_address 10.10.10.2 GroupB;
tcp_outgoing_address 10.10.10.3 GroupC;