Solution for multi-wan routing with same gateway from ISP
Symptoms: Only one (or maybe two) modems out of four would work because of the ISP giving out the same gateway IP. (Turns out it can be caused also from two gateways on the same subnet.)
Solution below:
Ok, I opted for option 3…bought three Linksys WRT54GL series routers...
http://www.amazon.com/Cisco-Linksys-WRT54GL-Wireless-G-Broadband-Compatible/dp/B000BTL0OA?pf_rd_mnb=ATVPDKIKX0D34&pf_rd_stb=center-2&pf_rd_rat=0817NMRY4ZRQZM6P18TH&pf_rd_t3r=101&pf_rd_ptd=470938631&pf_rd_ied=507846&tag=buaazs-20&pf_rd_ptd=470938631&pf_rd_ied=
upgraded to current DD-WRT firmware (first with basic upgrade then with full package upgrade)
then set WAN (default gateway on pfsense) to normal without router.
then configured WAN2 on Router1 to be 192.168.0.1
then configured WAN3 on Router2 to be 192.168.1.1
then configured WAN4 on Router3 to be 192.168.2.1
later I setup with OPENDNS,NOIP, and set port fwds with anything I need to have come in.
My network was 172.17.17.1 network.
From my network I can acccess each modem and configure as needed.
KEY is that if you set each modem to 192.168.1.1 and 1.2, and 1.3 you will get the same errors. They need to be on separate subnets and then things are peachy. It is not an IT dream solution but it actually is working pretty good so far and has become quite stable.
At least I didn't have to toss PFSENSE quite yet…