ATT Internet AIr

[ahole4sure]

@stephenw10 @Gblenn

The weirdness still continues
Even though I thought I had things working correctly the dynamic ipv4 gateway would go offline and I couldn't get it to come back on
(admitedly all this might be the provisioning issue)

BUT -- I can get the ipv4 gateway to come online by enabling the dynamic ipv6 for the interface
when I enable that - it immediately makes the ipv4 gateway come online!!

I know so little about ipv6 --- does any of that sound familiar to anyone?

[stephenw10]

You can't put those two VIPs on different interfaces because they are both using the same subnet.

You will need to change the management IP for one of the modems so it's in a different subnet,

[ahole4sure]

@stephenw10

Ok. I know there are lots of variables in this messed up case, but I originally had modem #2 setup on 192.168.3.1 and it didn’t work
That’s why I switched
But I guess I shouldn’t have same subnet VIPs on different interfaces??

[stephenw10]

Indeed you can't have the same subnet on more than one interface. Especially because the gateway for one of them is in that subnet. You have a routing conflict which is probably why it stopped responding.

[ahole4sure]

@stephenw10 @stephenw10
Well I spoke too soon -- even modem #1 (with the presumed correct ATT provisioning ) finally started disconnecting ...

When I watch the modem dashboard screen (and even the ethernet lights) it appears the ethernet connection intermittently disconnectsand reconnects
And YES I was able to get into the modem interface (with appropriate creation of VIP) and set the MAC address to the pfsense interface. And I even "blocked" (on the ATT modem ethernet interface) the MAC address of the switch VLAN port.

So my question for you guys -- have I done everything that I can do -- any other VLAN settings to change or try?
And if I have my options are to :

1. do as @Gblenn suggested and just modify my setup so that my pfsense has only my various LAN subnets connected via VLAN and connect the ATT modem directly to the pfsense

or

2. assuming I haven't done something wrong and others on the internet who have connected a WAN through VLAN succesfully -- then return my ATT modem and buy a cellular modem gateway that will work correctly with VLAN (and utilize ATT). If I go that route - any suggestions on device?

I am attaching my VLAN settings one more time to be sure I haven't overlooked something
where VLAN ID 10 was my modem

[Gblenn]

@ahole4sure said in ATT Internet AIr:

even modem #1 (with the presumed correct ATT provisioning ) finally started disconnecting ...

That is wierd, so when it's connected directly to the pfsense interface, it is stable and "just works"? But when connected via the TPLink, it disconnects... and reconnects?

Does it at least maintain the MAC and provide that intermittent connection only towards pfsense now? Anything in the TPLink switch that can give an indication, like stats (bad packets etc)? Does the port light turn off when the link is down?

I'm starting to think it could be a cable issue perhaps?

[ahole4sure]

@Gblenn

Regarding cable

Tried 3 different ones
And all three pass cable tester

[stephenw10]

Hard to imagine the VLAN itself could be an issue. I would try to remove VLAN 1 from the interface connected to the modem. The switch admin interface is the only thing that could be interacting with the modem. Everything else is just forwarding packets.

I assume the switch interface is set statically? If it's set as dhcp that could be a problem.

[ahole4sure]

@stephenw10 @Gblenn

So I changed all cables
No change
Currently if I connect eitehr ATT modem through port 2 of the switch with port 1 connected to the pfsense igb3 port - I get this cycling over 1 to 10 seconds fo connected (varies between 1 and 2 devices - when 2 devices connected shows on the ATT modem it reports the MAC of the pfsense port and the switch), and disconnected (see photos of the ATT device - those photos are about 5 sec apart)

I made changes in the switch to get rid of any members to the default VLAN (VLAN 1).

I ordered 2 new switch from. Amazon - a netgear and a different one to see if it has to do with the switch

[stephenw10]

Port 1 should not have pvid 10. You don't want untagged traffic there ending up at the modem. Though there shouldn't be any untagged traffic arriving at port1.

[ahole4sure]

@stephenw10

Would there be anything else to explore , that would make the device intermittently connect and disconnect from the Ethernet??

Ordered new switches to trial that

Could it be anything in pfsense that would cause that?

And I guess it could be the ATT modem, but both modem # 1 and 2 do it so it would have to be a widespread issue

[stephenw10]

Hard to imagine it could be the switch.

Just to confirm though the switch admin interface itself is configured using a static IP address?
If that is set to DHCP it could be leaking requests out of VLAN10 causing problems.

[ahole4sure]

@stephenw10

Yes, sorry I meant to send screenshot
It is static

[stephenw10]

Hmm, well hard to say what's happening then. Is there any logging in the modem showing what the second client is?