Routing between interfaces/VLANs
-
maybe the logical architecture of the network has something to do with it?
Here's how this setup looks like:
pfsense > VLAN 3 taggged connected to switch > VLAN 3 tagged to Wifi Access Points > Access Points broadcasts the VLAN 3 thru it's SSID as untagged.
For the Windows-Machine: thats a VM on ESXi, where ESXi passes the VLAN 3 as an untagged network to the VM
Everything is Level 2 Switching, so no routing involved by the switches
All clients are DHCP, nothing static. The DHCP is running on pfsense. So if anything is misconfigured, the source must be in pfsense
-
@techvic said in Routing between interfaces/VLANs:
maybe the logical architecture of the network has something to do with it?
No doesn't matter... Comes down to how tcp works at a basic level... The client would never arp for an IP outside its network... Because that is not how it works..
A client would never on its own arp for that IP, since with the settings on its interface that IP is not on its network.. So there would be no way it could ever see the arp... Arps are at Layer 2.. Could you manually send out such an arp - sure.. But the OS should never do such a thing on its own.
If your seeing arps for that 3.1 address from 150.36/24 then it thinks for whatever reason that 3.1 is part of its local network.
If devices arped for IPs that are not on its network - every single IP you talk to on the internet - the client would arp for...
You have something wrong for sure with that client to why you can not send traffic to its gateway 150.1.. Could it be something odd going on with esxi - ok maybe.. Not sure on the details of your setup... But in all the years working with esxi, no I can not think of reason such a thing would happen. Nor have I seen it... it makes no sense for anything to arp for an IP outside its network..
But what would explain it completely is that client thinks 192.168.3.1 is on the same network as 192.168.150 - so mask of /16 would do that..
Reset the networking on that client doing the arps...
And again - are you seeing the same sort of problem from your 150.39 device?
The DHCP is running on pfsense. So if anything is misconfigured, the source must be in pfsense
Well that makes no sense, since your pfsense shows mask of /24... Client "shows" a mask of 24... So to validate - do a simple sniff of yoru dhcp traffic... What is being handed to the client?
edit:
Do you have something on the network that might have the same duplicate IP sending those arps? Maybe it has wrong mask on it... What is your esxi vmkern IP? etc. etc..
edit2: Look at the actual details of the arp your seeing... Is the MAC of the arp from your your client?
Sniff on your windows machine.. While your pinging, that 192.168.3.1 address -- do you see it arp for the gateway IP? Do you see it actually send the pings?
wireshark is FREE, download it and install it on your client your having problems with... And again is your other machine having the same problem? You have given 2 machine 150.39 and .36 - are both of them doing the same exact thing??
-
@johnpoz said in Routing between interfaces/VLANs:
And again - are you seeing the same sort of problem from your 150.39 device?
no, indeed on the Windows VM (192.168.150.39) everything works as it should. So there I can ping 192.168.3.1 and can access other hosts on the 192.168.3.0/24 net.
So for testing I connected a physical windows machine to the Wifi on 192.168.150.0/24, where I see the same issue as on the Mac yesterday (nothing to see on the packet capture at all). The machine gets a DHCP lease (192.168.150.21) and has access to the internet, but can't reach any host on 192.168.3.0/24.
Then I connected this machine by cable to the switch to a port with VLAN 3 untagged and PVID 3. There everything works.
So the culprit must be somewhere around the wireless system (TP-Link EAP managed Wifi). How is that possible, that accessing Internet works normal but anything to another net is not passing the Wifi system? here's a packet capture of opening google.com on the client thru Wifi:
17:31:54.819122 IP 143.204.101.25.443 > 192.168.150.21.52711: tcp 411 17:31:54.824123 IP 188.172.219.132.5938 > 192.168.150.21.52647: tcp 24 17:31:54.853304 IP 192.168.150.21.52712 > 143.204.101.114.443: tcp 0 17:31:54.854656 IP 192.168.150.21.56643 > 192.168.150.1.53: UDP, length 46 17:31:54.854834 IP 192.168.150.1.53 > 192.168.150.21.56643: UDP, length 110 17:31:54.861782 IP 192.168.150.21.57307 > 192.168.150.1.53: UDP, length 46 17:31:54.876373 IP 143.204.101.114.443 > 192.168.150.21.52712: tcp 0 17:31:54.879854 IP 192.168.150.21.52712 > 143.204.101.114.443: tcp 0 17:31:54.879907 IP 192.168.150.1.53 > 192.168.150.21.57307: UDP, length 127Sure I'm aware this is nothing related to pfSense anymore, but any ideas would be appreciated.
-
@techvic said in Routing between interfaces/VLANs:
that accessing Internet works normal but anything to another net is not passing the Wifi system? here's a packet capture of opening google.com on the client thru Wifi:
Because!! 143.204.25.443 is NOT on a 192.168/16 network - so it would actually send this traffic to the gateway..
When you say wireless.. You sure client is actually getting lease from pfsense? And not your wireless doing nat with 192.168.150 on both sides?
So sniff on pfsense and ping pfsense IP from this client 192.168.150.1 Do you see this traffic in your packet capture? In the sniff check the mac address, validate its your actual clients mac address, and not the mac address of your wireless device.
-
I found the culprit: because this GASTLAN is a net for guests, there on the Wifi-settings were "client isolation" enabled. Due to that, it blocked any traffic not bound to the internet. I even wasn't able to ping the gateway 192.168.150.1
Thank you very much for your patience and not giving up to find the solution till the end. Thats very rare nowadays
-
But WTF was arping 3.1??? That makes no sense at all.
Not sure how your doing your wifi - but why would it be set to a guest, when its a specific vlan already.. Which you control at pfsense..
-
@johnpoz said in Routing between interfaces/VLANs:
Not sure how your doing your wifi - but why would it be set to a guest, when its a specific vlan already.. Which you control at pfsense..
thats why I disabled that feature now > not needed.
@johnpoz said in Routing between interfaces/VLANs:
But WTF was arping 3.1??? That makes no sense at all.
It's TP-Link, China quality, wouldn't surprise me if it's just a bug (wouldn't be the first one). Or is it a hidden spy feature?
-
What IP is on the tplink device - maybe its mask is wrong?
-
@johnpoz said in Routing between interfaces/VLANs:
What IP is on the tplink device - maybe its mask is wrong?
Or the VLAN isolation isn't throrough and leaking through. I thought to remember sth like that from the smallest TP-Link Switches a few years ago...
-
@JeGr said in Routing between interfaces/VLANs:
Or the VLAN isolation isn't throrough and leaking through. I thought to remember sth like that from the smallest TP-Link Switches a few years ago...
And also TP-Link access points. I have one here and can't configure a 2nd SSID because of leaks between VLAN and native.
