Gateway offline, Packetloss

[Apaar]

@robh-0 The link is up but the gateway is down.

[RobH 0]

@apaar I understand. Mine started doing the same thing recently. If I disconnect one ISP from pfSense, the gateway goes down due to packet loss and fails over to the other ISP as it should. When I reconnect the ISP, it never comes back up. I tried all sorts of things just as you have to resolve this issue, but nothing works. I rebooted the pfSense box and all WANs came back as they were supposed to.

[Apaar]

@robh-0 Sir I m using only 1 ISP on my Pfsense route, I hooked it up to my other ISP to check the DHCP and the lan ports.
I m using only one static ip ISP on the Pfsense router, Which is just showing gateway down. I have restarted, Factory reset the router multiple times and still the same, I know the configuration is correct because i remember it very well, also the ISP technician had a look at the configuration and said it should work but it isn't.

[RobH 0]

@apaar The issue I'm experiencing would occur if I only had one ISP.

What happens if you disable gateway monitoring? You really don't need monitoring with only one ISP.

[SteveITS]

@apaar said in Gateway offline, Packetloss:

incomplete

https://docs.netgate.com/pfsense/en/latest/monitoring/status/arp.html
"A MAC address listed as (Incomplete) indicates that the firewall has attempted to discover the host via ARP but it has not yet received a valid response."

Can you post your WAN interface settings?

[Apaar]

This post is deleted!

[Apaar]

@steveits Sure!

[stephenw10]

Mmm, the gateway is not responding to ARP.

I assume you are connected to the LAN so it's unlikely the actual NIC is concorrect.

So I'd bet the ISP modem/router is blocking the MAC for some reason. Did you try rebooting that?

Steve

[Apaar]

@stephenw10 i did reboot it, i will get it checked by ISP again. Thank you sir

[stephenw10]

The last thing I'd try there is to run a packet capture on the WAN and see if any traffic is coming into it at all.

https://docs.netgate.com/pfsense/en/latest/diagnostics/packetcapture/webgui.html

Steve

[Apaar]

@stephenw10 I have no clue about running packet capture, but i will try to do so.

[Apaar]

@stephenw10 I did do packet Capture, at first it didn't work. But then the second time gateway showed online and then went offline within 30 sec. I can share the packet capture file if you want.

[Apaar]

@stephenw10 Also now on the ARP Table it says WAN-Gateway- Expires in 651 Seconds.

[Apaar]

Gateway Still showing offline and there is no internet.!

[stephenw10]

Sure you can upload it to me here:
https://nc.netgate.com/nextcloud/s/AP2AyanaK52knSP

Something odd happening there though if the gateway did respond to ARP and then stopped.

You might try swapping the WAN and LAN assignments just in case it's something the Realtek NIC is doing. Though they are both Realtek.

Steve

[Apaar]

@stephenw10 Sure, I will try to swap them. Also i shared the file on the link.

[ashishgupta09229]

I'm curious, if you reboot pfSense, does it then come up or does it stay down?

[Apaar]

@ashishgupta09229 It is still down, even after rebooting and reseting the router. Everything is working from the ISP side as i checked it with my PC manually inserting the IPv4 on the ethernet adapter.

[stephenw10]

Hmm, so it looks like the gateway just stops responding. It's not disconnected since we can still see it's broadcast ARPs for other IPs, it ust stops replying to pings.
For example in that pcap it responds in packet 5038 and then stops. During that time all other traffic pfSense also fails to get a reply so it's not just the gateway itself refusing pings.
It remains non-responsive until pfSense ARPs for the gateway in packet 8598. Then it responds to the ARP and then starts responding to pings and other traffic.
Before that it inially starts repsonding the previous time pfSense ARPs for it in packet 3237
The gap between those is ~20mins which is what you would expect for an ARP expiry.

So this appears to be an ARP issue. The gateway loses the pfSense WAN IP from it's ARP table until pfSense sends a query. But we never see the gateway ARP for the pfSense WAN IP itself. That implies there may be an IP conflict. Two devices using that IP.
However that would apply to any device you connected there not just pfSense. When you connect the other router does it work continually for, say, 30mins?

Steve

[Apaar]

@stephenw10 I just checked, its not giving any problem with the other ISP. Just giving issues on the static IP gateway.