Problems with flaky internet and pfSense

KOM

Capture is easy with pfSense (Diagnostics - Packet Capture), and we can help you read & decode the capture.

Bob.Dig

What I just noticed is that an incoming ICMP echo request (by the external Broadband Quality Monitor) continuously got answered by pfSense in that time where all the other machines had no internet. So how is this possible or related to the fact, that the connectivity to all the other machines only comes back when the DHCP of the internet connection is manually renewed. Any ideas?

johnpoz

How is what possible for an IP to answer a ping? Do you enabled pfsense to answer pings on its wan? Out of the box it does not allow that btw.

So lets say your dhcp lease didn't renew and you had IP address 1.2.3.4 (some public IP because your isp gateway is in bridge mode).

Its quite possible someone else now has IP 1.2.3.4 and is answering the external monitors pings.. Doesn't mean you will work..

We need some actual info to work with if you want help..

When your internet stops working - what is the IP on pfsense wan.. Is pfsense showing the gateway up, ie it can pings its gateway.. say 1.2.3.3 ?

When you renew/release/renew your wan dhcp lease - do you get a different IP?

If your gateway is showing up, and can not get to internet from your clients.. Using pfsense diag, ping some IP - say 8.8.8.8 does that respond? Can pfsense resolve stuff.. On its diag page, trying looking up some website you have not been too, say www.cnn.com or something - does that resolve?

Need something to work with here if you want help.

Bob.Dig

@johnpoz So IP stays the same and sure I enabled the ICMP echo request. It had not occurred(?) to me that pfsense by itself could have internet... So I will test the ping thing. And yes the gateway on the WAN-Interface would shown up.
Also my ISP is doing some sort of special CGC-NAT and pfSense is running in hyper-v...

johnpoz

So if your isp is doing CGnat - how is it you can ping your IP.. What IP are you pinging and from where? Your IP is public on pfsense or its rfc1918, if its public then its not CGnat, if its rfc1918 (10.x.x.x, 192.168.x.x, 172.16-31.x.x) then I find it unlikely that they are passing the pings on to you, etc.

When a carrier does CGnat - they are having multiple clients share a public IP.. They can not pass ping to all clients sharing that IP, etc. etc. While it is possible for them to port forward some ports to you.. This would have to be setup with the ISP, etc.

Bob.Dig

@johnpoz Like I said before it is special. It looks like a NAT-IP, but at the same time it seems exposed, so I can open ports on my side etc. Don't ask me why they do it like that and I have some servers running like WP, Nextcloud etc..

johnpoz

Not saying your your lying or anything - but I am doubtful... What is more likely is your behind your isp devices nat.. And your pfsense is maybe set as dmz host?

What is the ping time to your "gateway" in pfsense?

Bob.Dig

@johnpoz No, but I am no network professional.

Bob.Dig

What is the ping time to your "gateway" in pfsense?

I am not sure what you mean by that but I will try to find out.

johnpoz

What does pfsense show for its response time to your gateway on the dashboard widget?

Who is the ISP exactly?

Bob.Dig

@johnpoz Just added it:

 WAN_DHCP
100.65.191.254
	8.9ms 	2.0ms 	0.0%

Telecolumbus in germany

johnpoz

They are using 100.64/10 space - yes that is CGnat space..

I still find odd that they would be doing 1:1 nat to some public IP - and passing all ports to you..

But ok - when your clients are having a problem - does pfsense still have access to internet?

But now we are getting some info, so we can understand your setup, and figure out what is going on.

Bob.Dig

@johnpoz I will test this next time it happens.

bmeeks

Depending on the specific model of cable modem you have, you may need to have pfSense "reject" DHCP lease offers from the internal IP of the cable modem.

For example, I had a Motorola cable modem where 192.168.100.1 was the internal LAN-side IP of the cable modem. I used the modem in bridge mode so my external public IP for the modem was passed to my pfSense firewall. When the external cable signal went down and the modem went into a carrier search and retrain mode, it would seemingly switch out of bridge mode and offer my firewall WAN an IP address from the modem's internal 192.168.100.0/24 net block. My firewall's WAN interface would happily accept the new IP. However, once the external cable signal came back online and the modem switched to bridge mode again, my WAN would frequently be left holding onto that 192.168.100.x IP address and thus I had no Internet connectivity. I would have to manually "release the lease" and renew to pick back up the bridge mode public IP.

You can prevent this by putting your cable modem's private LAN IP address in the Reject leases from box on the WAN interface settings page --

Bob.Dig

@bmeeks I already Block private networks and loopback addresses but if this is something different, I will happily try this. Thank you!

bmeeks

@Bob-Dig said in Problems with flaky internet and pfSense:

@bmeeks I already Block private networks and loopback addresses but if this is something different, I will happily try this. Thank you!

Yes, this setting is different from that.

Bob.Dig

@bmeeks It will not hurt anyway I guess.

bmeeks

@Bob-Dig said in Problems with flaky internet and pfSense:

@bmeeks It will not hurt anyway.

Just be sure to use the actual internal IP (or LAN gateway address) of your cable modem. Your model very well could use a different default internal IP from mine. You can find out by doing some Google research using the brand of your modem.

Bob.Dig

@bmeeks It is the same here. Although I am wondering how pfsense could still answer the echorequests. But again, it will not hurt to try that.

JKnott

@Bob-Dig said in Problems with flaky internet and pfSense:

@johnpoz Like I said before it is special. It looks like a NAT-IP, but at the same time it seems exposed, so I can open ports on my side etc. Don't ask me why they do it like that and I have some servers running like WP, Nextcloud etc..

What is your WAN IP address?