Able to ping, nslookup and curl in pfSense box but curl failed in clients
-
@viragomann @rcoleman-netgate
This is initial setup. After installation completed and rebooted. I just setup 2 interfaces, for LAN (192.168.1.1) and WAN (DHCP from ISP modem 192.168.10.x). No VLAN setup.For WAN I am using internal NIC and for LAN I am using USB Gigabit NIC.
If not mistake around 6-7 years ago I installed pfSense and worked just after I set configuration like above. I have mikrotik and openwrt devices which worked out of the box before any custom rules setup.
Two days ago I decided to try pfSense again. After initial setup the clients unable to ping google.com but ping to ip is ok. This issue fixed after I disabled DNSSEC support.
The remaining issue client devices cannot access the internet. Ping and nslookup to google.com working in both pfsense box and clients. But these commands working in pfsense box only
- curl https://google.com
- telnet google.com 80
- telnet mypersonalvps.com 22
I also think need to add rule(s) to allow the traffic but I don't know which rule and what kind of NAT configuration I need for this. Any idea what rules and NAT configuration I need for this ?
-
@mltobing said in Able to ping, nslookup and curl in pfSense box but curl failed in clients:
I just setup 2 interfaces, for LAN (192.168.1.1) and WAN (DHCP from ISP modem 192.168.10.x).
So as @rcoleman-netgate already requested above, I'm also wondering, which device is 192.168.31.1 which is responding DNS requests.
Obviously there is an additional subnet. -
@viragomann My current setup like picture below
-
@mltobing So... remove OpenWRT and plug the Laptop into the LAN port. Does the issue resolve? Then it's OpenWRT, not pfSense.
-
@rcoleman-netgate I tried that already. Same result
This is the trace route from my laptop connected directly to pfSense LAN NIC.
I cannot see 192.168.10.x (This should be pfSense not OpenWRT)
-
@mltobing What do the firewall logs say, then? All blocked traffic is logged by default unless you explicitly make a rule to deny that (which you haven't done).
Status->System Logs .... Firewall tab. Look for, or filter by, your system's IP.
-
@mltobing said in Able to ping, nslookup and curl in pfSense box but curl failed in clients:
I also think need to add rule(s) to allow the traffic but I don't know which rule and what kind of NAT configuration I need for this. Any idea what rules and NAT configuration I need for this ?
On the LAN interface all traffic is passed by default unless you remove that rule or block the traffic.
AHA!The default rule says LAN NET for the source... I suspect 31.0/24 is being blocked because it is not 1.0/24
change that to Any source (did you change this?) and it should be good to go.
-
@rcoleman-netgate When you mentioned something wrong with OpenWRT, I removed OpenWRT and my laptop connected directly to pfSense LAN NIC so my laptop using 192.168.1.x.
I followed your instruction to update LAN Net to any. But still same.
From Firewall logs I found only ICMPv6 blocked (because I just disabled IPv6) and then the first record because I tracerouted from WAN to LAN IP Address. There is no other traffic blocked. Please check this picture.
-
@mltobing Telnet over 443? Hmm.
Run a packet capture on the WAN interface with 443 as the port and the IP address you are checking as the host.
Does it see the traffic?
-
@rcoleman-netgate This is the result of packet capture (time in pfsense box slightly different with my laptop)
-
@mltobing What's between your pfSense and the world?
This suggests the issue does not lie in your pfSense but on the next step out - it goes in the pfSense and out the WAN port but nothing is coming back. -
@rcoleman-netgate That really strange. There is ISP modem after pfSense box. I removed pfSense box and change it with OpenWRT AP all working fine.
If you think like that, now I am not sure if this issue related to Intel Atom box or the NICs
-
@mltobing Are you running any type of VPN?
-
@rcoleman-netgate I am not running any type of VPN
I forgot if we cannot curl, because of that we didn't get any reply. But we have no issue with ping, so I tried to capture and we got reply.
Strange. Why pfSense box allowed ICMP and nslookup but blocked other traffic. On my laptop I checked the network status "internet access" but I cannot browsing the internet.
Thanks for your fast response. I will go out and reply you later
-
@rcoleman-netgate I tried this scenario to get packets from OpenWRT. I ran curl on my laptop first then pfsense box
pfSense WAN captured packets from both of them but didn't forward requests from my laptop to OpenWRT. We can see OpenWRT captured packets after 20:55:48 only. Do you know why pfSense WAN didn't forward packets from my laptop?
-
It's not that pfSense is not forwarding the responses it's that it never gets any responses to forward. For some reason.
There must be some difference between the packets from the client and those from pfSense. The TTL would be different for example.
The pcap on openwrt doesn't show any of the traffic from the laptop behind pfSense. Was is started after that had failed?
Steve
-
My number one suspect here would be the USB NIC you're using except you have that as LAN and it appears to be passing inbound there.
What is the WAN NIC in that device? What hardware off-loading do you have enabled?Steve
-
@stephenw10 The NIC assignment were correct. If I set them wrong, WAN interface didn't get any IP Address.
Because this is initial setup I didn't change any hardware offloading setting.I tested again and this time I captured OpenWRT LAN interface. pfSense WAN directly connected to OpenWRT LAN.
Traffics forwarded from my laptop don't have TS val, but from pfSense have.
-
Ok so pfSense is sending that traffic as expected and OpenWRT sees it on the LAN but no replies.
Are there any replies on the OpenWRT WAN?You're probably going to need to open that in Wireshark and look at it more closely.
You might also connect the laptop to OpenWRT directly and pcap the same traffic there when it succeeds.
https://en.wikipedia.org/wiki/Transmission_Control_Protocol#TCP_timestamps
TCP timestamps are enabled by default In Linux kernel.,[27] and disabled by default in Windows Server 2008, 2012 and 2016.[28]
Steve
-
@stephenw10 I am not familiar with packet inspection. Is there something I need to check ?
This is the packets capture result on OpenWRT LAN interface
Top = my laptop => pfSense => OpenWRT (unable to connect to internet, no reply from OpenWRT WAN)
Bottom = my laptop => OpenWRT (able to connect to internet)
