@Bob-Dig No, setting the default gateway did not not solve the problem. Whenever I use WAN Chunian ISP for my LAN PC interface (PC connected to pfsense via ethernet), the issue started to happen. And if the same WAN Chunian ISP is used with LAN Router (Home wifi router), then it keeps working fine.
Not sure, if I should try capturing the packets if that can help.