I assume it still responds from the LAN side though?
And the other device never loses it's IP address?
I would try running a packet capture on WAN when it fails to see what's happening. I expect to see pfSense either ARPing for the gateway or trying to renew it's DHCP lease.
You should see the DHCP client logging that though.