So I can ping from the remote side to the local side but return packets don't get back and for some reason are routed normally (ie out to the internet/default route).
Not sure why pfSense is routing packets incorrectly though unless I'm missing some setting.