I Think you are mismatching between routing ang gateway role of your PFSense.
In Datacenter envireonment, we tried to manage the WAN Acces from 3 different operators. We wanted to manage the whole solution through VLAN Interfaces instead of physical interfaces. And we faced many problems, concerning routing, nating and IP Aliasing (VIP), because we wanted PF to act as a gateway role, not a simple routing role.
We Believe PF loves 1 Interface = 1 physical interface when you want your PF behaving as a gateway. In a routing only configuraiton, no problem dealing with Vlans insteads of physical interfaces.
If you want a gateway mode, i'd suggest you to dédicate 1 phys interface for Public side (WAN), and another phys interface for the Private side (LAN). You can still use VLANs for your LAN phys interface…
Be sure of what you want to NAT beside of what you want to route.
...Or deal with AON - Manual OUtbound NAT....