what you want is net.inet.carp.preempt.
The preempt shold be enabled. That means if one interface is failing on a pfSense then ALL Interface do a failover not only one.
Also bare in mind I have seen some complications with carp and multicast on the esxi and the security settings of the protgroup / swtich. (Multicat - promismode / ARP address Change)