@raqib But it is not helping in every case, I had problems on Server 2022 and this only helped some of the time.

What "helped" me all of the time was using two separate, external vSwitches, one only for pfSense and one for all the other VMs. And that meant there had to be a physical switch in place to connect those two vSwitches. Thankfully it is working in the latest Plus-version.