Multi wan setup routing FFR pf keeps doesn't allow routes to be updated

[Ofloo]

So I use IPsec, I have multi one setup so setup ipsec tunnel through each while ago one of these wan interfaces went bad so routed all traffic through 1 wan port.

|multiwan| -- site1
 |             |
 ` ----------- site2

Now that everything is working again, so routed each site to it's own wan again, done this with static route in FRR for some reason the ipsec tunnel wouldn't connect, when i tcpdump the traffic I noticed that it still went out the wrong wan?

Restart FRR, stil nothing changed. Restarted IPSec still nothing changed, checked firewall rules as I if there was any rule redirecting the traffic there was not.

Checked route get if the IP was supposed to be routed through the right interface it did?

did pfctl -d and pfctl -e and everything worked !!!? But no rules that was redirecting the traffic? Could this be a bug or something, I do have sticky connections enabled. But i would guess this shouldn't matter as ipsec was restarted completely?