Ok, I figured it out.
When configuring the vlan interfaces, at first I hadn't noticed, it was set with a mask of /32.
The rules being generated automatically, the NAT was set for the interface, with the same mask but not for the network with the right mask.
I fixed the VLAN interface mask a while ago but the NAT was still wrong.
Working like a charm now!