If you need external clients to connect to the server you would need rules on the WAN to allow that.
Rules on the VLAN would allow the server to connect out.
That is assuming you have not assigned the bridge as WAN, for example, which is something you could do but probably just complicates things.
Steve