Only some vnc traffic getting through

[TechResQ]

I have rules set up to explicitly allow ALL traffic to 4 ip addresses, and yet only one of the IP addresses works. This was in attempt to get VNC working on the REMOTE servers. My local rule is set up as follows:

Pass | WAN | IPv4 | Any Protocol | source = [Alias of IPS] | destination = any] | Log Packets

The logs show that its allowing traffic for all four ip's, however, only one server connects. I can connect to the remote servers from outside of the pfsense protected network. Any ideas?