10 second delay on new TCP connections to specific IP address

[Cry Havok]

Try another location - before you spend time chasing red herrings you need to be able to narrow down the issues.

As for VPN - try this about setting up site to site with OpenVPN.  Before you do that though, do check that it is happening from more than just your office.