10 second delay on new TCP connections to specific IP address
-
Try another location - before you spend time chasing red herrings you need to be able to narrow down the issues.
As for VPN - try this about setting up site to site with OpenVPN. Before you do that though, do check that it is happening from more than just your office.