@breusshe I ended up finding a setting that was different between my old vpn setup and the vpn company setup for 2.5. I changed that and everything suddenly worked.
I still can't really explain why though. The entire time my VPN would connect but it did not appear to route traffic. No log entries that I could find that told me what was happening on that end either.