Is this performance to be expected?

[s1l3nce]

@michmoor Yep. That's why there are 2 entries from both sender and receiver and a SUM. I used -P2.

[JKnott]

@s1l3nce said in Is this performance to be expected?:

But when I do file transfers through smb

That's the problem. SMB is lousy for anything other than the local LAN.
Your own testing shows that

[s1l3nce]

@jknott Yep, I'm aware But why do you think the Synology NAS deals with it much better? What could be causing that difference in performance, even when the NAS has a weaker processor?

[SteveITS]

@s1l3nce Looks like it has 4 cores so 15% would be less than one. OpenVPN is single threaded as I recall. You could verify usage with "top" during the test.

I didn't dig through your settings but did you review
https://docs.netgate.com/pfsense/en/latest/recipes/index.html#openvpn

[s1l3nce]

Sorry for my ignorance guys. I've just launched iperf with -P4 (4 threads) instead of -P2 and now I'm getting nearly 300 mbps (which is the connection cap) and 25% CPU usage, which means that I'm maxing out one core.

So that's definitely a relief but now I need to figure out why my smb transfers are so bad. If you have any tips on that, I'm all ears

@steveits said in Is this performance to be expected?:

https://docs.netgate.com/pfsense/en/latest/recipes/index.html#openvpn

Yep, I did

[michmoor]

@s1l3nce said in Is this performance to be expected?:

So that's definitely a relief but now I need to figure out why my smb transfers are so bad. If you have any tips on that, I'm all ears

I would avoid SMB transfers period.
What is the latency between the client and the server?

[s1l3nce]

@michmoor said in Is this performance to be expected?:

What is the latency between the client and the server?

20ms and very stable.

I've just found something very interesting. When I do smb transfers between server and client, this happens:

• Client downloading a file from OpenVPN server
  

• Client uploading a file to OpenVPN server
  

I've also tried using WireGuard and the downloading was even worse than OpenVPN but the upload was the same; network capped.

• Client downloading a file from WireGuard server
  

• Client uploading a file to WireGuard server
  

I think I'm very close to finding the culprit. Thanks for the help and all the interest Sharing all this stuff with you is helping me a lot.

Btw, just to clarify, this is a speed test on the network where the NAS is hosted. I said 500/500 mpbs in the op because it's in my contract but for some reason I'm receiving 100 extra mbps. Not complaining

And just to be sure that the NAS is not causing this issue, I've also downloaded files from a Windows machine inside the same network to the machine with the openVPN client and the download speeds where the same as from the NAS (around 15 Megabytes/s).

[s1l3nce]

Tomorrow I will try to do the same test but with a client from a different network that also has a 600/600 mbps connection, because I'm starting to think that it could be an issue on the receiving end, meaning that maybe the client that I'm using right now has some issue with VPN downloads. I doubt this is the case but who knows...

I will update this post tomorrow with the results.

[s1l3nce]

Ok, I've done some testing from this other client and the results are pretty much the same: uploads are great (400 mbps, which is the maximum that I can expect from my firewall's processor with AES-NI) and downloads are still poor (average of 150 mbps).

I've also tested doing FTP file transfers through VPN and I got the same results as with smb. So smb is not the issue.

So these are my findings so far:

• OpenVPN does not seem to be the problem: I've got even worse server upload with WireGuard.
• SMB is not the problem: FTP through VPN gives similar results.
• My server upload is not the problem: direct SFTP uploads (bypassing the VPN) are just fine.
• My firewall processor is not the problem: the CPU caps at 25% (one core at full usage) when the upload reaches about 400 mbps.

I'm really out of ideas now but at least I've discarded loads of things

[s1l3nce]

I still haven't figured out why this is happening. The only update I have is that I've also tested this on macOS using the official openVPN client and I had the same results: perfect upload speeds (to the server) and terrible download speeds (from the server).

I don't know what else to try at this point.

[s1l3nce]

I know this topic is quite old but I just want to give a small update.

I ended up changing from OpenVPN to Wireguard. I managed to reach my maximum upload/download server speeds through Wireguard. So, even though it is more painful to configure each client, the performance increase makes a huge difference.

[s1l3nce]

Here is my transfer performance using Wireguard

DOWNLOADING FROM SERVER (Server upload performance)

UPLOADING TO SERVER (Server download performance)

I'm very happy with these results.