How can i get 10gb ethernet lan speeds?



  • So I have Verizon FIOS and I pay for 50mbps down and 50mbps up which is about 6.25megabytes per second. However, when I transfer files locally under LAN I get speeds of about 75megabytes per second with scp (75MB/s thats megabytes right?). I also did throughput test a while back although I forget how I did it but I measured to around 1Gbps. So, how do people have things like 10Gbps local networks? I am interesting in increasing my speed if possible. I do not know a lot about networking. All of my cables are CAT6 except for the WAN interface that goes out to my modem (lol I know).

    EDIT: I used iperf to do the test and I just did another quick one, resulted in

    [ ID] Interval       Transfer     Bandwidth
    [  3]  0.0-10.0 sec  1.10 GBytes   941 Mbits/sec
    
    

    EDIT2: I just realized my NICs are limited to 1Gbps….so that's where it is. I would have to buy a 10Gbps NIC for both my client and server. Okay, I pretty much answered myself..



  • 75MiB/s is quite a bit below 1Gb/s. I get 114MiB/s on my 1Gb network, which is nearly the max. Start simple, get a faster HD or something to make your 1Gb network work at full speed before you spend huge amounts of money on a 10Gb network.


  • Rebel Alliance Global Moderator

    "I would have to buy a 10Gbps NIC for both my client and server"

    If only it was that easy - well guess it is if  you want to drop some $$.  Have you priced 10Ge switches as of late? ;)

    If when you doing file copies your only seeing 75MBps – and when you test with iperf you see 941mbps your bottleneck in that transfer is most likely not the network.  HDD, antivirus, firewalls on your clients, etc.  Just cpu of the machine, etc.  I run very budget home hardware and I see 100MBps + moving files back and forth without any issues.

    What are you speeds with just ftp or just plain old smb, depending on your client and server smb3 should be viable which is way better than the older smb1/cifs/smb2 protocols.

    SCP is prob not the best protocol for HIGH speed tansfers ;)



  • @altiris:

    So I have Verizon FIOS and I pay for 50mbps down and 50mbps up which is about 6.25megabytes per second. However, when I transfer files locally under LAN I get speeds of about 75megabytes per second with scp (75MB/s thats megabytes right?). I also did throughput test a while back although I forget how I did it but I measured to around 1Gbps. So, how do people have things like 10Gbps local networks? I am interesting in increasing my speed if possible. I do not know a lot about networking. All of my cables are CAT6 except for the WAN interface that goes out to my modem (lol I know).

    EDIT: I used iperf to do the test and I just did another quick one, resulted in

    [ ID] Interval       Transfer     Bandwidth
    [  3]  0.0-10.0 sec  1.10 GBytes   941 Mbits/sec
    
    

    EDIT2: I just realized my NICs are limited to 1Gbps….so that's where it is. I would have to buy a 10Gbps NIC for both my client and server. Okay, I pretty much answered myself..

    Although cabling is generally better today, if you have custom cable runs, its worth checking the cables are terminated and shielded properly, as that can cause massive numbers of retries across a network. A quick & dirty test you can do without any proper cabling equipment is transferring a large file say 1GB in size across the different cable runs ie server to workstations, the one's that it run slowest over are often not terminated/shielded properly.

    Always worth getting shielded as well, I've seen power supplies for desktop calculators affect the data across the network cable.

    fwiw.



  • SMB3.1 support multiple TCP streams to increase throughput over multiple interfaces. A multi-port NIC and a cheap managed 1Gb switch could dramatically increase your SMB file transfers.


  • Rebel Alliance Global Moderator

    ^ exactly!!  If you want to play with the new smb 3.1 you would need windows 10 and or server 2016 which is out in TP, TP2 dropped a couple of months back.

    Now if you can get multiple streams going over a lagged/bonded connection you could could see some large numbers only using very cheap gig nics and decent switch.  Smart or managed gig switches that support lagg/portchannel/etherchannel/etc.. can be had very reasonable home price points.  I picked up a SG300-10 for under $200 back a while ago.. I have see that model for under 180 easy currently.  And there are for sure other choices under the 100 mark for sure.

    But with your iperf test at 941mbps I don't think its your network holding you back to 75MBps – could be your HDD, older drives for sure can not handle very sustained high speed xfers..  And use a better protocol than scp.. While its great and secure its not screaming fast..