Trying to find the bottleneck



  • Hi,

    I just upgraded my pfSense box for a sempron 210U @1.5Ghz, 1GiB RAM, dual Intel Nic pro pcie x4 for trunk, realtek GiB for wan.

    The dual Nic is configured as LACP and contains 5 vlans.

    Here is the result of iperf -c (from an atom n270 plugged on one of the LACP clan), pfSense is the server :

    
    iperf -c 10.0.11.1 -i1                                                                                                                                                                                             :(
    ------------------------------------------------------------
    Client connecting to 10.0.11.1, TCP port 5001
    TCP window size: 21.6 KByte (default)
    ------------------------------------------------------------
    [  3] local 10.0.11.24 port 60291 connected with 10.0.11.1 port 5001
    [ ID] Interval       Transfer     Bandwidth
    [  3]  0.0- 1.0 sec  21.1 MBytes   177 Mbits/sec
    [  3]  1.0- 2.0 sec  49.0 MBytes   411 Mbits/sec
    [  3]  2.0- 3.0 sec  51.0 MBytes   428 Mbits/sec
    [  3]  3.0- 4.0 sec  49.4 MBytes   414 Mbits/sec
    [  3]  4.0- 5.0 sec  49.5 MBytes   415 Mbits/sec
    [  3]  5.0- 6.0 sec  51.8 MBytes   434 Mbits/sec
    [  3]  6.0- 7.0 sec  50.4 MBytes   423 Mbits/sec
    [  3]  7.0- 8.0 sec  50.4 MBytes   423 Mbits/sec
    [  3]  8.0- 9.0 sec  50.2 MBytes   422 Mbits/sec
    [  3]  9.0-10.0 sec  50.4 MBytes   423 Mbits/sec
    [  3]  0.0-10.0 sec   473 MBytes   397 Mbits/sec
    iperf -c 10.0.11.1 -i1  0,04s user 8,99s system 89% cpu 10,045 total
    
    

    From the pfSense box now, the other box is the server

    
    iperf -c 10.0.11.24 -t5 -i1
    ------------------------------------------------------------
    Client connecting to 10.0.11.24, TCP port 5001
    TCP window size: 65.0 KByte (default)
    ------------------------------------------------------------
    [  3] local 10.0.11.1 port 58487 connected with 10.0.11.24 port 5001
    [ ID] Interval       Transfer     Bandwidth
    [  3]  0.0- 1.0 sec  79.6 MBytes   668 Mbits/sec
    [  3]  1.0- 2.0 sec   112 MBytes   938 Mbits/sec
    [  3]  2.0- 3.0 sec   109 MBytes   916 Mbits/sec
    [  3]  3.0- 4.0 sec  76.6 MBytes   643 Mbits/sec
    [  3]  4.0- 5.0 sec   112 MBytes   938 Mbits/sec
    [  3]  0.0- 5.0 sec   490 MBytes   821 Mbits/sec
    
    

    I try to enable the tcp offloading (disabled by default), but no changes.

    I's a great improvement compared to the old box (130Mbit/s max) but I'm quite disappointed for the moment.

    Any idea will be welcome :)

    Thanks.

    Note : Running 2.1 RC2 snapshots



  • Oups, just found myself… I can reach the Gigabit by increasing the tcp windows size.

    At least could be usefull for others :)