6100 slow throughput over WAN

njacobs

I've previously posted about my 3100 not being able to route a gigabit over the WAN, so I upgraded to a 6100 and so far the results have been disappointing.

With PPPoE I still appear to be CPU limited and am maxing out at 850 Mbps over the WAN (ix3):

last pid: 68402;  load averages:  0.57,  0.28,  0.24                                          up 0+00:35:49  10:14:45
550 threads:   6 running, 510 sleeping, 34 waiting
CPU:  0.0% user,  0.0% nice, 29.0% system,  0.0% interrupt, 71.0% idle
Mem: 93M Active, 66M Inact, 398M Wired, 7252M Free
ARC: 184M Total, 30M MFU, 150M MRU, 184K Anon, 683K Header, 3349K Other
     52M Compressed, 131M Uncompressed, 2.53:1 Ratio
Swap: 1024M Total, 1024M Free

  PID USERNAME    PRI NICE   SIZE    RES STATE    C   TIME    WCPU COMMAND
   11 root        155 ki31     0B    64K CPU2     2  34:30  99.54% [idle{idle: cpu2}]
    0 root        -76    -     0B   720K CPU0     0   2:16  99.36% [kernel{if_io_tqg_0}]
   11 root        155 ki31     0B    64K CPU3     3  34:52  96.96% [idle{idle: cpu3}]
   11 root        155 ki31     0B    64K RUN      1  34:29  78.91% [idle{idle: cpu1}]
    0 root        -76    -     0B   720K -        1   0:08  20.73% [kernel{if_io_tqg_1}]
   11 root        155 ki31     0B    64K RUN      0  32:38   0.73% [idle{idle: cpu0}]
    0 root        -76    -     0B   720K -        2   0:19   0.20% [kernel{if_config_tqg_0}]
74711 root         20    0    14M  4672K CPU1     1   0:03   0.16% top -aSH

When offloading the PPPoE to a Ubiquiti EdgeRouter X in front of the 6100 I'm still only achieving 850 Mbps, but peak CPU usage has dropped as expected:

last pid: 46239;  load averages:  0.78,  0.34,  0.25                                          up 0+00:45:07  10:24:03
550 threads:   6 running, 510 sleeping, 34 waiting
CPU:  0.5% user,  0.0% nice, 25.9% system,  0.0% interrupt, 73.6% idle
Mem: 87M Active, 68M Inact, 410M Wired, 7245M Free
ARC: 184M Total, 30M MFU, 151M MRU, 174K Anon, 690K Header, 3395K Other
     52M Compressed, 132M Uncompressed, 2.54:1 Ratio
Swap: 1024M Total, 1024M Free

  PID USERNAME    PRI NICE   SIZE    RES STATE    C   TIME    WCPU COMMAND
   11 root        155 ki31     0B    64K RUN      2  43:34  98.60% [idle{idle: cpu2}]
   11 root        155 ki31     0B    64K CPU0     0  41:32  98.32% [idle{idle: cpu0}]
   11 root        155 ki31     0B    64K CPU3     3  43:58  86.31% [idle{idle: cpu3}]
    0 root        -76    -     0B   720K CPU1     1   0:27  76.98% [kernel{if_io_tqg_1}]
   11 root        155 ki31     0B    64K RUN      1  43:16  22.97% [idle{idle: cpu1}]
    0 root        -76    -     0B   720K -        3   0:14  12.82% [kernel{if_io_tqg_3}]
  387 root         52    0   132M    43M accept   0   0:04   1.16% php-fpm: pool nginx (php-fpm)
  388 root         22    0   135M    45M accept   3   0:05   0.88% php-fpm: pool nginx (php-fpm){php-fpm}
    0 root        -76    -     0B   720K -        3   0:20   0.20% [kernel{if_config_tqg_0}]
74711 root         20    0    14M  4692K CPU2     2   0:04   0.16% top -aSH

When I connect my host machine directly to the ER-X I'm consistently achieving > 960 Mbps.

The 6100 is a running a clean install of 22.05 with no additional packages installed.

Reading other's posts the 6100 should easily be able to handle these speeds over the WAN. Does anyone have any ideas?

Thanks,

Nathan

njacobs

Scrap that. I had an inconsistency in my client testing setup.

I'm pleased to report that the 6100 is achieving > 960 Mbps even when handling the PPPoE directly.

Very happy.

Nathan

stephenw10

Great to hear, thanks for the update.