Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    8200/6100 Intel x553 NIC and certain SFP+ modules

    Scheduled Pinned Locked Moved Official Netgate® Hardware
    18 Posts 3 Posters 716 Views 6 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • stephenw10S Online
      stephenw10 Netgate Administrator
      last edited by

      What speeds do you usually get? Do you see any errors on the interface?

      Yes the 6100 would be identical in that respect.

      1 Reply Last reply Reply Quote 0
      • A Offline
        aholmes5
        last edited by

        I'm on a 2gbps symmetric fiber plan. I get 2300mbps up and down when I use my extra switch with a dac cable in the 8200's WAN port. When I plug the PON module into the WAN port directly (doesn't matter ix0 or ix1), I get upload speeds of 2300mbps but download speeds will be 1500mbps then within a minute or two deteriorate to 30-40mbps.

        1 Reply Last reply Reply Quote 0
        • stephenw10S Online
          stephenw10 Netgate Administrator
          last edited by

          No errors/collisions on the interface (Status > Interfaces) when that happens?

          A 1 Reply Last reply Reply Quote 0
          • A Offline
            aholmes5 @stephenw10
            last edited by

            @stephenw10 Lots of In errors. No out errors and no collisions.

            1 Reply Last reply Reply Quote 0
            • stephenw10S Online
              stephenw10 Netgate Administrator
              last edited by

              Interesting. Then check the stats in the sysctl to see what sort of errors they are: sysctl dev.ix.0

              The C3K NICs are limited in the information they can get from modules about the link state. That can mean they negotiate incorrectly or fail to link with some media types. XPON modules that that hide the real link and present to the NIC as something else so there are a few things there that could cause problems.

              A 1 Reply Last reply Reply Quote 0
              • A Offline
                aholmes5 @stephenw10
                last edited by aholmes5

                @stephenw10 SFP in 8200.txt SFP in switch.txt

                Here is what I have. I don't know how to interpret this. Lots of errors:
                dev.ix.0.mac_stats.rec_len_errs: 20
                dev.ix.0.mac_stats.remote_faults: 0
                dev.ix.0.mac_stats.local_faults: 53
                dev.ix.0.mac_stats.short_discards: 7
                dev.ix.0.mac_stats.byte_errs: 1425
                dev.ix.0.mac_stats.ill_errs: 873
                dev.ix.0.mac_stats.crc_errs: 5468
                dev.ix.0.mac_stats.rx_errs: 6374

                1 Reply Last reply Reply Quote 0
                • stephenw10S Online
                  stephenw10 Netgate Administrator
                  last edited by

                  Mmm, interesting no one type....

                  Check netstat -m make sure there's no buffer exhaustion happening.

                  A 1 Reply Last reply Reply Quote 0
                  • A Offline
                    aholmes5 @stephenw10
                    last edited by

                    @stephenw10
                    58799/4456/63255 mbufs in use (current/cache/total)
                    49273/3559/52832/1000000 mbuf clusters in use (current/cache/total/max)
                    3/2029 mbuf+clusters out of packet secondary zone in use (current/cache)
                    0/1524/1524/524288 4k (page size) jumbo clusters in use (current/cache/total/max)
                    0/0/0/524288 9k jumbo clusters in use (current/cache/total/max)
                    0/0/0/84161 16k jumbo clusters in use (current/cache/total/max)
                    113245K/14328K/127573K bytes allocated to network (current/cache/total)
                    0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
                    0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
                    0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
                    0/0/0 requests for jumbo clusters denied (4k/9k/16k)
                    0 sendfile syscalls
                    0 sendfile syscalls completed without I/O request
                    0 requests for I/O initiated by sendfile
                    0 pages read by sendfile as part of a request
                    0 pages were valid at time of a sendfile request
                    0 pages were valid and substituted to bogus page
                    0 pages were requested for read ahead by applications
                    0 pages were read ahead by sendfile
                    0 times sendfile encountered an already busy page
                    0 requests for sfbufs denied
                    0 requests for sfbufs delayed

                    1 Reply Last reply Reply Quote 0
                    • L Offline
                      lio1503
                      last edited by

                      Hi @aholmes5

                      I have the same issue. I connect my Fiber WAN on SFP+ 10G on netgate 6100 with a 10GTEK sfp+10G and my unifi switch on the second WAN on SFP+ 10G on netgate 6100 with DAC 10G cable but my download speed is reduce of 80% but my upload is fine.
                      Do you found a solution ?

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S Online
                        stephenw10 Netgate Administrator
                        last edited by

                        Are you seeing errors on the interfaces?

                        Do you have any traffic shaping?

                        L 1 Reply Last reply Reply Quote 0
                        • L Offline
                          lio1503 @stephenw10
                          last edited by lio1503

                          @stephenw10
                          I see some error on interfaces and no traffic shaping configured.

                          1 Reply Last reply Reply Quote 0
                          • L Offline
                            lio1503
                            last edited by

                            Screenshot 2025-08-06 203441.png

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S Online
                              stephenw10 Netgate Administrator
                              last edited by

                              No errors shown there. So some on the WAN?

                              How are you testing the throughput?

                              L 1 Reply Last reply Reply Quote 0
                              • L Offline
                                lio1503 @stephenw10
                                last edited by

                                @stephenw10

                                I put the wrong image sorry

                                netgate1.png netgate2.png netgate3.png

                                1 Reply Last reply Reply Quote 0
                                • stephenw10S Online
                                  stephenw10 Netgate Administrator
                                  last edited by

                                  Hmm, not really a significant number there. Nothing that would cause throttling to that extent.

                                  What about the PPPoE parent interface? Which I assume is ix0?
                                  Try: netstat -i and ifconfig -v ix0

                                  L 1 Reply Last reply Reply Quote 0
                                  • L Offline
                                    lio1503 @stephenw10
                                    last edited by

                                    Hi @stephenw10

                                    Here the result of commands

                                    Screenshot 2025-08-08 112744.png

                                    Screenshot 2025-08-08 112955.png

                                    Thanks

                                    1 Reply Last reply Reply Quote 0
                                    • stephenw10S Online
                                      stephenw10 Netgate Administrator
                                      last edited by

                                      Ok huge number of input errors on ix0. That's what you'd expect for bad downloads.

                                      You have an XPON module in there I assume? Can you access that to get stats?

                                      You can check the sysctl output for ix0 to see what type of errors those are: sysctl dev.ix.0

                                      1 Reply Last reply Reply Quote 0
                                      • First post
                                        Last post
                                      Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.