Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    10GB Lan causing strange performance issues, goes away when switched over to 1GB

    Scheduled Pinned Locked Moved General pfSense Questions
    71 Posts 6 Posters 5.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • N
      ngr2001 @ngr2001
      last edited by

      @ngr2001

      In addition, when it comes to "Normal" vs "Warp" mode, I think I would prefer to run in "Warp" mode, I do not see any down side to that setup for my use case. At any point in time I will only have 4-12 hardwired clients active, only 2-3 of which will have any kind of substantial traffic.

      1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator @ngr2001
        last edited by

        @ngr2001 said in 10GB Lan causing strange performance issues, goes away when switched over to 1GB:

        What doesn't make sense to me is how cheap these switches can be bought for on Ebay.

        Probably because of how loud and power hungry they are. Like most (all?) older 10G switches.

        N 1 Reply Last reply Reply Quote 0
        • L
          lnguyen @lnguyen
          last edited by

          @lnguyen Switches are either store & forward or cut through forwarding. Its $200 because its an EOL DC switch. I deployed hundreds of these. It runs NexusOS but the command structure is very similar to that of Cisco Catalyst switches. Noise level and power draw will be higher than your current one. Its also all SFP+ ports.

          N 1 Reply Last reply Reply Quote 0
          • N
            ngr2001 @stephenw10
            last edited by

            @stephenw10

            According to the data sheets the 3650 uses 99W at idle and the 3854-X uses 112W at idle. In the read world my 3650 with light load is consuming 60W according to my UPS. Both have a similar PSU and FAN design I cant imagine the power or sound being any different.

            That said, do you have any other recommendations, perhaps a Cisco 350X or 550X would be better suited for my needs. I would prefer to drop the my current 60W load to 20W if possible, but again I am chasing speed here.

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              I have nothing in mind. I couldn't run a switch like that here.

              1 Reply Last reply Reply Quote 0
              • N
                ngr2001 @lnguyen
                last edited by

                @lnguyen

                What are your thoughts on the Cisco 350X or 550X ?

                L 1 Reply Last reply Reply Quote 0
                • L
                  lnguyen @ngr2001
                  last edited by

                  @ngr2001 It’s Cisco’s lowest end gear. Don’t care for that product line in that channel of the market. There are other brands serving that channel that have better products

                  N 1 Reply Last reply Reply Quote 0
                  • N
                    ngr2001 @lnguyen
                    last edited by

                    @lnguyen I am open to any suggestions, I would love some suggestions on makes and models that I can research and price check on ebay.

                    L 1 Reply Last reply Reply Quote 0
                    • L
                      lnguyen @ngr2001
                      last edited by

                      @ngr2001 What are you trying to achieve? Seems as though your issue was resolved with the command I gave you. Are you trying to get lower latency? The lower latency of CTF of a Nexus switch doesn't really improve anything for you when the Internet latency is far greater.

                      N L 2 Replies Last reply Reply Quote 0
                      • N
                        ngr2001 @lnguyen
                        last edited by

                        @lnguyen

                        My goals in order of importance:

                        1. 10Gb ports (I only have 2 today, that's not enough need 12-24)
                        2. Lower Latency (May be moot to your point)
                        3. Lower Power consumption (Current 3650 is using 60W)
                        4. Reduce noise (Currently not an issue with the 3650)
                        5. Price needs to be under $500 bucks new or used

                        So in short I am looking for either a 24 or 48 port switch wherein all ports are 10Gb, preferably RJ45 but SPF+ is fine too.

                        That is why the nexus 3000 was so appealing to me, the only ? would be is if the nexus would be louder and use more energy than the 3650.

                        1 Reply Last reply Reply Quote 0
                        • L
                          lnguyen @lnguyen
                          last edited by lnguyen

                          @lnguyen Go look for Cisco Catalyst WS-C3850-12X-48U for well under $500. Or Cisco Catalyst WS-C3850-24XU. The difference is 48 ports of which ports 37-48 are 5-speed mGig vs 24 ports that are 5-speed mGig.

                          N 1 Reply Last reply Reply Quote 0
                          • N
                            ngr2001 @lnguyen
                            last edited by

                            @lnguyen

                            I'll def take a look thank you, however I just stumbled onto this gem.

                            https://forums.servethehome.com/index.php?threads/brocade-icx-series-cheap-powerful-10gbe-40gbe-switching.21107/

                            This has me seriously considering a Brocade ICX7250. It has 8(x) 10Gb ports and 48 1Gb ports. You can get these on ebay for under 100 bucks and the idle power is around 50W and from what I read its near silent. It also keeps getting better in that anyone can download their latest firmware and the license is basically free (honor system).

                            It seems to check off all my boxes, I have no experience with Brocade and from what I read they seem to pretty reliable and fast, thoughts ??

                            L 1 Reply Last reply Reply Quote 0
                            • L
                              lnguyen @ngr2001
                              last edited by

                              @ngr2001 Whatever works for you. Brocade/Ruckus ICX7250 are enterprise switches. Whatever you buy is going to be overkill for what you are probably doing. What drives your 10GbE needs?

                              N 1 Reply Last reply Reply Quote 0
                              • stephenw10S
                                stephenw10 Netgate Administrator
                                last edited by stephenw10

                                I have a Brocade ICX6450 (4 10G ports) and have been pretty happy with it. I did swap out the fans for some quieter ones.

                                I was also looking at the 7250. Missed one a few weeks back on ebay. Most are 48 port and I just don't need that.

                                And, yes, total overkill for my needs!

                                N 1 Reply Last reply Reply Quote 0
                                • N
                                  ngr2001 @stephenw10
                                  last edited by

                                  @stephenw10

                                  Good to hear, they seem like a really solid choice, plenty of ebay for cheap, any idea what your real world idle power draw is ?

                                  1 Reply Last reply Reply Quote 0
                                  • N
                                    ngr2001 @lnguyen
                                    last edited by

                                    @lnguyen

                                    The 10Gb need comes from running a file server / NAS at 10Gg, a few of my workstations support 10Gb and I want to move large 4K video files faster. Makes a huge difference when dealing with dozens of 8GB+ files. I will also be upgrading to Wifi 7 and the AP's support 10GB. I wired my house back in the day with Cat 6E 550mhz premium cable so I should be good to go, just need the switch at this point.

                                    L 1 Reply Last reply Reply Quote 0
                                    • L
                                      lnguyen @ngr2001
                                      last edited by lnguyen

                                      @ngr2001 said in 10GB Lan causing strange performance issues, goes away when switched over to 1GB:

                                      I will also be upgrading to Wifi 7 and the AP's support 10GB

                                      I don't see why you would want the Brocade over the Cisco then? The copper ports with PoE are 1GbE. The WS-C3850-12X-48 or WS-C3850-24X have 12 or 24 x mGig ports with PoE+ to support this future WiFi 7 AP. Adding the Network module C3850-NM-8-10G will give you 8 x 10GbE SFP+ ports

                                      N 2 Replies Last reply Reply Quote 0
                                      • N
                                        ngr2001 @lnguyen
                                        last edited by

                                        @lnguyen

                                        The ICX7250 has 8(x) 10Gb SPF+ ports, all 8 are full 10Gb, 2 only come active by default, you can activate the other 6 with a single "free" license command. The other 45 RJ45 ports are 1Gb. In addition the rated idle power consumption is only 50W and I am sure that will likely benchmark lower especially as I disable ports etc. Seems like a win win to me.

                                        The WS-C3850-12X-48U is very nice though too I looked very hard at it, this one would save me the hassle of getting SFP+ adapters. The only reason I am leaning away from CIsco is that they are little more a used nightmare in regards to lic and images. Rarely do the sellers show the output of system config / lic and you typically get a Base IP lic which does not support things like VLAN routing which I would not mind having. Looks like I get all Layer 3 stuff with the brocade for much less hassle.

                                        1 Reply Last reply Reply Quote 0
                                        • N
                                          ngr2001 @lnguyen
                                          last edited by

                                          @lnguyen

                                          Also I will not being using POE for the AP, it will be plugged into outlet and the uplink will simply be 10Gb to the switch. The switch will not need to know or understand Wifi 7, it will be just another device on the network.

                                          1 Reply Last reply Reply Quote 0
                                          • N
                                            ngr2001
                                            last edited by

                                            Quick Update:

                                            I bought a Brocade ICX-7250 from ebay. So far its been great, flashed to newest firmware, activated licenses, all very easy. I deployed a basic config and swapped out my Cisco.

                                            Couple of notables:

                                            1. Idle power with a dozen or so clients not very active was only 42W, my Cisco 3650 was 60W.

                                            2. The 10Gb Lan mixed with 1Gb WAN & 1Gb Clients speed issue did not happen. Right out of the box with no config tweaks I am getting full WAN speeds and I am not seeing any errors in any of the port statistics.

                                            3. Noise wise the ICX-7250 at idle once the fans spin down may actually have a slightly higher pitch tone and may be 1-2db louder than the 3650, it tolerable, mine sits in a dedicated closet anyway. I attempted to replace the fans with Notua's. I found out that the most recent firmware does a speed check for fan1, if its does not spin fast enough the switch will not boot. So unfortunately I was not able to mod this switch to dead silence yet. I do not know what the RPM cut off range is yet, I suspect around 6800rpm is the min it needs to see at idle, not sure i feel like testing more fans, its quiet enough for now.

                                            stephenw10S C 2 Replies Last reply Reply Quote 2
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.