Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    10GB Fiber network, yes/no?

    Scheduled Pinned Locked Moved General pfSense Questions
    22 Posts 9 Posters 2.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • AndyRHA
      AndyRH
      last edited by

      New information... a one time fee and lower monthly. This becomes a math problem. Even if you can only get 1.1Gb out of it, cheaper for the same or better is always a plus.

      o||||o
      7100-1u

      1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by

        I mean if I could get anything like that cost here I'd probably jump at it. Even if I never actually used that bandwidth!

        1 Reply Last reply Reply Quote 0
        • bmeeksB
          bmeeks
          last edited by bmeeks

          I tend to agree with most everyone else here. If you are not currently routinely maxing out a 1 Gig connection, then upgrading to 10 Gig is not really necessary. If the monthly rate is cheaper, then maybe I would, but ...

          1. Read all the fine print and make sure the monthly rate quoted is not a trial period "teaser rate" and the price jumps up to a higher amount after some time period. ISPs are sneaky, so read ALL of the fine print.

          2. Even if the rate is truly cheaper over a long term, do the math to pit monthly rate savings with the $300 one-time upgrade fee. How long would it take to break-even on the upgrade fee and then start realizing any true monthly savings?

          3. Lastly, without upgrading all of your local network infrastructure (switches and likely firewall hardware) you won't be able to take advantage of 10 Gig network speeds.

          I've been in the IT business for a very long time. I started with 1200 and then 2400 baud dial-up modems. In the 1990s I got my first "high speed" home Internet access in the form of a 128K ISDN dial-up connection that cost me an arm and a leg for the modem and the service. Eventually that was upgraded to 1.5 megabit DSL service. The DSL then got upgraded to a 6 megabit circuit. Several years ago I ditched the DSL and moved to cable first at 12 megabits and then fairly quickly taking advantage of upgrades to 24 megabits, 50 megabits, 100 megabits, and finally 1 Gig (820 megabits or so actually) for download speeds until the first of this year (2023). A local ISP finally offered 1 Gig symmetrical FTTH (fiber-to-the-home) service. They began installing the fiber in the ground in late December 2022 and into January 2023, and I signed up and had active service in February of 2023. They also offer a 2.5 Gig down with 1 Gig up option, but I've stayed with the 1 Gig symmetrical for now as it meets all my needs including uploading lots of data to cloud storage. Speed tests at any time of the day routinely show 945 megabits/sec or so in each direction (down and up). I'm a happy camper at $89.95 per month which includes a $10 ONT/modem fee. I live in a small rural town with a population of around 13,000 or so. Having 1 Gig symmetrical FTTH in our area is really quite amazing when you think about it.

          1 Reply Last reply Reply Quote 1
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            Mmm, I recall thinking that 500K DSL was very expensive and probably not worth it. Until I got it and then couldn't imagine going back.

            But at that point my existing home network and hosts were all 10M or 100M so using that was no issue.

            1 Reply Last reply Reply Quote 1
            • bmeeksB
              bmeeks
              last edited by bmeeks

              My first exposure to business networking was 4 megabit Token Ring (I think I'm remembering the data rate correctly) followed quickly by 10 megabits Ethernet. That morphed into 100 megabits, and then started growing quickly.

              Our very early corporate "road warrior" setup was banks of 2400 baud (and later 14,400 baud) dial-up modems that users connected into the corporate network with using IBM ThinkPad laptops. The network backend was Novell NetWare.

              My how things have changed since then 🙂.

              I guess the next big revolution will be some kind of subspace link for the transport medium (a whimsical reference to my Star Trek avatar) and quantum computers for the processing ☺. And probably with an option to have all that surgically implanted in your head. Oh, and anyone with a less than petabits/sec connection will be considered an "old fart" LOL!

              JKnottJ 1 Reply Last reply Reply Quote 2
              • M
                mer @AndyRH
                last edited by

                @AndyRH said in 10GB Fiber network, yes/no?:

                IMO at this time 1Gb for home is fine.

                At one point in time T1 speeds were more than adequate for big business.

                :)

                1 Reply Last reply Reply Quote 1
                • JKnottJ
                  JKnott @chudak
                  last edited by JKnott

                  @chudak said in 10GB Fiber network, yes/no?:

                  Any feedback is appreciated

                  10 Gb for home use is overkill. In fact, it's overkill for many businesses. The first time I came across 10 Gb in my work was at a datacentre for a major bank. Back in the late 90s, when I was at IBM Canada, we had a 45 Mb DS3 connection and there were about 5000 employees in the building, IIRC.

                  My own connection is 1.5 Gb down, but I'm limited to 1 Gb by my hardware. Even that is overkill, as it was when I had 500 Mb down. I have long passed the point where I see any real improvement from increased bandwidth.

                  BTW, my first Internet connection was via dial up modem, with 56K down and 33.6K up. That was fast back then.

                  PfSense running on Qotom mini PC
                  i5 CPU, 4 GB memory, 32 GB SSD & 4 Intel Gb Ethernet ports.
                  UniFi AC-Lite access point

                  I haven't lost my mind. It's around here...somewhere...

                  bmeeksB 1 Reply Last reply Reply Quote 0
                  • JKnottJ
                    JKnott @bmeeks
                    last edited by

                    @bmeeks said in 10GB Fiber network, yes/no?:

                    4 megabit Token Ring (I think I'm remembering the data rate correctly)

                    Yep, then it was 16 Mb.

                    PfSense running on Qotom mini PC
                    i5 CPU, 4 GB memory, 32 GB SSD & 4 Intel Gb Ethernet ports.
                    UniFi AC-Lite access point

                    I haven't lost my mind. It's around here...somewhere...

                    1 Reply Last reply Reply Quote 0
                    • bmeeksB
                      bmeeks @JKnott
                      last edited by

                      @JKnott said in 10GB Fiber network, yes/no?:

                      BTW, my first Internet connection was via dial up modem, with 56K down and 33.6K up.

                      Yea, I almost forgot about those higher dial-up speeds. Had some 33K and 56K modems for a bit before I moved to the 128K ISDN dial-up. My work location had T1 and then DS3 links in the early days.

                      1 Reply Last reply Reply Quote 0
                      • bmeeksB
                        bmeeks
                        last edited by bmeeks

                        I won't go so far out on the limb to say "you never need 10 Gig at home". But for today and the near future 1 Gig service is probably plenty for home use. My 1 Gig service really is not noticeable at all compared to my former 100 megabit service with day-to-day web browsing, email, or even streaming. Once you get to about 24-50 megabits down, and a reasonable upstream bandwidth, streaming will work fine.

                        The biggest benefit of the symmetrical Gigabit service I've personally seen for my purposes is downloading large files is really fast (like ISO images or videos, for example). But the even bigger plus is the high speed upload path lets me finally take advantage of personal cloud storage for an "offsite disaster recovery" scenario for stuff like personal photos and documents. I can send data to the cloud nearly as fast as I can send it over to a local file server on the LAN. That is a sort of "game changer" for backups.

                        I'm sure the time will come, though, where 10 Gig will be the new "standard". AI and virtual reality is going to continue to progress, and that will demand more and more bandwidth (especially virtual reality and its derivations).

                        1 Reply Last reply Reply Quote 1
                        • G
                          Gblenn
                          last edited by

                          I got the opportunity to upgrade my connection to 10G through my service provider, where I happen to know the CEO and owner... Although I am not really paying anything for it, it still cost quite a bit of money, and work, to make the upgrade anyway...

                          First and foremost I had to upgrade my ports on my pfsense machine, as well as some servers running on the same (all VM). Similarly I upgraded my TrueNAS server and at least one 10G switch was needed for this (to run DACs in the rack). One the cheaper one's I could find was an 8 port SFP+ only switch (TP-Link Omada). But it turns out that 10G RJ45 SFP-transcievers have some limitations in the length of cables they support (25-30 meters), at least when looking the reasonably priced one's. So I ended up adding another switch with RJ45 ports that can handle longer cables. And finally I upgraded my PC with a 10G NIC...
                          To summarize, the material "needed" for this upgrade came to:
                          3x Intel X520-T2 cards
                          1x 8 Port SFP+ managed switch
                          1x 4 + 2 port (RJ45 & SFP+) managed switch
                          1x 10G NIC for my PC
                          And quite a few hours to get things working as I wanted, not the least because of issues with cable lengths.

                          The 4 port switch supports 2.5G as well and it turns out that my Proxmox servers had 2.5G on the motherboard NIC's which was sort of a bonus.

                          Is it worth it... well, I am not paying anything more for the connection, and it was a great learning experience and a quite fun project. Also, the upgrade on the LAN side is actually quite good as I am now able to max out my disks (incl cache) on the NAS, rather than the network.

                          An internet connection with 10G is definitely overkill as most have stated already, and for the most part there is no difference whatsoever. EXCEPT for when there are any one of all these huge upgrades to Call of Duty...!! Luckily the CDN's used by Blizzard and Steam seem to be extremely capable and I get 60-70 GB upgrades in minutes where my friends wait for an hour or two... :)

                          As far as home broadband goes, I think 2.5G is a better option probably. Most or all new computers/motherboards support it. 2,5G switches are not horrendously expensive, and cabling isn't as sensitive as for 10G...

                          chudakC 1 Reply Last reply Reply Quote 3
                          • chudakC
                            chudak @Gblenn
                            last edited by

                            @Gblenn said in 10GB Fiber network, yes/no?:

                            I got the opportunity to upgrade my connection to 10G through my service provider, where I happen to know the CEO and owner... Although I am not really paying anything for it, it still cost quite a bit of money, and work, to make the upgrade anyway...

                            First and foremost I had to upgrade my ports on my pfsense machine, as well as some servers running on the same (all VM). Similarly I upgraded my TrueNAS server and at least one 10G switch was needed for this (to run DACs in the rack). One the cheaper one's I could find was an 8 port SFP+ only switch (TP-Link Omada). But it turns out that 10G RJ45 SFP-transcievers have some limitations in the length of cables they support (25-30 meters), at least when looking the reasonably priced one's. So I ended up adding another switch with RJ45 ports that can handle longer cables. And finally I upgraded my PC with a 10G NIC...
                            To summarize, the material "needed" for this upgrade came to:
                            3x Intel X520-T2 cards
                            1x 8 Port SFP+ managed switch
                            1x 4 + 2 port (RJ45 & SFP+) managed switch
                            1x 10G NIC for my PC
                            And quite a few hours to get things working as I wanted, not the least because of issues with cable lengths.

                            The 4 port switch supports 2.5G as well and it turns out that my Proxmox servers had 2.5G on the motherboard NIC's which was sort of a bonus.

                            Is it worth it... well, I am not paying anything more for the connection, and it was a great learning experience and a quite fun project. Also, the upgrade on the LAN side is actually quite good as I am now able to max out my disks (incl cache) on the NAS, rather than the network.

                            An internet connection with 10G is definitely overkill as most have stated already, and for the most part there is no difference whatsoever. EXCEPT for when there are any one of all these huge upgrades to Call of Duty...!! Luckily the CDN's used by Blizzard and Steam seem to be extremely capable and I get 60-70 GB upgrades in minutes where my friends wait for an hour or two... :)

                            As far as home broadband goes, I think 2.5G is a better option probably. Most or all new computers/motherboards support it. 2,5G switches are not horrendously expensive, and cabling isn't as sensitive as for 10G...

                            Good summary thx
                            How much did you end up in dollars?

                            G P 2 Replies Last reply Reply Quote 0
                            • G
                              Gblenn @chudak
                              last edited by

                              @chudak I got the X520 cards as refurb server cards which cost me somewhere around $80-85 each. I use all Omada switches and AP's and therefore ended up with the TL-SX3008F and TL-SX3206HPP. These are 260-550 USD roughly.
                              The ISP sent me two RJ45 10G modules free of charge and the SFP+ DAC's I use are Unifi or some Chinese brand version (12-15 USD each). And then it was the TP-Link tx401 NIC for the PC at around 80 USD.
                              So all in all I ended up spending about 1200 USD I believe... perhaps a bit more with all the DACs. Plus I had to modify the SX3008 by putting fans inside it as it was overheating when using the RJ45 modules...

                              chudakC 1 Reply Last reply Reply Quote 0
                              • chudakC
                                chudak @Gblenn
                                last edited by

                                @Gblenn said in 10GB Fiber network, yes/no?:

                                @chudak I got the X520 cards as refurb server cards which cost me somewhere around $80-85 each. I use all Omada switches and AP's and therefore ended up with the TL-SX3008F and TL-SX3206HPP. These are 260-550 USD roughly.
                                The ISP sent me two RJ45 10G modules free of charge and the SFP+ DAC's I use are Unifi or some Chinese brand version (12-15 USD each). And then it was the TP-Link tx401 NIC for the PC at around 80 USD.
                                So all in all I ended up spending about 1200 USD I believe... perhaps a bit more with all the DACs. Plus I had to modify the SX3008 by putting fans inside it as it was overheating when using the RJ45 modules...

                                Great thx

                                No ethernet cable upgrade? Are you using CAT5E?

                                G 1 Reply Last reply Reply Quote 0
                                • P
                                  pwood999 @chudak
                                  last edited by

                                  @chudak Out of curiosity what speed are you actually seeing on the 10G connection. If it's standard XGS-PON, that usually maxes out around 8.5Gbps data payload due to overheads in the PON system. If the ISP is using 25Gb PON, then they could theoretically deliver 10Gb data rates.

                                  chudakC 1 Reply Last reply Reply Quote 0
                                  • G
                                    Gblenn @chudak
                                    last edited by

                                    @chudak No I cabled my house back in 2006 and used Cat6 as it were. But there are a few of them on the middle floor where I didn't have space in the "duct" coming up from the basement. So I ended up running them a different path all the way from the basement via the attic and then down again, which apparently exceeded the 30m limit of the RJ45 modules.
                                    But when connecting the TP-Link tx401 to the TL-SX3206HPP it works even those longer cables... I suppose 5E will work fine in most cases as well, as long as you keep to reasonable lengths.

                                    1 Reply Last reply Reply Quote 1
                                    • chudakC
                                      chudak @pwood999
                                      last edited by

                                      @pwood999 said in 10GB Fiber network, yes/no?:

                                      @chudak Out of curiosity what speed are you actually seeing on the 10G connection. If it's standard XGS-PON, that usually maxes out around 8.5Gbps data payload due to overheads in the PON system. If the ISP is using 25Gb PON, then they could theoretically deliver 10Gb data rates.

                                      I don't have 10GB fibber yet :)

                                      On 1GB I see ~700MBps on iPhone 13 Pro and full 1GB on wired connections

                                      1 Reply Last reply Reply Quote 0
                                      • First post
                                        Last post
                                      Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.