Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    High latency and packet loss HELP!! [not solved]

    Scheduled Pinned Locked Moved General pfSense Questions
    39 Posts 5 Posters 5.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • johnpozJ
      johnpoz LAYER 8 Global Moderator
      last edited by

      Normal advice for packages when updating is to remove them, update then put your packages back..

      What package is using growl?  I just looked through the package manager and do not see that listed in either the packages I have installed or available packages.

      Well I do see it in pfsense..

      [2.4.0-RC][root@pfsense.local.lan]/root: pkg info pear-Net_Growl-2.7.0         
      pear-Net_Growl-2.7.0
      Name          : pear-Net_Growl
      Version        : 2.7.0
      Installed on  : Fri Mar 31 07:43:42 2017 CDT
      Origin        : net/pear-Net_Growl
      Architecture  : FreeBSD:11:amd64
      Prefix        : /usr/local
      Categories    : net pear
      Licenses      : BSD2CLAUSE
      Maintainer    : garga@FreeBSD.org
      WWW            : https://pear.php.net/package/Net_Growl/
      Comment        : Send notifications to Growl
      Annotations    :
              repo_type      : binary
              repository    : pfSense
      Flat size      : 1.03MiB
      Description    :
      Growl is a MACOSX application that listen to notifications sent by
      applications and displays them on the desktop using different display
      styles. Net_Growl offers the possibility to send notifications to Growl
      from your PHP application through network communication using UDP.

      WWW: https://pear.php.net/package/Net_Growl/
      [2.4.0-RC][root@pfsense.local.lan]/root:

      An intelligent man is sometimes forced to be drunk to spend time with his fools
      If you get confused: Listen to the Music Play
      Please don't Chat/PM me for help, unless mod related
      SG-4860 24.11 | Lab VMs 2.8, 24.11

      1 Reply Last reply Reply Quote 0
      • DerelictD
        Derelict LAYER 8 Netgate
        last edited by

        Codel won't do any good if the buffering is in the ISP network, which it must be because pfSense won't buffer bloat like that without significant effort.

        There is no way to shape on pfSense LAN because he is trying to load balance 3 20Mbit connections into 60Mbit and there is no way for the shaper to know which WAN is saturated when sending out LAN.

        He needs to limit downloads on each WAN interface to something that will reduce the buffer bloat in his crappy crappy ISP network.

        The only way I can think of to do that on each WAN independently is a limiter on each WAN. That requires 2.4.

        It is unknown if 2.4 will introduce something that doesn't work for you. Probably not. 2.4.0-RELEASE should be real soon now.

        If you have a 2.3.4_1 installer ready and a current backup you can get back to where you are in about 10 minutes.

        Chattanooga, Tennessee, USA
        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
        Do Not Chat For Help! NO_WAN_EGRESS(TM)

        1 Reply Last reply Reply Quote 0
        • DerelictD
          Derelict LAYER 8 Netgate
          last edited by

          @tripplex:

          can i just update to 2.4 from 2.3.4_p1? Will it cause any issues?

          getting this while updating to 2.4.0:
          pkg: cached package pear-Net_Growl-2.7.0: size mismatch, cannot continue
          Failed

          What, exactly, did you do there to initiate that upgrade?

          Chattanooga, Tennessee, USA
          A comprehensive network diagram is worth 10,000 words and 15 conference calls.
          DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
          Do Not Chat For Help! NO_WAN_EGRESS(TM)

          1 Reply Last reply Reply Quote 0
          • johnpozJ
            johnpoz LAYER 8 Global Moderator
            last edited by

            Yeah I fail to understand such a odd ball setup?  If you want 60mbps - why not just get a pipe that big?  So you have 3 cable providers in your area but nothing fatter than 20mbps?

            I just ordered 500/50 to be installed on wed! ;)  Big jump from my 75/10 connection and cheaper too.  Sad part is my pfsense VM can not route that that speed, so until I update my vm host or pull trigger on sg3100.. Which wife would kill me on cost of either option right at the moment… So I had to order a unifi usg :( cheapest option that I could find that could handle the speed.. But looks like openvpn and ipv6 tunnels going to be a PITA vs the easy clickity clickity of pfsense..  And didn't tell her about that cost, just that needed new modem to handle the new speed..  So prob in for some shit when she sees the amazon bill ;) hehehehe

            An intelligent man is sometimes forced to be drunk to spend time with his fools
            If you get confused: Listen to the Music Play
            Please don't Chat/PM me for help, unless mod related
            SG-4860 24.11 | Lab VMs 2.8, 24.11

            1 Reply Last reply Reply Quote 0
            • T
              tripplex
              last edited by

              ok i got it updated 2.4.0 now i am going to set the limiters on the wan.

              Is the attached settings correct? because it isn't working to limit the wan speed.

              ![Screenshot-2017-10-1 Anonymous Anonymous dev - Firewall Traffic Shaper By Interface.png](/public/imported_attachments/1/Screenshot-2017-10-1 Anonymous Anonymous dev - Firewall Traffic Shaper By Interface.png)
              ![Screenshot-2017-10-1 Anonymous Anonymous dev - Firewall Traffic Shaper By Interface.png_thumb](/public/imported_attachments/1/Screenshot-2017-10-1 Anonymous Anonymous dev - Firewall Traffic Shaper By Interface.png_thumb)

              1 Reply Last reply Reply Quote 0
              • johnpozJ
                johnpoz LAYER 8 Global Moderator
                last edited by

                no dude no.. Did you not read the thread I pointed too.

                An intelligent man is sometimes forced to be drunk to spend time with his fools
                If you get confused: Listen to the Music Play
                Please don't Chat/PM me for help, unless mod related
                SG-4860 24.11 | Lab VMs 2.8, 24.11

                1 Reply Last reply Reply Quote 0
                • T
                  tripplex
                  last edited by

                  there are so much things there i can't find what i needed gonna read through it all.

                  1 Reply Last reply Reply Quote 0
                  • DerelictD
                    Derelict LAYER 8 Netgate
                    last edited by

                    Remove the shaper. You need to use limiters.

                    Chattanooga, Tennessee, USA
                    A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                    DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                    Do Not Chat For Help! NO_WAN_EGRESS(TM)

                    1 Reply Last reply Reply Quote 0
                    • T
                      tripplex
                      last edited by

                      after creating the limiter where shall i put it on the wan tab of the firewall rule and how is it suppose to be configured i.e. the firewall rule with limiter?

                      1 Reply Last reply Reply Quote 0
                      • DerelictD
                        Derelict LAYER 8 Netgate
                        last edited by

                        On a floating match rule on WAN out.

                        ![Screen Shot 2017-10-01 at 4.24.51 AM.png](/public/imported_attachments/1/Screen Shot 2017-10-01 at 4.24.51 AM.png)
                        ![Screen Shot 2017-10-01 at 4.24.51 AM.png_thumb](/public/imported_attachments/1/Screen Shot 2017-10-01 at 4.24.51 AM.png_thumb)
                        ![Screen Shot 2017-10-01 at 4.25.10 AM.png](/public/imported_attachments/1/Screen Shot 2017-10-01 at 4.25.10 AM.png)
                        ![Screen Shot 2017-10-01 at 4.25.10 AM.png_thumb](/public/imported_attachments/1/Screen Shot 2017-10-01 at 4.25.10 AM.png_thumb)
                        screenshot-pfsense-b-2017-10-01-04-26-18.png
                        screenshot-pfsense-b-2017-10-01-04-26-18.png_thumb

                        Chattanooga, Tennessee, USA
                        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                        Do Not Chat For Help! NO_WAN_EGRESS(TM)

                        1 Reply Last reply Reply Quote 0
                        • DerelictD
                          Derelict LAYER 8 Netgate
                          last edited by

                          I used 18/5 just to demonstrate this:

                          [2.4.0-RC][root@pfSense-b]/root: speedtest-cli
                          Retrieving speedtest.net configuration…
                          Testing from Cox ()...
                          Retrieving speedtest.net server list...
                          Selecting best server based on ping...
                          Hosted by LV.Net (Las Vegas, NV) [13.99 km]: 18.701 ms
                          Testing download speed…............................................................................
                          .Download: 17.23 Mbit/s
                          Testing upload speed...
                          Upload: 5.15 Mbit/s

                          Chattanooga, Tennessee, USA
                          A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                          DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                          Do Not Chat For Help! NO_WAN_EGRESS(TM)

                          1 Reply Last reply Reply Quote 0
                          • T
                            tripplex
                            last edited by

                            Its working but no more latency issue when i drop the bandwidth to 10 mbps but i still get packet loss and eventually the interface goes offline.

                            Am i right to feel this is a hardware problem?

                            1 Reply Last reply Reply Quote 0
                            • T
                              tripplex
                              last edited by

                              Its happening badly when the speed test tries to upload. the latency is in the thousands.

                              I have another pc can install pfsense to a hp z200 workstation. Should i do that?

                              1 Reply Last reply Reply Quote 0
                              • DerelictD
                                Derelict LAYER 8 Netgate
                                last edited by

                                It's not pfSense. It's your ISP.

                                Edit the gateways and tell them to always be up while you test. That way the dpinger alarms won't take interfaces down and the interfaces will stay up.

                                ![Screen Shot 2017-10-01 at 5.45.00 AM.png](/public/imported_attachments/1/Screen Shot 2017-10-01 at 5.45.00 AM.png)
                                ![Screen Shot 2017-10-01 at 5.45.00 AM.png_thumb](/public/imported_attachments/1/Screen Shot 2017-10-01 at 5.45.00 AM.png_thumb)

                                Chattanooga, Tennessee, USA
                                A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                                DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                                Do Not Chat For Help! NO_WAN_EGRESS(TM)

                                1 Reply Last reply Reply Quote 0
                                • johnpozJ
                                  johnpoz LAYER 8 Global Moderator
                                  last edited by

                                  also are you trying to test through the load balancer?  Some tests can create multiple sessions to try and fill the pipe vs using 1 session..  I think your going to have a problem with 3 different wans and shaping if your trying to load balance.

                                  And I am curious if there is any shared connectivity here?  So these are 3 different isp with 3 different lines or are you just running 3 different modems from the same cable company?

                                  An intelligent man is sometimes forced to be drunk to spend time with his fools
                                  If you get confused: Listen to the Music Play
                                  Please don't Chat/PM me for help, unless mod related
                                  SG-4860 24.11 | Lab VMs 2.8, 24.11

                                  1 Reply Last reply Reply Quote 0
                                  • H
                                    Harvy66
                                    last edited by

                                    Upload bufferbloat is easy to fix. Set FariQ traffic shaping on all 3 WAN interfaces, set your bandwidth, and preferably set your default queue to have Codel enabled.

                                    1 Reply Last reply Reply Quote 0
                                    • T
                                      tripplex
                                      last edited by

                                      @johnpoz:

                                      also are you trying to test through the load balancer?  Some tests can create multiple sessions to try and fill the pipe vs using 1 session..  I think your going to have a problem with 3 different wans and shaping if your trying to load balance.

                                      And I am curious if there is any shared connectivity here?  So these are 3 different isp with 3 different lines or are you just running 3 different modems from the same cable company?

                                      3 different lines with modems  from the same ISP.

                                      I just increased the latency threshold on the wan interfaces. working good so far , that's what i did in the past before reinstalling pfsense.

                                      1 Reply Last reply Reply Quote 0
                                      • johnpozJ
                                        johnpoz LAYER 8 Global Moderator
                                        last edited by

                                        "3 different lines with modems  from the same ISP."

                                        For what possible reason??  Makes zero sense - from same isp, so if they have issues all 3 of your connections going to have problems.  Your telling me the fastest connection they can give you is 20.. On cable?  So you got 3 of them?

                                        An intelligent man is sometimes forced to be drunk to spend time with his fools
                                        If you get confused: Listen to the Music Play
                                        Please don't Chat/PM me for help, unless mod related
                                        SG-4860 24.11 | Lab VMs 2.8, 24.11

                                        1 Reply Last reply Reply Quote 0
                                        • T
                                          tripplex
                                          last edited by

                                          There 50mbps is the next step from 20 mbps but the price for that bandwidth is so high i couldn't afford it but three 20mbps line is almost the same cost, so i went with that option. Seems now i am paying the price for that.  :-[ :-\

                                          Thanks to everyone who help on this thread. And I installed pfsense on the hp z200 workstation and it had the same problem as the IBM so its definitely the ISP as [b]Derelict said.

                                          1 Reply Last reply Reply Quote 0
                                          • johnpozJ
                                            johnpoz LAYER 8 Global Moderator
                                            last edited by

                                            With cost of 3 modems.. That you are renting or you bought..  Sorry but I don't so how this was ever a viable option for anything..  And could not make sense cost wise.. What going to save 5 bucks or something for the 3 lines vs the 50mbps line?

                                            Live with the 20.. If that is not enough then get the 50.. You can not just magically put a bunch of lines together and think its going to act like 1 fat pipe.. It just doesn't work that way no matter how many people want it too..

                                            Yes load sharing is some cool shit.. Works when you have multiple users.. How many different users do you have trying to use this connection setup?

                                            An intelligent man is sometimes forced to be drunk to spend time with his fools
                                            If you get confused: Listen to the Music Play
                                            Please don't Chat/PM me for help, unless mod related
                                            SG-4860 24.11 | Lab VMs 2.8, 24.11

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.