Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Haproxy 100% cpu usage

    Scheduled Pinned Locked Moved Cache/Proxy
    47 Posts 7 Posters 4.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M
      maverick_slo @Luca De Andreis
      last edited by

      Same here, removed workaround as well
      All good last 8 hours ..

      1 Reply Last reply Reply Quote 1
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by

        Great, thanks for testing.

        1 Reply Last reply Reply Quote 0
        • C
          coreybrett
          last edited by

          I upgraded last night.

          Still having same issue.

          247da18f-2d04-4b07-8b49-93f737527cdb-image.png

          M 1 Reply Last reply Reply Quote 0
          • M
            maverick_slo @coreybrett
            last edited by maverick_slo

            @coreybrett you probably did not restart service after upgrade.
            Please restart service so that new binary can be run...

            C 1 Reply Last reply Reply Quote 1
            • C
              coreybrett @maverick_slo
              last edited by

              @maverick_slo I am pretty sure I rebooted after running the package update
              will do so again and check it in the morning

              1 Reply Last reply Reply Quote 0
              • stephenw10S
                stephenw10 Netgate Administrator
                last edited by

                You should see it in the stats page:

                HAProxy version 2.9.7-5742051, released 2024/04/05
                Statistics Report for pid 81592
                
                L 1 Reply Last reply Reply Quote 0
                • L
                  Luca De Andreis @stephenw10
                  last edited by

                  @stephenw10

                  I can confirm that after this uptime:
                  f2709fec-bb14-4aea-8dd6-3ccdf6814179-immagine.png

                  HAProxy on a normal production load and without workaround applied... works fine:

                  54b362ed-7c24-442d-901b-40695bf2f239-immagine.png

                  1 Reply Last reply Reply Quote 1
                  • C
                    coreybrett
                    last edited by

                    Still having trouble with this.

                    934ff6f6-81db-4d3c-bf42-29f46ff28afa-image.png

                    Shell Output - /usr/local/sbin/haproxy -v
                    HAProxy version 2.9.7-5742051 2024/04/05 - https://haproxy.org/
                    Status: stable branch - will stop receiving fixes around Q1 2025.
                    Known bugs: http://www.haproxy.org/bugs/bugs-2.9.7.html
                    Running on: FreeBSD 15.0-CURRENT FreeBSD 15.0-CURRENT #0 plus-RELENG_24_03-n256311-e71f834dd81: Fri Apr 19 00:28:14 UTC 2024     root@freebsd:/var/jenkins/workspac
                    
                    L stephenw10S 2 Replies Last reply Reply Quote 0
                    • L
                      Luca De Andreis @coreybrett
                      last edited by

                      @coreybrett

                      strange, for me, on a production system, it works perfectly

                      3f3b0c0d-e0f9-4b18-b7b5-0043f3b20a58-immagine.png

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator @coreybrett
                        last edited by

                        @coreybrett said in Haproxy 100% cpu usage:

                        Still having trouble with this.

                        Are you still seeing panics too?

                        L 1 Reply Last reply Reply Quote 0
                        • L
                          Luca De Andreis @stephenw10
                          last edited by

                          @stephenw10

                          For me the system is absolutely stable, while with HAProxy 2.9.1, it rebooted after 1-2 days of uptime

                          1 Reply Last reply Reply Quote 0
                          • C
                            coreybrett
                            last edited by

                            @stephenw10 said in Haproxy 100% cpu usage:

                            panics

                            No panics for me, but it stops serving content and sites go down

                            stephenw10S 1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator @coreybrett
                              last edited by

                              @coreybrett said in Haproxy 100% cpu usage:

                              No panics for me

                              Was it panicking in 2.9.1?

                              C L 2 Replies Last reply Reply Quote 0
                              • C
                                coreybrett @stephenw10
                                last edited by

                                @stephenw10 no, that was never an issue for me

                                C 1 Reply Last reply Reply Quote 0
                                • C
                                  coreybrett @coreybrett
                                  last edited by

                                  these sites have very little traffic, but they service web hooks that must work when called

                                  L 1 Reply Last reply Reply Quote 0
                                  • L
                                    Luca De Andreis @coreybrett
                                    last edited by

                                    @coreybrett

                                    Before upgrading HAProxy, then using version 2.9.1, I had problems with instability, PfSense reboots and high CPU load on the system in production (higher network load).
                                    On an identical system, but at low load I had only CPU "waste" but no system instability.
                                    In my opinion, with version 2.9.1 of HAProxy the crashing problem occurs only if a certain system load is exceeded.
                                    With 2.9.7 everything was ok after 11 days of uptime.

                                    1 Reply Last reply Reply Quote 0
                                    • L
                                      Luca De Andreis @stephenw10
                                      last edited by

                                      @stephenw10

                                      Hi !

                                      This morning my PfSense plus on 24.03 and HAProxy crash.
                                      dump.tar.gz

                                      1 Reply Last reply Reply Quote 0
                                      • stephenw10S
                                        stephenw10 Netgate Administrator
                                        last edited by

                                        Hmm, disappointing. Looks like exactly the same crash.

                                        You didn't see the high CPU loading before it panicked?

                                        L 1 Reply Last reply Reply Quote 0
                                        • L
                                          Luca De Andreis @stephenw10
                                          last edited by

                                          @stephenw10

                                          No, low or very low rate (on HAProxy 2.9.7) abnormal high CPU usage on 2.9.1
                                          Just a note, PfSense plus run on a VM on more than 40 firewalls, only PfSense using HAProxy has this behavior.

                                          1 Reply Last reply Reply Quote 1
                                          • C
                                            coreybrett
                                            last edited by

                                            I was not able to use more that one backend server. With only one backend, it would run without any issues, but if I had more that one backend, it wouldn't last 24 hours before it consumed 100% of CPU and stopped accepting new connections.

                                            The HAP logs did not reveal anything. However, I was looking thru the system logs and noticed that one of my WAN interfaces was glitching, and that coincided with HAP locking up.

                                            The WAN interface was not really necessary (it had a static IP and was connected to a Cradlepoint cellular modem), so I just disabled it to see what would happen. This interface was not used by the HAP config at all. HAP has been solid since and is working fine with my full config that has 4 backends. This also fixed another issue I had with "loading the rules: pfctl: DIOCADDRULENV" errors.

                                            Sergei_ShablovskyS 1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.