Haproxy 100% cpu usage

[stephenw10]

OK the backend haproxy pkg had been updated to current (2.9.7) and looks good in testing here.

You can upgrade it dircetly like: pkg upgrade haproxy

Or reinstall the pfSense HAProxy package to get it.

If this confirms the fix and doesn't introduce any new show stoppers we'll bump the package version so it appears as an upgrade for all users.

Steve

[Luca De Andreis]

@stephenw10

... upgrade to 2.9.7 in production and... for now... works fine :)

Thanks
Luca

[maverick_slo]

Same here, removed workaround as well
All good last 8 hours ..

[stephenw10]

Great, thanks for testing.

[coreybrett]

I upgraded last night.

Still having same issue.

login-to-view

[maverick_slo]

@coreybrett you probably did not restart service after upgrade.
Please restart service so that new binary can be run...

[coreybrett]

@maverick_slo I am pretty sure I rebooted after running the package update
will do so again and check it in the morning

[stephenw10]

You should see it in the stats page:

HAProxy version 2.9.7-5742051, released 2024/04/05
Statistics Report for pid 81592

[Luca De Andreis]

@stephenw10

I can confirm that after this uptime:
login-to-view

HAProxy on a normal production load and without workaround applied... works fine:

login-to-view

[coreybrett]

Still having trouble with this.

login-to-view

Shell Output - /usr/local/sbin/haproxy -v
HAProxy version 2.9.7-5742051 2024/04/05 - https://haproxy.org/
Status: stable branch - will stop receiving fixes around Q1 2025.
Known bugs: http://www.haproxy.org/bugs/bugs-2.9.7.html
Running on: FreeBSD 15.0-CURRENT FreeBSD 15.0-CURRENT #0 plus-RELENG_24_03-n256311-e71f834dd81: Fri Apr 19 00:28:14 UTC 2024     root@freebsd:/var/jenkins/workspac

[Luca De Andreis]

@coreybrett

strange, for me, on a production system, it works perfectly

login-to-view

[stephenw10]

@coreybrett said in Haproxy 100% cpu usage:

Still having trouble with this.

Are you still seeing panics too?

[Luca De Andreis]

@stephenw10

For me the system is absolutely stable, while with HAProxy 2.9.1, it rebooted after 1-2 days of uptime

[coreybrett]

@stephenw10 said in Haproxy 100% cpu usage:

panics

No panics for me, but it stops serving content and sites go down

[stephenw10]

@coreybrett said in Haproxy 100% cpu usage:

No panics for me

Was it panicking in 2.9.1?

[coreybrett]

@stephenw10 no, that was never an issue for me

[coreybrett]

these sites have very little traffic, but they service web hooks that must work when called

[Luca De Andreis]

@coreybrett

Before upgrading HAProxy, then using version 2.9.1, I had problems with instability, PfSense reboots and high CPU load on the system in production (higher network load).
On an identical system, but at low load I had only CPU "waste" but no system instability.
In my opinion, with version 2.9.1 of HAProxy the crashing problem occurs only if a certain system load is exceeded.
With 2.9.7 everything was ok after 11 days of uptime.

[Luca De Andreis]

@stephenw10

Hi !

This morning my PfSense plus on 24.03 and HAProxy crash.
dump.tar.gz

[stephenw10]

Hmm, disappointing. Looks like exactly the same crash.

You didn't see the high CPU loading before it panicked?