[solved] 23.01.r.20230202.1645 2500 MB Laundry
-
I did some changes today and later noticed high memory usage for Laundry.
So it might not be related to the RC at all but is there a hint what could be the cause?
After a reboot it looks like it is going up again. -
It looks like php-fpm is constantly growing
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 99408 root 1 68 0 309M 225M accept 2 0:11 0.00% php-fpm 89017 root 1 68 0 309M 217M accept 2 0:08 0.00% php-fpm 357 root 1 68 0 309M 211M accept 3 0:12 1.35% php-fpm 358 root 1 68 0 309M 210M accept 2 0:09 0.00% php-fpm
-
So my guess is the problem is related to one of those:
IPv6 GRE tunnel to HE and DDNS to tunnelbroker
NPt
IPv6 Gateway Group failing and failing back.I hadn't run those before (the upgrade) though.
-
-
-
-
Look at Diagnostics > System Activity or
top -aSH
from a shell prompt, and then look at the memory breakdown in the header.That will give you a better idea of what is consuming memory.
You can also try sorting top by resource usage (e.g.
top -aSH -o res
) -
@jimp For now I don't see it anymore. Maybe it was a widget or I changed something else. I still use the HE tunnel etc. so it seems not related to this.
-
@jimp Now it rising again, maybe you can see what the problem is. It has almost doubled til now.
[23.01-RC][admin@pfSense.home.arpa]/root: top -aSH last pid: 77573; load averages: 0.16, 0.19, 0.17 up 0+12:07:45 20:29:47 451 threads: 8 running, 430 sleeping, 13 waiting CPU: 0.5% user, 0.0% nice, 0.5% system, 0.3% interrupt, 98.7% idle Mem: 1408M Active, 1276M Inact, 986M Wired, 243M Free ARC: 135M Total, 48M MFU, 80M MRU, 400K Anon, 1102K Header, 5863K Other 102M Compressed, 262M Uncompressed, 2.57:1 Ratio Swap: 2048M Total, 2048M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 187 ki31 0B 64K RUN 3 715:38 98.39% [idle{idle: 11 root 187 ki31 0B 64K RUN 0 713:47 98.27% [idle{idle: 11 root 187 ki31 0B 64K RUN 2 711:43 97.64% [idle{idle: 11 root 187 ki31 0B 64K CPU1 1 711:57 97.30% [idle{idle: 22604 root 68 0 629M 554M piperd 2 0:36 0.96% php-fpm: poo 0 root -64 - 0B 2256K - 2 8:30 0.77% [kernel{hvev 0 root -64 - 0B 2256K - 1 7:20 0.64% [kernel{hvev 12 root -60 - 0B 144K WAIT 2 3:38 0.53% [intr{swi1: 0 root -64 - 0B 2256K - 0 5:00 0.37% [kernel{hvev 12 root -60 - 0B 144K WAIT 1 4:57 0.36% [intr{swi1: 0 root -64 - 0B 2256K - 0 2:04 0.18% [kernel{hn2 0 root -64 - 0B 2256K - 3 3:27 0.17% [kernel{hvev 98437 root 24 0 14M 4816K CPU0 0 0:00 0.15% top -aSH 12 root -60 - 0B 144K WAIT 3 1:00 0.08% [intr{swi1: 12 root -60 - 0B 144K WAIT 3 1:02 0.07% [intr{swi1: last pid: 221; load averages: 0.14, 0.19, 0.17 up 0+12:07:50 20:29:52 448 threads: 5 running, 430 sleeping, 13 waiting CPU: 0.2% user, 0.0% nice, 0.7% system, 0.0% interrupt, 99.1% idle Mem: 1408M Active, 1276M Inact, 986M Wired, 242M Free ARC: 135M Total, 48M MFU, 79M MRU, 191K Anon, 1103K Header, 5869K Other 102M Compressed, 262M Uncompressed, 2.57:1 Ratio Swap: 2048M Total, 2048M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 187 ki31 0B 64K RUN 3 715:43 99.16% [idle{idle: 11 root 187 ki31 0B 64K CPU0 0 713:52 98.76% [idle{idle: 11 root 187 ki31 0B 64K CPU2 2 711:48 97.75% [idle{idle: 11 root 187 ki31 0B 64K CPU1 1 712:02 96.96% [idle{idle: 52561 root 56 0 629M 557M accept 1 0:36 1.64% php-fpm: poo 0 root -64 - 0B 2256K - 1 7:20 0.76% [kernel{hvev 0 root -64 - 0B 2256K - 2 8:30 0.76% [kernel{hvev 12 root -60 - 0B 144K WAIT 0 4:57 0.46% [intr{swi1: 12 root -60 - 0B 144K WAIT 2 3:38 0.46% [intr{swi1: 0 root -64 - 0B 2256K - 0 5:00 0.41% [kernel{hvev 72112 unbound 20 0 123M 86M kqread 0 0:03 0.28% /usr/local/s 0 root -64 - 0B 2256K - 3 3:27 0.19% [kernel{hvev 0 root -64 - 0B 2256K - 1 2:04 0.19% [kernel{hn2 12 root -60 - 0B 144K WAIT 0 1:02 0.14% [intr{swi1: 98437 root 21 0 17M 4884K CPU3 3 0:00 0.11% top -aSH 12 root -60 - 0B 144K WAIT 2 1:00 0.10% [intr{swi1: 0 root -64 - 0B 2256K - 1 0:44 0.08% [kernel{hn1 89267 root 20 0 31M 10M kqread 2 0:01 0.03% nginx: worke 6 root -16 - 0B 16K pftm 3 0:04 0.03% [pf purge] 70919 dhcpd 20 0 25M 13M select 2 0:02 0.02% /usr/local/s 65188 root 20 0 21M 10M select 0 0:00 0.02% sshd: admin@ 0 root -64 - 0B 2256K - 0 0:11 0.02% [kernel{dumm 72900 dhcpd 20 0 22M 10M select 3 0:02 0.02% /usr/local/s 7 root -16 - 0B 16K - 0 0:07 0.02% [rand_harves 8 root -16 - 0B 48K psleep 2 0:03 0.01% [pagedaemon{ 23813 root 21 0 73M 43M nanslp 3 0:08 0.01% php_wg: Wire 40535 root 20 0 13M 2868K nanslp 0 0:03 0.01% /usr/local/b 40166 root 20 0 13M 2856K sbwait 0 0:03 0.01% /usr/local/b 40166 root 20 0 13M 2856K nanslp 3 0:02 0.01% /usr/local/b 39877 root 20 0 13M 2864K sbwait 0 0:03 0.01% /usr/local/b 39428 root 20 0 13M 2856K sbwait 3 0:03 0.01% /usr/local/b 38463 root 20 0 13M 2864K sbwait 3 0:03 0.01% /usr/local/b 38901 root 20 0 13M 2864K sbwait 1 0:03 0.01% /usr/local/b 2 root -60 - 0B 64K WAIT 0 0:03 0.01% [clock{clock 38011 root 20 0 13M 2868K nanslp 0 0:02 0.01% /usr/local/b 32904 root 20 0 13M 2976K select 1 0:00 0.01% /usr/sbin/sy 39877 root 20 0 13M 2864K nanslp 2 0:02 0.00% /usr/local/b 37746 root 20 0 13M 2864K nanslp 3 0:02 0.00% /usr/local/b 0 root -16 - 0B 2256K - 2 0:01 0.00% [kernel{z_wr 88723 root 20 0 21M 7588K select 2 0:03 0.00% /usr/local/s 38463 root 20 0 13M 2864K nanslp 0 0:02 0.00% /usr/local/b 38901 root 20 0 13M 2864K nanslp 2 0:02 0.00% /usr/local/b 99867 root 20 0 13M 2476K kqread 2 0:01 0.00% /usr/bin/tai 356 root 20 0 111M 29M kqread 2 0:01 0.00% php-fpm: mas 0 root -64 - 0B 2256K - 2 0:14 0.00% [kernel{hn0 39428 root 20 0 13M 2856K nanslp 2 0:02 0.00% /usr/local/b 354 root 20 0 18M 8340K kqread 3 0:01 0.00% /usr/local/s 72112 unbound 20 0 123M 86M kqread 0 0:03 0.00% /usr/local/s 0 root -16 - 0B 2256K - 3 0:01 0.00% [kernel{z_io 0 root -16 - 0B 2256K - 3 0:00 0.00% [kernel{z_wr 38901 root 20 0 13M 2864K nanslp 2 0:00 0.00% /usr/local/b 72112 unbound 20 0 123M 86M kqread 3 0:02 0.00% /usr/local/s 40535 root 20 0 13M 2868K sbwait 1 0:01 0.00% /usr/local/b 38463 root 20 0 13M 2864K nanslp 1 0:00 0.00% /usr/local/b 38011 root 20 0 13M 2868K sbwait 3 0:01 0.00% /usr/local/b 37746 root 20 0 13M 2864K sbwait 0 0:01 0.00% /usr/local/b 0 root -16 - 0B 2256K - 2 0:00 0.00% [kernel{z_wr 72112 unbound 20 0 123M 86M kqread 1 0:02 0.00% /usr/local/s last pid: 24141; load averages: 0.35, 0.23, 0.19 up 0+12:08:01 20:30:03 448 threads: 5 running, 430 sleeping, 13 waiting CPU: 0.5% user, 0.0% nice, 1.0% system, 0.0% interrupt, 98.5% idle Mem: 1412M Active, 1277M Inact, 986M Wired, 236M Free ARC: 135M Total, 48M MFU, 80M MRU, 148K Anon, 1102K Header, 5861K Other 102M Compressed, 262M Uncompressed, 2.57:1 Ratio Swap: 2048M Total, 2048M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 187 ki31 0B 64K CPU0 0 714:02 98.20% [idle{idle: 11 root 187 ki31 0B 64K CPU2 2 711:58 97.81% [idle{idle: 11 root 187 ki31 0B 64K CPU1 1 712:12 97.71% [idle{idle: 11 root 187 ki31 0B 64K RUN 3 715:54 97.18% [idle{idle: 0 root -64 - 0B 2256K - 2 8:31 0.69% [kernel{hvev 0 root -64 - 0B 2256K - 1 7:20 0.68% [kernel{hvev 22604 root 68 0 629M 555M accept 0 0:36 0.49% php-fpm: poo 12 root -60 - 0B 144K WAIT 3 3:38 0.42% [intr{swi1: 12 root -60 - 0B 144K WAIT 1 4:57 0.41% [intr{swi1: 0 root -64 - 0B 2256K - 0 5:00 0.34% [kernel{hvev 0 root -64 - 0B 2256K - 3 3:28 0.19% [kernel{hvev 0 root -64 - 0B 2256K - 0 2:04 0.17% [kernel{hn2 12 root -60 - 0B 144K WAIT 1 1:02 0.13% [intr{swi1: 12 root -60 - 0B 144K WAIT 0 1:00 0.11% [intr{swi1: 358 root 61 0 629M 544M accept 3 0:35 0.10% php-fpm: poo 0 root -64 - 0B 2256K - 2 0:44 0.06% [kernel{hn1 98437 root 20 0 17M 4912K CPU3 3 0:00 0.05% top -aSH 0 root -64 - 0B 2256K - 3 0:11 0.03% [kernel{dumm 88723 root 20 0 21M 7588K select 2 0:03 0.03% /usr/local/s 89267 root 20 0 31M 10M kqread 3 0:01 0.03% nginx: worke 70919 dhcpd 20 0 25M 13M select 3 0:02 0.02% /usr/local/s 72900 dhcpd 20 0 22M 10M select 2 0:02 0.02% /usr/local/s 8 root -16 - 0B 48K psleep 1 0:03 0.02% [pagedaemon{ 7 root -16 - 0B 16K - 2 0:07 0.01% [rand_harves 6 root -16 - 0B 16K pftm 0 0:04 0.01% [pf purge] 23813 root 21 0 73M 43M nanslp 0 0:08 0.01% php_wg: Wire 40758 _dhcp 20 0 13M 2828K select 3 0:01 0.01% dhclient: hn 40166 root 20 0 13M 2856K sbwait 1 0:03 0.01% /usr/local/b 65188 root 20 0 21M 10M select 0 0:00 0.01% sshd: admin@ 39877 root 20 0 13M 2864K sbwait 1 0:03 0.01% /usr/local/b 38901 root 20 0 13M 2864K sbwait 0 0:03 0.01% /usr/local/b 40535 root 20 0 13M 2868K nanslp 0 0:03 0.01% /usr/local/b 38463 root 20 0 13M 2864K sbwait 2 0:03 0.01% /usr/local/b 39428 root 20 0 13M 2856K sbwait 2 0:03 0.01% /usr/local/b 2 root -60 - 0B 64K WAIT 0 0:03 0.01% [clock{clock 38463 root 20 0 13M 2864K nanslp 1 0:02 0.01% /usr/local/b 72112 unbound 20 0 123M 86M kqread 0 0:03 0.01% /usr/local/s 38901 root 20 0 13M 2864K nanslp 2 0:02 0.01% /usr/local/b 72112 unbound 20 0 123M 86M kqread 2 0:02 0.01% /usr/local/s 38011 root 20 0 13M 2868K nanslp 0 0:02 0.01% /usr/local/b 37746 root 20 0 13M 2864K nanslp 3 0:02 0.01% /usr/local/b 32904 root 20 0 13M 2976K select 2 0:00 0.00% /usr/sbin/sy 40166 root 20 0 13M 2856K nanslp 0 0:02 0.00% /usr/local/b 39877 root 20 0 13M 2864K nanslp 0 0:02 0.00% /usr/local/b 39428 root 20 0 13M 2856K nanslp 2 0:02 0.00% /usr/local/b 99867 root 20 0 13M 2476K kqread 3 0:01 0.00% /usr/bin/tai 72625 root 20 0 21M 10M select 0 0:00 0.00% sshd: admin@ 557 root 20 0 11M 1600K select 2 0:01 0.00% /sbin/devd - 354 root 20 0 18M 8340K kqread 3 0:01 0.00% /usr/local/s 0 root -64 - 0B 2256K - 1 0:14 0.00% [kernel{hn0 40535 root 20 0 13M 2868K sbwait 1 0:01 0.00% /usr/local/b 37746 root 20 0 13M 2864K nanslp 3 0:00 0.00% /usr/local/b 37746 root 20 0 13M 2864K sbwait 0 0:01 0.00% /usr/local/b 356 root 20 0 111M 29M kqread 0 0:01 0.00% php-fpm: mas 38011 root 20 0 13M 2868K sbwait 2 0:01 0.00% /usr/local/b 38463 root 20 0 13M 2864K nanslp 2 0:00 0.00% /usr/local/b 39877 root 20 0 13M 2864K nanslp 2 0:00 0.00% /usr/local/b 39428 root 20 0 13M 2856K nanslp 0 0:00 0.00% /usr/local/b 40535 root 20 0 13M 2868K accept 1 0:00 0.00% /usr/local/b 38463 root 20 0 13M 2864K accept 1 0:00 0.00% /usr/local/b 37746 root 20 0 13M 2864K accept 0 0:00 0.00% /usr/local/b 38011 root 20 0 13M 2868K accept 1 0:00 0.00% /usr/local/b 40166 root 20 0 13M 2856K nanslp 2 0:00 0.00% /usr/local/b 38901 root 20 0 13M 2864K accept 3 0:00 0.00% /usr/local/b 40535 root 20 0 13M 2868K nanslp 1 0:00 0.00% /usr/local/b 40166 root 20 0 13M 2856K accept 2 0:00 0.00% /usr/local/b 39877 root 20 0 13M 2864K accept 3 0:00 0.00% /usr/local/b 15659 root 20 0 13M 3604K bpf 2 0:01 0.00% /usr/local/s 38901 root 20 0 13M 2864K nanslp 3 0:00 0.00% /usr/local/b 39428 root 20 0 13M 2856K accept 2 0:00 0.00% /usr/local/
[23.01-RC][admin@pfSense.home.arpa]/root: top -aSH -o res last pid: 73702; load averages: 0.15, 0.20, 0.18 up 0+12:09:19 20:31:21 448 threads: 5 running, 430 sleeping, 13 waiting CPU: 0.0% user, 0.0% nice, 0.3% system, 0.0% interrupt, 99.7% idle Mem: 1440M Active, 1281M Inact, 986M Wired, 205M Free ARC: 135M Total, 48M MFU, 79M MRU, 152K Anon, 1101K Header, 5864K Other 102M Compressed, 262M Uncompressed, 2.57:1 Ratio Swap: 2048M Total, 2048M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 52561 root 68 0 629M 567M accept 0 0:37 0.00% php-fpm: poo 357 root 68 0 629M 564M accept 3 0:34 0.00% php-fpm: poo 22604 root 63 0 629M 558M accept 1 0:36 0.00% php-fpm: poo 358 root 68 0 629M 548M accept 0 0:35 0.00% php-fpm: poo 44535 root 68 0 629M 535M accept 3 0:34 0.00% php-fpm: poo 72112 unbound 20 0 123M 86M kqread 3 0:03 0.00% /usr/local/s 72112 unbound 20 0 123M 86M kqread 2 0:03 0.00% /usr/local/s 72112 unbound 20 0 123M 86M kqread 1 0:02 0.00% /usr/local/s 72112 unbound 20 0 123M 86M kqread 0 0:02 0.00% /usr/local/s 99939 root 24 0 73M 46M piperd 0 0:00 0.00% /usr/local/b 23813 root 21 0 73M 43M nanslp 3 0:08 0.01% php_wg: Wire 356 root 20 0 111M 29M kqread 0 0:01 0.00% php-fpm: mas 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s last pid: 87207; load averages: 0.11, 0.19, 0.17 up 0+12:09:36 20:31:38 448 threads: 6 running, 429 sleeping, 13 waiting CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 1444M Active, 1282M Inact, 986M Wired, 200M Free ARC: 134M Total, 47M MFU, 80M MRU, 432K Anon, 1102K Header, 5866K Other 102M Compressed, 262M Uncompressed, 2.57:1 Ratio Swap: 2048M Total, 2048M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 52561 root 68 0 725M 568M accept 1 0:37 0.00% php-fpm: poo 357 root 68 0 629M 566M accept 0 0:34 0.00% php-fpm: poo 22604 root 21 0 629M 560M accept 1 0:36 0.00% php-fpm: poo 358 root 68 0 629M 550M accept 1 0:36 0.00% php-fpm: poo 44535 root 68 0 629M 536M accept 3 0:34 0.00% php-fpm: poo 72112 unbound 20 0 123M 86M kqread 1 0:03 0.00% /usr/local/s 72112 unbound 20 0 123M 86M kqread 2 0:03 0.00% /usr/local/s 72112 unbound 20 0 123M 86M kqread 0 0:02 0.00% /usr/local/s 72112 unbound 20 0 123M 86M kqread 3 0:02 0.00% /usr/local/s 99939 root 24 0 73M 46M piperd 0 0:00 0.00% /usr/local/b 23813 root 21 0 73M 43M nanslp 1 0:08 0.02% php_wg: Wire 356 root 20 0 111M 29M kqread 1 0:01 0.00% php-fpm: mas 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 19M usem 3 0:00 0.00% /usr/
-
Now I have 97% Memory usage:
[23.01-RC][admin@pfSense.home.arpa]/root: top -aSH last pid: 12140; load averages: 0.44, 0.31, 0.26 up 0+12:25:18 20:47:20 448 threads: 5 running, 430 sleeping, 13 waiting CPU: 5.6% user, 0.0% nice, 7.3% system, 0.0% interrupt, 87.1% idle Mem: 543M Active, 3884K Inact, 2342M Laundry, 892M Wired, 133M Free ARC: 116M Total, 50M MFU, 59M MRU, 83K Anon, 1101K Header, 5875K Other 85M Compressed, 218M Uncompressed, 2.56:1 Ratio Swap: 2048M Total, 133M Used, 1915M Free, 6% Inuse PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 187 ki31 0B 64K CPU1 1 728:52 89.91% [idle{idle: 11 root 187 ki31 0B 64K RUN 0 730:44 89.52% [idle{idle: 11 root 187 ki31 0B 64K CPU2 2 728:38 86.84% [idle{idle: 11 root 187 ki31 0B 64K CPU3 3 732:34 85.58% [idle{idle: 358 root 68 0 725M 35M select 3 0:41 8.01% php-fpm: poo 12 root -60 - 0B 144K WAIT 3 3:43 0.87% [intr{swi1: 0 root -64 - 0B 2256K - 2 8:38 0.77% [kernel{hvev 0 root -64 - 0B 2256K - 1 7:28 0.55% [kernel{hvev 0 root -64 - 0B 2256K - 0 5:05 0.42% [kernel{hvev 68000 root 20 0 14M 4124K CPU0 0 0:00 0.38% top -aSH 12 root -60 - 0B 144K WAIT 2 5:02 0.35% [intr{swi1: 88723 root 20 0 21M 4520K select 0 0:04 0.33% /usr/local/s 40758 _dhcp 20 0 13M 1508K select 3 0:01 0.15% dhclient: hn 0 root -64 - 0B 2256K - 2 2:06 0.15% [kernel{hn2 0 root -64 - 0B 2256K - 3 3:29 0.14% [kernel{hvev last pid: 90200; load averages: 0.53, 0.34, 0.27 up 0+12:25:25 20:47:27 448 threads: 5 running, 429 sleeping, 14 waiting CPU: 0.0% user, 0.0% nice, 0.5% system, 0.0% interrupt, 99.5% idle Mem: 547M Active, 9604K Inact, 2335M Laundry, 889M Wired, 132M Free ARC: 115M Total, 49M MFU, 59M MRU, 147K Anon, 1101K Header, 5871K Other 85M Compressed, 218M Uncompressed, 2.56:1 Ratio Swap: 2048M Total, 139M Used, 1909M Free, 6% Inuse PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 187 ki31 0B 64K CPU3 3 732:40 98.76% [idle{idle: 11 root 187 ki31 0B 64K RUN 0 730:50 98.67% [idle{idle: 11 root 187 ki31 0B 64K CPU2 2 728:44 98.39% [idle{idle: 11 root 187 ki31 0B 64K CPU1 1 728:58 97.48% [idle{idle: 0 root -64 - 0B 2256K - 2 8:38 0.67% [kernel{hvev 44535 root 58 0 725M 38M accept 3 0:40 0.65% php-fpm: poo 0 root -64 - 0B 2256K - 1 7:28 0.60% [kernel{hvev 0 root -64 - 0B 2256K - 0 5:05 0.47% [kernel{hvev 12 root -60 - 0B 144K WAIT 3 3:43 0.45% [intr{swi1: 12 root -60 - 0B 144K WAIT 0 5:02 0.39% [intr{swi1: 68000 root 20 0 17M 4176K CPU0 0 0:00 0.38% top -aSH 0 root -64 - 0B 2256K - 1 2:06 0.18% [kernel{hn2 0 root -64 - 0B 2256K - 3 3:29 0.15% [kernel{hvev 89267 root 20 0 31M 6168K kqread 2 0:01 0.10% nginx: worke 12 root -60 - 0B 144K WAIT 3 1:01 0.08% [intr{swi1: 4999 root 20 0 21M 8004K select 3 0:00 0.08% sshd: admin@ 0 root -64 - 0B 2256K - 0 0:45 0.06% [kernel{hn1 12 root -60 - 0B 144K WAIT 0 1:03 0.06% [intr{swi1: 70919 dhcpd 20 0 25M 11M select 1 0:02 0.03% /usr/local/s 72900 dhcpd 20 0 22M 8352K select 3 0:02 0.03% /usr/local/s 6 root -16 - 0B 16K pftm 3 0:04 0.02% [pf purge] 0 root -64 - 0B 2256K - 0 0:12 0.02% [kernel{dumm 32904 root 20 0 13M 2500K select 0 0:00 0.02% /usr/sbin/sy 7 root -16 - 0B 16K - 0 0:08 0.02% [rand_harves 39877 root 20 0 13M 2356K sbwait 1 0:03 0.01% /usr/local/b 38901 root 20 0 13M 2356K sbwait 2 0:03 0.01% /usr/local/b 39428 root 20 0 13M 2348K sbwait 0 0:03 0.01% /usr/local/b 38463 root 20 0 13M 2356K sbwait 0 0:03 0.01% /usr/local/b 39428 root 20 0 13M 2348K nanslp 0 0:02 0.01% /usr/local/b 40535 root 20 0 13M 2360K nanslp 0 0:03 0.01% /usr/local/b 40166 root 20 0 13M 2348K sbwait 2 0:03 0.01% /usr/local/b 99867 root 20 0 13M 1956K kqread 3 0:01 0.01% /usr/bin/tai 38011 root 20 0 13M 2360K nanslp 3 0:03 0.01% /usr/local/b 0 root -64 - 0B 2256K - 2 0:14 0.01% [kernel{hn0 40166 root 20 0 13M 2348K nanslp 0 0:02 0.01% /usr/local/b 39877 root 20 0 13M 2356K nanslp 0 0:02 0.01% /usr/local/b 37746 root 20 0 13M 2356K nanslp 0 0:02 0.01% /usr/local/b 2 root -60 - 0B 64K WAIT 0 0:03 0.00% [clock{clock 8 root -16 - 0B 48K psleep 3 0:04 0.00% [pagedaemon{ 38463 root 20 0 13M 2356K nanslp 3 0:02 0.00% /usr/local/b 38901 root 20 0 13M 2356K nanslp 1 0:02 0.00% /usr/local/b 356 root 20 0 111M 19M kqread 2 0:01 0.00% php-fpm: mas 37746 root 20 0 13M 2356K sbwait 1 0:01 0.00% /usr/local/b 40535 root 20 0 13M 2360K sbwait 0 0:01 0.00% /usr/local/b 17 root 16 - 0B 16K syncer 0 0:00 0.00% [syncer] 16 root -16 - 0B 48K - 0 0:00 0.00% [bufdaemon{b 22604 root 68 0 725M 20M accept 1 0:43 0.00% php-fpm: poo 52561 root 68 0 725M 22M accept 2 0:43 0.00% php-fpm: poo 358 root 68 0 725M 52K accept 1 0:41 0.00% php-fpm: poo 357 root 68 0 725M 24M accept 1 0:40 0.00% php-fpm: poo 0 root -64 - 0B 2256K - 0 0:17 0.00% [kernel{hn4 0 root -64 - 0B 2256K - 3 0:16 0.00% [kernel{hn3 23813 root 21 0 73M 25M nanslp 3 0:09 0.00% php_wg: Wire 93146 root 68 20 13M 4096B wait 1 0:07 0.00% /bin/sh /var 0 root -12 - 0B 2256K - 2 0:07 0.00% [kernel{z_wr 0 root -12 - 0B 2256K - 2 0:07 0.00% [kernel{z_wr 0 root -12 - 0B 2256K - 3 0:07 0.00% [kernel{z_wr 5 root -8 - 0B 928K tx->tx 0 0:05 0.00% [zfskern{txg 0 root -16 - 0B 2256K - 3 0:05 0.00% [kernel{z_wr 0 root -16 - 0B 2256K - 3 0:05 0.00% [kernel{z_wr 0 root -16 - 0B 2256K - 2 0:05 0.00% [kernel{z_wr 0 root -16 - 0B 2256K swapin 0 0:04 0.00% [kernel{swap 88723 root 20 0 21M 4520K select 2 0:04 0.00% /usr/local/s 72112 unbound 20 0 123M 4096B kqread 2 0:03 0.00% /usr/local/s 72112 unbound 20 0 123M 4096B WAIT 1 0:03 0.00% /usr/local/s 72112 unbound 20 0 123M 4096B kqread 0 0:02 0.00% /usr/local/s 72112 unbound 20 0 123M 4096B kqread 3 0:02 0.00% /usr/local/s 557 root 20 0 11M 680K select 3 0:01 0.00% /sbin/devd - 89127 root 20 0 31M 4096B kqread 2 0:01 0.00% nginx: worke 0 root -16 - 0B 2256K - 3 0:01 0.00% [kernel{z_wr 354 root 20 0 18M 6536K kqread 2 0:01 0.00% /usr/local/s 40758 _dhcp 20 0 13M 1508K select 2 0:01 0.00% dhclient: hn 9 root -16 - 0B 16K psleep 3 0:01 0.00% [vmdaemon] 38011 root 20 0 13M 2360K sbwait 3 0:01 0.00% /usr/local/b 0 root -16 - 0B 2256K - 2 0:01 0.00% [kernel{z_nu
[23.01-RC][admin@pfSense.home.arpa]/root: top -aSH -o res last pid: 38223; load averages: 0.36, 0.36, 0.29 up 0+12:27:45 20:49:47 448 threads: 5 running, 430 sleeping, 13 waiting CPU: 0.0% user, 0.0% nice, 1.2% system, 0.2% interrupt, 98.5% idle Mem: 600M Active, 6048K Inact, 2282M Laundry, 892M Wired, 132M Free ARC: 119M Total, 53M MFU, 59M MRU, 148K Anon, 1100K Header, 5868K Other 88M Compressed, 223M Uncompressed, 2.53:1 Ratio Swap: 2048M Total, 197M Used, 1851M Free, 9% Inuse PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 358 root 63 0 725M 30M accept 0 0:42 0.00% php-fpm: poo 357 root 68 0 837M 29M accept 3 0:41 0.00% php-fpm: poo 23813 root 20 0 73M 25M nanslp 1 0:09 0.01% php_wg: Wire 52561 root 68 0 837M 22M accept 2 0:43 0.00% php-fpm: poo 99939 root 24 0 73M 20M piperd 0 0:00 0.00% /usr/local/b 356 root 20 0 111M 19M kqread 1 0:01 0.00% php-fpm: mas 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s last pid: 39272; load averages: 0.36, 0.36, 0.29 up 0+12:27:47 20:49:49 448 threads: 6 running, 430 sleeping, 12 waiting CPU: 0.3% user, 0.0% nice, 0.5% system, 0.0% interrupt, 99.2% idle Mem: 601M Active, 6224K Inact, 2282M Laundry, 892M Wired, 133M Free ARC: 119M Total, 53M MFU, 59M MRU, 172K Anon, 1102K Header, 5872K Other 88M Compressed, 223M Uncompressed, 2.53:1 Ratio Swap: 2048M Total, 197M Used, 1851M Free, 9% Inuse PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 358 root 47 0 725M 31M accept 0 0:42 0.83% php-fpm: poo 357 root 68 0 837M 29M accept 3 0:41 0.00% php-fpm: poo 23813 root 21 0 73M 25M nanslp 3 0:09 0.01% php_wg: Wire 52561 root 68 0 837M 22M accept 2 0:43 0.00% php-fpm: poo 99939 root 24 0 73M 20M piperd 0 0:00 0.00% /usr/local/b 356 root 20 0 111M 19M kqread 0 0:01 0.00% php-fpm: mas 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 0 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 2 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 1 0:00 0.00% /usr/local/s 42905 root 20 0 95M 12M usem 3 0:00 0.00% /usr/local/s
I will reboot now.
-
This may be what we just tracked down today. It was happening in a PHP module function that fetches interface addresses, which in turn gets used by several dashboard widgets and system functions. Even sitting at the dashboard under the wrong conditions would end up using memory in PHP.
It's fixed now and will be in the next build we do:
https://github.com/pfsense/FreeBSD-ports/commit/2e01a52514ba6e08ec44a6bc951b623b027d0655
-
@jimp It looks like that was it, memory consumption is stable right now.
I noticed that system info is only partially showing stats, they come and go.
But I will mark this thread as solved for now.
-
I haven't seen that happen yet on any build (even the latest). You might keep the browser console open while you let it sit and the dashboard and see if it reports an error when the information is blank/missing.
The fix for the memory leak would primarily have affected the interfaces widget(s), gateways widget, and cellular widget. I'm not sure any of the others used the affected function (even indirectly), so I don't know why the system info fields that update via AJAX would be blank unless it isn't getting data back in that query for some reason.
-
Any errors logged? I'm not seeing that on any test box here on todays build.
-
This post is deleted! -
@jimp Ok, found the problem. I had the System Info Widget twice, second one was reduced only to monitor CPU and RAM usage. But if I have it twice, that problem will occur for me.
-
Huh, that's interesting. Probably not considered a valid config but unexpected even so.
-
@stephenw10 I only did this because of the memory problem I had before. Interestingly it only happens, if the second Sys Info is reduced. If both have all there boxes checked, there is no problem.
-