Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    mbuf cluster rising after upgrade from 2.5.2

    Scheduled Pinned Locked Moved General pfSense Questions
    15 Posts 2 Posters 1.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      captain118 @stephenw10
      last edited by

      @stephenw10 That is a good an interesting point. You dont see it hitting the max at any point in time. That may be because of the resolution of the graph, but I dont know that this is the case. The only logs I saw anywhere was when I hooked up the monitor to see why the system was offline. That is where I saw the error message about the mbuf clusters being exceeded.
      I'll dig through some more logs and see if I can find those log entries. But for now here is the the 1 hour resolution for the last week. It looks like the highest logged is 1.2M. It is clear though when you compare it to before the update that some is definitely functioning differently after the update. Before it never got above 1% and now its almost constantly rising.
      8243ed23-e1cb-4b07-a5a8-63d3a4ab41d7-image.png
      7572f3b8-2984-4b8f-84b5-1eff57789699-image.png

      1 Reply Last reply Reply Quote 0
      • C
        captain118
        last edited by

        Here is a picture I took. This one is from the first time it happened before I disabled openvpn.
        Screenshot 2024-01-15 141044.png

        1 Reply Last reply Reply Quote 0
        • C
          captain118
          last edited by

          Also it looks like before the system went offline I was able to forward the errors to my syslog server:
          cf8fee89-6817-45a7-bb56-8e46bbed0b86-image.png

          1 Reply Last reply Reply Quote 0
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            Hmm, well that seems pretty conclusive. I wonder if it stopped allowing further mbufs for some other reason than it was actually exhausted....

            Were you able to access the console at that point? Querying netstat -m whilst in that state would be telling.

            C 1 Reply Last reply Reply Quote 0
            • C
              captain118 @stephenw10
              last edited by

              @stephenw10 I think I did run it but I didnt take a picture of it.

              C 1 Reply Last reply Reply Quote 0
              • C
                captain118 @captain118
                last edited by

                @captain118 Its been a while since I did it the first time. I dont remember if the console was responsive or not. I may not have run it until after a reboot. Either way, I dont have a picture of it.

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  Are you able to test a clean 2.7.2 install with your config restored into it?

                  Nothing you're running seems particularly exotic so it could be something that didn't upgrade as expected. Though I'd expect more failures than that in that situation.

                  I assume you don't have anything custom installed?

                  C 1 Reply Last reply Reply Quote 0
                  • C
                    captain118 @stephenw10
                    last edited by

                    @stephenw10 Nothing custom installed. I did wonder if there was a possiblity that the bridge that didnt survive the update could have been part of what caused the issues I'm seeing. I can do a fresh install of 2.7.2 in a couple of weeks. I wanted to make sure there wasnt anything I should do before resorting to a full rebuild.

                    I see you work at netgate. Is there anything that would be useful for you to have before I do the rebuild? I wish I had taken some time between the 2.6 and 2.7 upgrades so I could pinpoint where I saw the problem arise, but alas that was not the case.

                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by

                      Hmm, I missed the bridge. What did you have bridged? What do you in place of that now?

                      Grabbing a status_output file is always useful whenever any debugging is required:
                      https://docs.netgate.com/pfsense/en/latest/recipes/diagnostic-data.html

                      C 1 Reply Last reply Reply Quote 0
                      • C
                        captain118 @stephenw10
                        last edited by

                        @stephenw10 I had bridged my main inside interface with another interface to function as a span interface for capturing traffic to be analyzed by security onion. I havent set it back up yet.

                        1 Reply Last reply Reply Quote 0
                        • stephenw10S
                          stephenw10 Netgate Administrator
                          last edited by

                          Hmm, but none of that remained in the config? No bridge device shown in ifconfig?

                          C 1 Reply Last reply Reply Quote 0
                          • C
                            captain118 @stephenw10
                            last edited by

                            @stephenw10 It doesnt show in either the UI or the ifconfig output.

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator
                              last edited by

                              Hmm, well I would be trying a clean 2.7.2 install at this point. I'm not aware of any known mbuf leak so we need to determine if it's the config or something broken in the install.

                              1 Reply Last reply Reply Quote 1
                              • First post
                                Last post
                              Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.