Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Traffic shaper changes [90% completed, please send money to complete bounty]

    Scheduled Pinned Locked Moved Completed Bounties
    375 Posts 72 Posters 466.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      billm
      last edited by

      Just wanted to update the thread.  I'm still working on this, had some issues with some of the new gui libraries that we needed to get fixed as well as some VM issues that are now resolved.  I'm hoping to spend some time during my vacation to get a new wizard completed which should allow me to generate configs that I can use to create the backend :)  Due to the use of the new gui library, I can pretty easily say that this won't appear in the RELENG_1 branch at all, but I'll attempt to backport it for those that have pledged and donated for this so it can get tested and have some eyes on it earlier (and of course so you can have a new toy :)).

      –Bill

      pfSense core developer
      blog - http://www.ucsecurity.com/
      twitter - billmarquette

      1 Reply Last reply Reply Quote 0
      • S
        sai
        last edited by

        Thanks Bill.

        I have a request: could you make the wizard optional please?

        I realize that altq is really difficult to understand, but sometimes you just want to set things up yourself. This is especially true when you are trying to learn about the software.

        1 Reply Last reply Reply Quote 0
        • B
          billm
          last edited by

          @sai:

          Thanks Bill.

          I have a request: could you make the wizard optional please?

          I realize that altq is really difficult to understand, but sometimes you just want to set things up yourself. This is especially true when you are trying to learn about the software.

          The wizard is already optional.  I do plan on making the manual configuration a little more reliable and less prone to easy breakage (the real problem) though.

          –Bill

          pfSense core developer
          blog - http://www.ucsecurity.com/
          twitter - billmarquette

          1 Reply Last reply Reply Quote 0
          • L
            Leoandru
            last edited by

            Hey Bill mind if I chip in on this project? I'm finding more free time on my hand these days, so I'm specifically interested in helping with transparent shaping and investigating the muliwan/multinterface shaping of altq.

            1 Reply Last reply Reply Quote 0
            • B
              billm
              last edited by

              @Leoandru:

              Hey Bill mind if I chip in on this project? I'm finding more free time on my hand these days, so I'm specifically interested in helping with transparent shaping and investigating the muliwan/multinterface shaping of altq.

              You might check out http://wiki.pfsense.com/wikka.php?wakka=NewShaperNotes.  I think I can handle bridge, and multi-lan w/out too much problem.  Multi-wan is going to be a tad more challenging I think.

              –Bill

              pfSense core developer
              blog - http://www.ucsecurity.com/
              twitter - billmarquette

              1 Reply Last reply Reply Quote 0
              • L
                Leoandru
                last edited by

                @billm:

                @Leoandru:

                Hey Bill mind if I chip in on this project? I'm finding more free time on my hand these days, so I'm specifically interested in helping with transparent shaping and investigating the muliwan/multinterface shaping of altq.

                You might check out http://wiki.pfsense.com/wikka.php?wakka=NewShaperNotes.  I think I can handle bridge, and multi-lan w/out too much problem.  Multi-wan is going to be a tad more challenging I think.

                –Bill

                cool, I'll experiment with altq and multi-wan shaping and update the wiki with my findings and ideas. Off the bat though I'm not sure if this can be done without modifying altq itself. Also I'll experiment with the ideas you currently have to see if I can add any additional info. What about transparent/l7 shaping? have any ideas or wiki entry on that? I have a few idea's I'd like to share on that, I probably make a wiki entry once I setup a testing platform this weekend and put together some notes.

                1 Reply Last reply Reply Quote 0
                • S
                  sullrich
                  last edited by

                  @Leoandru:

                  cool, I'll experiment with altq and multi-wan shaping and update the wiki with my findings and ideas. Off the bat though I'm not sure if this can be done without modifying altq itself. Also I'll experiment with the ideas you currently have to see if I can add any additional info. What about transparent/l7 shaping? have any ideas or wiki entry on that? I have a few idea's I'd like to share on that, I probably make a wiki entry once I setup a testing platform this weekend and put together some notes.

                  Yay!  Glad to see you have some free time Leo!

                  1 Reply Last reply Reply Quote 0
                  • L
                    Leoandru
                    last edited by

                    just a little update: The multiple interface shaping feature is starting to look a bit daunting, altq was not designed for it. The queuing hierarchy created on each interface are totally unrelated. So if you try to shape 1 wan interface over two lans then altq simple can't do it. Probably some combination of dummynet and altq would solve the problem, I'll post my opinions on the wiki later.

                    1 Reply Last reply Reply Quote 0
                    • B
                      billm
                      last edited by

                      Thanks Leon…I'll check out the wiki, the configs apply, but I'm not terribly surprised it doesn't work quite as advertised :-/

                      --Bill

                      pfSense core developer
                      blog - http://www.ucsecurity.com/
                      twitter - billmarquette

                      1 Reply Last reply Reply Quote 0
                      • H
                        hoba
                        last edited by

                        As dummynet can shape incoming on an interface this would be an option to shape traffic inside tunnels as well (before the traffic on the outgoing interface is only seen as encrypted traffic only). I have some setups that work this way pretty well with m0n0wall. However, getting this all under control and even crunching all that logic in a wizard will be a hard task I guess and considering multiple interfaces…

                        1 Reply Last reply Reply Quote 0
                        • S
                          sullrich
                          last edited by

                          @hoba:

                          As dummynet can shape incoming on an interface this would be an option to shape traffic inside tunnels as well (before the traffic on the outgoing interface is only seen as encrypted traffic only). I have some setups that work this way pretty well with m0n0wall. However, getting this all under control and even crunching all that logic in a wizard will be a hard task I guess and considering multiple interfaces…

                          Dummynet does not work with ALTQ/PF.  As soon as you add a RDR, all traffic stops on the firewall.

                          1 Reply Last reply Reply Quote 0
                          • B
                            billm
                            last edited by

                            @Leoandru:

                            just a little update: The multiple interface shaping feature is starting to look a bit daunting, altq was not designed for it. The queuing hierarchy created on each interface are totally unrelated. So if you try to shape 1 wan interface over two lans then altq simple can't do it. Probably some combination of dummynet and altq would solve the problem, I'll post my opinions on the wiki later.

                            Leon, any updates on this?  I've been holding off spending much more time on this until it's proven working (or not)…it should work I think, but it's a bit of a hack to setup as best as I can tell.

                            --Bill

                            pfSense core developer
                            blog - http://www.ucsecurity.com/
                            twitter - billmarquette

                            1 Reply Last reply Reply Quote 0
                            • L
                              Leoandru
                              last edited by

                              @billm:

                              Leon, any updates on this?  I've been holding off spending much more time on this until it's proven working (or not)…it should work I think, but it's a bit of a hack to setup as best as I can tell.

                              --Bill

                              No.. I haven't been able to make it work, I was holding off the write up on this until I had absolutely given up. Also I didn't know your were holding off until more proof could be given that it doesn't work, but I was hoping that you could prove me wrong with some test and sample setups. I was still experimenting with several ideas  though I haven't gotten as much time as I would have liked to experiment with them (maybe i spoke too soon of free time cause it seems to be vanishing into work). Maybe this weekend I'll be able to give something more concrete, but please go ahead with your ideas and experiment I check this thread regularly for updates so you can post any success you have had with this. Sorry for the lack of correspondence on irc, it would be nice if we could bounce ideas off each other but I just havn't found the time yet.

                              1 Reply Last reply Reply Quote 0
                              • B
                                billm
                                last edited by

                                'k I'll just drop you a private email if I can find your address again :)

                                –Bill

                                pfSense core developer
                                blog - http://www.ucsecurity.com/
                                twitter - billmarquette

                                1 Reply Last reply Reply Quote 0
                                • S
                                  SMachiz
                                  last edited by

                                  I would contribute $25 for proper dual-wan QoS/shaping.

                                  1 Reply Last reply Reply Quote 0
                                  • C
                                    cabe
                                    last edited by

                                    just a little update: The multiple interface shaping feature is starting to look a bit daunting, altq was not designed for it. The queuing hierarchy created on each interface are totally unrelated. So if you try to shape 1 wan interface over two lans then altq simple can't do it. Probably some combination of dummynet and altq would solve the problem, I'll post my opinions on the wiki later.

                                    So does this mean that it's not possible to shape across multiple WAN interfaces? Or does it mean that we can't even shape across a bridged WAP and LAN connected to a single WAN..  ???

                                    1 Reply Last reply Reply Quote 0
                                    • E
                                      eickst
                                      last edited by

                                      Any updates on this feature?  Not multi-wan but at least multi-lan such as WAP and LAN.

                                      1 Reply Last reply Reply Quote 0
                                      • S
                                        sullrich
                                        last edited by

                                        No.

                                        1 Reply Last reply Reply Quote 0
                                        • C
                                          cabe
                                          last edited by

                                          @eickst:

                                          Any updates on this feature?  Not multi-wan but at least multi-lan such as WAP and LAN.

                                          I'm probably going to just switch to the new beta of m0n0wall for that feature.

                                          1 Reply Last reply Reply Quote 0
                                          • S
                                            sullrich
                                            last edited by

                                            @cabe:

                                            @eickst:

                                            Any updates on this feature?  Not multi-wan but at least multi-lan such as WAP and LAN.

                                            I'm probably going to just switch to the new beta of m0n0wall for that feature.

                                            Have fun!

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.