Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Traffic shaper changes [90% completed, please send money to complete bounty]

    Completed Bounties
    72
    375
    462.0k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • S
      SlickNetAaron
      last edited by

      I just reflashed with the image provided.  It was labeled "upgrade" and now ALIX reports there is no boot disk.  I imagine that since the image was labeled "upgrade" that we cannot flash this image?  So how do we get this to go since upgrades are not supported?

      I've had my network torn apart for 5 days waiting for a working shaper.  I need to wrap this up.

      @SlickNetAaron:

      This is true, but is the size of this image correct?  70mb?  The previous embedded image was half that.

      @sullrich:

      Embedded upgrades are not supported and are not known to work all the time.  See the release notes.

      1 Reply Last reply Reply Quote 0
      • S
        sullrich
        last edited by

        Embedded upgrades are not supported at all.

        1 Reply Last reply Reply Quote 0
        • S
          SlickNetAaron
          last edited by

          @sullrich:

          Embedded upgrades are not supported at all.

          I understand that.

          But the image that is provided by ermal is labeled "embedded upgrade".  I flashed it (NOT using the upgrade process) and the image is invalid.

          So the dev is ONLY giving us an embedded upgrade, which isn't working.  And if we flash the image, it is not bootable.

          Do you see the problem?

          Aaron

          1 Reply Last reply Reply Quote 0
          • H
            hoba
            last edited by

            It's a custom update file I think. You should feed it as such to the webgui. It's only labeled that way so the webgui accepts it as upgrade I think. Ermal has to comment on this.

            1 Reply Last reply Reply Quote 0
            • S
              SlickNetAaron
              last edited by

              @hoba:

              It's a custom update file I think. You should feed it as such to the webgui. It's only labeled that way so the webgui accepts it as upgrade I think. Ermal has to comment on this.

              The Web GUI will NOT accept it.  Option 13 on the console fails - as described above by myself and someone else.

              This image is 2x the normal size??  I don't think the image was built correctly!  And we only have the "upgrade" image, with no full install image provided.

              Aaron

              1 Reply Last reply Reply Quote 0
              • M
                mikenl
                last edited by

                @ermal:

                http://cvstrac.pfsense.com/chngview?cn=21849
                Found the problem it should not happen only with the Sinlge Lan multi Wan wizard.

                If you can't wait for the next build do your fixes accordingly it is not hard afaik.

                Fixed it indeed, thanks.

                1 Reply Last reply Reply Quote 0
                • E
                  eri--
                  last edited by

                  SlickNetAron i am building it. Check the link i gave i will update it there.

                  You will notice from the date.

                  1 Reply Last reply Reply Quote 0
                  • S
                    SlickNetAaron
                    last edited by

                    @ermal:

                    SlickNetAron i am building it. Check the link i gave i will update it there.

                    You will notice from the date.

                    I'm not seeing this yet..  Is it the link that has ermal in the url?

                    Thanks,
                    Aaron

                    1 Reply Last reply Reply Quote 0
                    • G
                      GoldServe
                      last edited by

                      Can I get a quick who to send money to and where to request access for the embedded 1.2 images?

                      I just found out that when I torrent, a lot of my ACKs are delayed so surfing web pages is much slower. I just want a simple configuration to prioritize http traffic and ACKs.

                      Thanks.

                      1 Reply Last reply Reply Quote 0
                      • S
                        SlickNetAaron
                        last edited by

                        FYI, The shaper wizard built into 2.1 release will already do this.

                        This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

                        Unless you have multiple WANs or multiple LANs, it doesn't sound like you need this new shaper?  I'm just letting you know that you can already do what you like in the current 1.2 release.  If you are running 1.2, you probably do not have it configured correctly.

                        If you use pfSense and appreciate the work of the devs, please donate!  These guys work very hard, and pfSense is pretty great!  Just from the info you gave, it doesn't sound like you need the new shaper.  Your situation, as described, is quite basic.

                        Regards,
                        Aaron

                        @GoldServe:

                        Can I get a quick who to send money to and where to request access for the embedded 1.2 images?

                        I just found out that when I torrent, a lot of my ACKs are delayed so surfing web pages is much slower. I just want a simple configuration to prioritize http traffic and ACKs.

                        Thanks.

                        1 Reply Last reply Reply Quote 0
                        • G
                          GoldServe
                          last edited by

                          @SlickNetAaron:

                          FYI, The shaper wizard built into 2.1 release will already do this.

                          This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

                          Unless you have multiple WANs or multiple LANs, it doesn't sound like you need this new shaper?  I'm just letting you know that you can already do what you like in the current 1.2 release.  If you are running 1.2, you probably do not have it configured correctly.

                          If you use pfSense and appreciate the work of the devs, please donate!  These guys work very hard, and pfSense is pretty great!  Just from the info you gave, it doesn't sound like you need the new shaper.  Your situation, as described, is quite basic.

                          Regards,
                          Aaron

                          I do have mulitple WANs but it seems my problem may be due to other reasons..like PFsense is overloaded in packets or some tcp window size issue as described here: http://forum.pfsense.org/index.php/topic,8698.0.html

                          I would still like to donate for all the hard work put into this project and maybe try the new shaper if it can help my problems.

                          1 Reply Last reply Reply Quote 0
                          • E
                            eri--
                            last edited by

                            This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

                            Pretty nervous buddy what's wrong?! You think you are at a retal store in here?!

                            Anyway teh build is running for embedded when it is finished you will find it there.

                            Please, honor your claims by gathering all this things into a nice tutorial.

                            1 Reply Last reply Reply Quote 0
                            • M
                              mikenl
                              last edited by

                              Found a rather simple writeup of HSFC basics with some nice examples, thought others could benefit from it.
                              http://calomel.org/pf_hfsc.html

                              Still trying to find a bit of text explaining why drops happen, and i don't see any borrows,
                              cause in my understanding right now HFSC is all about scheduling time based more than solely prioritize traffice.

                              Ermal, if i use the traffic shaping wizard 1 wan multi lan, than in my setup the qLocal queues get assigned a negative bandwidth for some reason and
                              you'll get errors. No biggie, but i guess i should mention it.

                              1 Reply Last reply Reply Quote 0
                              • E
                                eri--
                                last edited by

                                Yeah i hardcoded a value of 10Mbits in there and i guess i was wrong  ::)

                                What do you mean drop happens and you do not see any borrows?!
                                With HFSC you will not see any borrows on Status->Queues. That is there only for CBQ scheduler.

                                You can increase the queue limit somewhat to eliminate the drops.
                                The default size is 50 slots. If you double it be aware that you might tradeof latency with that.

                                1 Reply Last reply Reply Quote 0
                                • M
                                  mikenl
                                  last edited by

                                  yeah makes perfect sense with the numbers i'm getting.
                                  Ok borrows are for CBQ only.
                                  Then i'm still wondering why i sometimes get 200000+ drops on a queue.
                                  Is the queue not getting enough bandwidth ? or is it thorreteling then ?

                                  1 Reply Last reply Reply Quote 0
                                  • R
                                    ridnhard19
                                    last edited by

                                    Hi ermal, I hate to bring more bad news, or maybe I dont know how to use your version of the *.img file but it does not work.  The file size is almost 4 times the size of a normal embedded image during the RC's and final releases of the normal software. With this said I gave it the benifit of the dought and flashed it; would not boot.  I  checked to see if it was compressed (part of flashing you decompress and pipe to std in of dd; following instructions) and It was not.

                                    I compressed the file to see if we got something close to the size which is distributed on the website as the standard FINAL release of the last version; it ended up being 380kb.  Something does not seem quite right or I dont know how to use your specific IMG file.

                                    If someone pointed me to directions I can try and help roll some of the embedded images and test them before they get pushed out to the masses.  This might help eliminate some of the frustration.

                                    Thanks for all your work on this, I have gotten it working, was having trouble with the floating rules but I understand this new version fixes that. Looking forward to seeing it in action again.

                                    @ermal:

                                    This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

                                    Pretty nervous buddy what's wrong?! You think you are at a retal store in here?!

                                    Anyway teh build is running for embedded when it is finished you will find it there.

                                    Please, honor your claims by gathering all this things into a nice tutorial.

                                    1 Reply Last reply Reply Quote 0
                                    • S
                                      sullrich
                                      last edited by

                                      Images updated.  Try pfSense.img.gz          02-Apr-2008 23:39  24.6M

                                      1 Reply Last reply Reply Quote 0
                                      • S
                                        SlickNetAaron
                                        last edited by

                                        @sullrich:

                                        Images updated.  Try pfSense.img.gz          02-Apr-2008 23:39  24.6M

                                        So we are using the sullrich folder again :)

                                        Thanks so much for fixing the image!  I'm booting now at least! Yaay!

                                        Ermal,  you can hold me to writing a tutorial/doc for the new shaper.  Just one thing I require before doing that: a working shaper  ;D

                                        Assuming this build is good to go for the most part, do you foresee any material changes that would affect my doc?  Or is this still a work in progress?  I would like to work closely with you to make sure my work (and the doc) is correct.

                                        Aaron

                                        1 Reply Last reply Reply Quote 0
                                        • S
                                          SlickNetAaron
                                          last edited by

                                          Hi ermal,

                                          I just ran the 1 wan, multi LAN wizard.  I get the following error at the end:

                                          There were error(s) loading the rules: cannot determine interface bandwidth for vr2, specify an absolute bandwidthaltq not defined on vr2 altq not defined on vr2 /tmp/rules.debug:26: errors in queue definition altq not defined on vr2 /tmp/rules.debug:27: errors in queue definition altq not defined on vr2 /tmp/rules.debug:28: errors in queue definition altq not defined on vr2 /tmp/rules.debug:29: errors in queue definition altq not defined on vr2 /tmp/rules.debug:30: errors in queue definition altq not defined on vr2 /tmp/rules.debug:31: errors in queue definition altq not defined on vr2 /tmp/rules.debug:32: errors in queue definition pfctl: Syntax error in config file: pf rules not loaded - The line in question reads [26]: queue qInternet on vr2 bandwidth 15Mb hfsc ( red , linkshare (15Mb, 100, 15Mb) , upperlimit 15Mb ) { qACK, qOthersDefault, qP2P, qVoIP, qOthersHigh, qOthersLow } …

                                          I'm going to run with the 1 interface and see how she goes.

                                          Aaron

                                          1 Reply Last reply Reply Quote 0
                                          • E
                                            eri--
                                            last edited by

                                            That is a problem of the vr driver which has been fixed in the latest versions of it.

                                            What you can do after running the wizard is to set the bandwidth of root queue ie "lan, wam,opt1" if it is not set since the driver does not automatically report its link layer speed to altq.
                                            Usually that would be LAN where i do not set the bandwidth explicitly since create the new structure as
                                            –rootqueue
                                            -----qInternet
                                            ------------corresponid queues

                                            I actually cannot do much about that for now. And i have not that kind of hardware to really test for all drivers that do not report this. So just a WARNING to users about that, sorry!

                                            The material want change about the shaper.

                                            Only when new queue disciplines come in. In fact they are addition to the docs to descrbie this new discipline.

                                            One thing to get verified for you that are using this update for 1.2 is the generation of the Floating Rules before the other tabs.

                                            You can do that by checking the /tmp/rules.debug and find the comment
                                            #User defined rules and see if rules of the floating tab are before the other specific interface tab rules.
                                            This is just to be sure they are ok and more eyes on it is not harmful.

                                            I hope there are no more issues in this build/update so you can use it on your environments.

                                            Thank you for your patience and sorry for any noise introduced on your environments.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.