Traffic shaper changes [90% completed, please send money to complete bounty]

ridnhard19 · Mar 31, 2008, 11:33 PM

@sullrich:

Embedded upgrades are not supported and are not known to work all the time. See the release notes.

Is it possible to roll a full/regular image for the embedded platform?

SlickNetAaron · Mar 31, 2008, 11:34 PM

This is true, but is the size of this image correct? 70mb? The previous embedded image was half that.

@sullrich:

Embedded upgrades are not supported and are not known to work all the time. See the release notes.

mikenl · Apr 1, 2008, 2:26 PM

@k3rmit:

Thanks for the new update, however once installed and followed trough the revised (great thanks) multi lan wizard, i got stuck at "Generating ALTQ queues…" in the filter reload page.

It's not going forward and cannot get back to the shaper page, i have this error:
Fatal error: Call to a member function on a non-object in /usr/local/www/firewall_shaper.php on line 321
Thanks for any help

albe

@ermal:

Can you please send me a copy of the <shaper>and <ezshaper>sections of config.xml.
Please even tell me what options you choosed since i tested it but could not get to this error.

For you try to delete the <shaper>section and try again.</shaper></ezshaper></shaper>

I'm experiencing the same problem.
Removing the <shaper>section from /cf/conf/config.xml doesn't help, i also tried deleting the <ezshaper>bit.
I tried the single wan multilan wizard. Hfsc, p2p catch all, prioritize http, dns. I believe thats it.
http://twentse-es.nl/shaper_config.xml</ezshaper></shaper>

eri-- · Apr 1, 2008, 4:48 PM

http://cvstrac.pfsense.com/chngview?cn=21849
Found the problem it should not happen only with the Sinlge Lan multi Wan wizard.

If you can't wait for the next build do your fixes accordingly it is not hard afaik.

SlickNetAaron · Apr 1, 2008, 6:10 PM

I just reflashed with the image provided. It was labeled "upgrade" and now ALIX reports there is no boot disk. I imagine that since the image was labeled "upgrade" that we cannot flash this image? So how do we get this to go since upgrades are not supported?

I've had my network torn apart for 5 days waiting for a working shaper. I need to wrap this up.

@SlickNetAaron:

This is true, but is the size of this image correct? 70mb? The previous embedded image was half that.

@sullrich:

Embedded upgrades are not supported and are not known to work all the time. See the release notes.

sullrich · Apr 1, 2008, 6:15 PM

Embedded upgrades are not supported at all.

SlickNetAaron · Apr 1, 2008, 6:22 PM

@sullrich:

Embedded upgrades are not supported at all.

I understand that.

But the image that is provided by ermal is labeled "embedded upgrade". I flashed it (NOT using the upgrade process) and the image is invalid.

So the dev is ONLY giving us an embedded upgrade, which isn't working. And if we flash the image, it is not bootable.

Do you see the problem?

Aaron

hoba · Apr 1, 2008, 6:24 PM

It's a custom update file I think. You should feed it as such to the webgui. It's only labeled that way so the webgui accepts it as upgrade I think. Ermal has to comment on this.

SlickNetAaron · Apr 1, 2008, 6:31 PM

@hoba:

It's a custom update file I think. You should feed it as such to the webgui. It's only labeled that way so the webgui accepts it as upgrade I think. Ermal has to comment on this.

The Web GUI will NOT accept it. Option 13 on the console fails - as described above by myself and someone else.

This image is 2x the normal size?? I don't think the image was built correctly! And we only have the "upgrade" image, with no full install image provided.

Aaron

mikenl · Apr 1, 2008, 8:08 PM

@ermal:

http://cvstrac.pfsense.com/chngview?cn=21849
Found the problem it should not happen only with the Sinlge Lan multi Wan wizard.

If you can't wait for the next build do your fixes accordingly it is not hard afaik.

Fixed it indeed, thanks.

eri-- · Apr 1, 2008, 8:11 PM

SlickNetAron i am building it. Check the link i gave i will update it there.

You will notice from the date.

SlickNetAaron · Apr 2, 2008, 5:01 AM

@ermal:

SlickNetAron i am building it. Check the link i gave i will update it there.

You will notice from the date.

I'm not seeing this yet.. Is it the link that has ermal in the url?

Thanks,
Aaron

GoldServe · Apr 2, 2008, 7:53 AM

Can I get a quick who to send money to and where to request access for the embedded 1.2 images?

I just found out that when I torrent, a lot of my ACKs are delayed so surfing web pages is much slower. I just want a simple configuration to prioritize http traffic and ACKs.

Thanks.

SlickNetAaron · Apr 2, 2008, 4:24 PM

FYI, The shaper wizard built into 2.1 release will already do this.

This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

Unless you have multiple WANs or multiple LANs, it doesn't sound like you need this new shaper? I'm just letting you know that you can already do what you like in the current 1.2 release. If you are running 1.2, you probably do not have it configured correctly.

If you use pfSense and appreciate the work of the devs, please donate! These guys work very hard, and pfSense is pretty great! Just from the info you gave, it doesn't sound like you need the new shaper. Your situation, as described, is quite basic.

Regards,
Aaron

@GoldServe:

Can I get a quick who to send money to and where to request access for the embedded 1.2 images?

I just found out that when I torrent, a lot of my ACKs are delayed so surfing web pages is much slower. I just want a simple configuration to prioritize http traffic and ACKs.

Thanks.

GoldServe · Apr 2, 2008, 5:51 PM

@SlickNetAaron:

FYI, The shaper wizard built into 2.1 release will already do this.

This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

Unless you have multiple WANs or multiple LANs, it doesn't sound like you need this new shaper? I'm just letting you know that you can already do what you like in the current 1.2 release. If you are running 1.2, you probably do not have it configured correctly.

If you use pfSense and appreciate the work of the devs, please donate! These guys work very hard, and pfSense is pretty great! Just from the info you gave, it doesn't sound like you need the new shaper. Your situation, as described, is quite basic.

Regards,
Aaron

I do have mulitple WANs but it seems my problem may be due to other reasons..like PFsense is overloaded in packets or some tcp window size issue as described here: http://forum.pfsense.org/index.php/topic,8698.0.html

I would still like to donate for all the hard work put into this project and maybe try the new shaper if it can help my problems.

eri-- · Apr 2, 2008, 6:00 PM

This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

Pretty nervous buddy what's wrong?! You think you are at a retal store in here?!

Anyway teh build is running for embedded when it is finished you will find it there.

Please, honor your claims by gathering all this things into a nice tutorial.

mikenl · Apr 2, 2008, 9:14 PM

Found a rather simple writeup of HSFC basics with some nice examples, thought others could benefit from it.
http://calomel.org/pf_hfsc.html

Still trying to find a bit of text explaining why drops happen, and i don't see any borrows,
cause in my understanding right now HFSC is all about scheduling time based more than solely prioritize traffice.

Ermal, if i use the traffic shaping wizard 1 wan multi lan, than in my setup the qLocal queues get assigned a negative bandwidth for some reason and
you'll get errors. No biggie, but i guess i should mention it.

eri-- · Apr 2, 2008, 10:14 PM

Yeah i hardcoded a value of 10Mbits in there and i guess i was wrong ::)

What do you mean drop happens and you do not see any borrows?!
With HFSC you will not see any borrows on Status->Queues. That is there only for CBQ scheduler.

You can increase the queue limit somewhat to eliminate the drops.
The default size is 50 slots. If you double it be aware that you might tradeof latency with that.

mikenl · Apr 2, 2008, 10:21 PM

yeah makes perfect sense with the numbers i'm getting.
Ok borrows are for CBQ only.
Then i'm still wondering why i sometimes get 200000+ drops on a queue.
Is the queue not getting enough bandwidth ? or is it thorreteling then ?

ridnhard19 · Apr 3, 2008, 3:07 AM

Hi ermal, I hate to bring more bad news, or maybe I dont know how to use your version of the *.img file but it does not work. The file size is almost 4 times the size of a normal embedded image during the RC's and final releases of the normal software. With this said I gave it the benifit of the dought and flashed it; would not boot. I checked to see if it was compressed (part of flashing you decompress and pipe to std in of dd; following instructions) and It was not.

I compressed the file to see if we got something close to the size which is distributed on the website as the standard FINAL release of the last version; it ended up being 380kb. Something does not seem quite right or I dont know how to use your specific IMG file.

If someone pointed me to directions I can try and help roll some of the embedded images and test them before they get pushed out to the masses. This might help eliminate some of the frustration.

Thanks for all your work on this, I have gotten it working, was having trouble with the floating rules but I understand this new version fixes that. Looking forward to seeing it in action again.

@ermal:

This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

Pretty nervous buddy what's wrong?! You think you are at a retal store in here?!

Anyway teh build is running for embedded when it is finished you will find it there.

Please, honor your claims by gathering all this things into a nice tutorial.