Traffic shaper changes [90% completed, please send money to complete bounty]

SlickNetAaron · Mar 31, 2008, 10:11 PM

When upgrading an embedded install the file is too big:

Enter the URL to the .tgz update file:

This build seems to be a LOT larger than the last update?  40ish MB vs 70?

I'm downloading now.  Do you have that much storage available?  Will report back

Aaron

SlickNetAaron · Mar 31, 2008, 10:20 PM

I had ame result. The filesystem created on the card is smaller than the new shaper image. I have a 2GB card, but the file system is not there.
Last half of the output:

remote size / mtime: 75129099 / 1206885245
/root/firmware.tgz 70% of 71 MB 146 kBps 02m29s
/: write failed, filesystem is full
/root/firmware.tgz 70% of 71 MB 146 kBps 02m29s
fetch: /root/firmware.tgz: No space left on device

Warning: filesize(): Stat failed for /root/firmware.tgz (errno=2 - No such file or directory) in /etc/rc.initial_firmware_update on line 58

File size mismatch. Upgrade cancelled.

Aaron

sullrich · Mar 31, 2008, 11:21 PM

Embedded upgrades are not supported and are not known to work all the time. See the release notes.

ridnhard19 · Mar 31, 2008, 11:33 PM

@sullrich:

Embedded upgrades are not supported and are not known to work all the time. See the release notes.

Is it possible to roll a full/regular image for the embedded platform?

SlickNetAaron · Mar 31, 2008, 11:34 PM

This is true, but is the size of this image correct? 70mb? The previous embedded image was half that.

@sullrich:

Embedded upgrades are not supported and are not known to work all the time. See the release notes.

mikenl · Apr 1, 2008, 2:26 PM

@k3rmit:

Thanks for the new update, however once installed and followed trough the revised (great thanks) multi lan wizard, i got stuck at "Generating ALTQ queues…" in the filter reload page.

It's not going forward and cannot get back to the shaper page, i have this error:
Fatal error: Call to a member function on a non-object in /usr/local/www/firewall_shaper.php on line 321
Thanks for any help

albe

@ermal:

Can you please send me a copy of the <shaper>and <ezshaper>sections of config.xml.
Please even tell me what options you choosed since i tested it but could not get to this error.

For you try to delete the <shaper>section and try again.</shaper></ezshaper></shaper>

I'm experiencing the same problem.
Removing the <shaper>section from /cf/conf/config.xml doesn't help, i also tried deleting the <ezshaper>bit.
I tried the single wan multilan wizard. Hfsc, p2p catch all, prioritize http, dns. I believe thats it.
http://twentse-es.nl/shaper_config.xml</ezshaper></shaper>

eri-- · Apr 1, 2008, 4:48 PM

http://cvstrac.pfsense.com/chngview?cn=21849
Found the problem it should not happen only with the Sinlge Lan multi Wan wizard.

If you can't wait for the next build do your fixes accordingly it is not hard afaik.

SlickNetAaron · Apr 1, 2008, 6:10 PM

I just reflashed with the image provided. It was labeled "upgrade" and now ALIX reports there is no boot disk. I imagine that since the image was labeled "upgrade" that we cannot flash this image? So how do we get this to go since upgrades are not supported?

I've had my network torn apart for 5 days waiting for a working shaper. I need to wrap this up.

@SlickNetAaron:

This is true, but is the size of this image correct? 70mb? The previous embedded image was half that.

@sullrich:

Embedded upgrades are not supported and are not known to work all the time. See the release notes.

sullrich · Apr 1, 2008, 6:15 PM

Embedded upgrades are not supported at all.

SlickNetAaron · Apr 1, 2008, 6:22 PM

@sullrich:

Embedded upgrades are not supported at all.

I understand that.

But the image that is provided by ermal is labeled "embedded upgrade". I flashed it (NOT using the upgrade process) and the image is invalid.

So the dev is ONLY giving us an embedded upgrade, which isn't working. And if we flash the image, it is not bootable.

Do you see the problem?

Aaron

hoba · Apr 1, 2008, 6:24 PM

It's a custom update file I think. You should feed it as such to the webgui. It's only labeled that way so the webgui accepts it as upgrade I think. Ermal has to comment on this.

SlickNetAaron · Apr 1, 2008, 6:31 PM

@hoba:

It's a custom update file I think. You should feed it as such to the webgui. It's only labeled that way so the webgui accepts it as upgrade I think. Ermal has to comment on this.

The Web GUI will NOT accept it. Option 13 on the console fails - as described above by myself and someone else.

This image is 2x the normal size?? I don't think the image was built correctly! And we only have the "upgrade" image, with no full install image provided.

Aaron

mikenl · Apr 1, 2008, 8:08 PM

@ermal:

http://cvstrac.pfsense.com/chngview?cn=21849
Found the problem it should not happen only with the Sinlge Lan multi Wan wizard.

If you can't wait for the next build do your fixes accordingly it is not hard afaik.

Fixed it indeed, thanks.

eri-- · Apr 1, 2008, 8:11 PM

SlickNetAron i am building it. Check the link i gave i will update it there.

You will notice from the date.

SlickNetAaron · Apr 2, 2008, 5:01 AM

@ermal:

SlickNetAron i am building it. Check the link i gave i will update it there.

You will notice from the date.

I'm not seeing this yet.. Is it the link that has ermal in the url?

Thanks,
Aaron

GoldServe · Apr 2, 2008, 7:53 AM

Can I get a quick who to send money to and where to request access for the embedded 1.2 images?

I just found out that when I torrent, a lot of my ACKs are delayed so surfing web pages is much slower. I just want a simple configuration to prioritize http traffic and ACKs.

Thanks.

SlickNetAaron · Apr 2, 2008, 4:24 PM

FYI, The shaper wizard built into 2.1 release will already do this.

This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

Unless you have multiple WANs or multiple LANs, it doesn't sound like you need this new shaper? I'm just letting you know that you can already do what you like in the current 1.2 release. If you are running 1.2, you probably do not have it configured correctly.

If you use pfSense and appreciate the work of the devs, please donate! These guys work very hard, and pfSense is pretty great! Just from the info you gave, it doesn't sound like you need the new shaper. Your situation, as described, is quite basic.

Regards,
Aaron

@GoldServe:

Can I get a quick who to send money to and where to request access for the embedded 1.2 images?

I just found out that when I torrent, a lot of my ACKs are delayed so surfing web pages is much slower. I just want a simple configuration to prioritize http traffic and ACKs.

Thanks.

GoldServe · Apr 2, 2008, 5:51 PM

@SlickNetAaron:

FYI, The shaper wizard built into 2.1 release will already do this.

This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

Unless you have multiple WANs or multiple LANs, it doesn't sound like you need this new shaper? I'm just letting you know that you can already do what you like in the current 1.2 release. If you are running 1.2, you probably do not have it configured correctly.

If you use pfSense and appreciate the work of the devs, please donate! These guys work very hard, and pfSense is pretty great! Just from the info you gave, it doesn't sound like you need the new shaper. Your situation, as described, is quite basic.

Regards,
Aaron

I do have mulitple WANs but it seems my problem may be due to other reasons..like PFsense is overloaded in packets or some tcp window size issue as described here: http://forum.pfsense.org/index.php/topic,8698.0.html

I would still like to donate for all the hard work put into this project and maybe try the new shaper if it can help my problems.

eri-- · Apr 2, 2008, 6:00 PM

This new shaper isn't quite finished yet (after 1.5 weeks I have yet to get a working copy), and I believe it will be released to the public for free in v1.3.

Pretty nervous buddy what's wrong?! You think you are at a retal store in here?!

Anyway teh build is running for embedded when it is finished you will find it there.

Please, honor your claims by gathering all this things into a nice tutorial.

mikenl · Apr 2, 2008, 9:14 PM

Found a rather simple writeup of HSFC basics with some nice examples, thought others could benefit from it.
http://calomel.org/pf_hfsc.html

Still trying to find a bit of text explaining why drops happen, and i don't see any borrows,
cause in my understanding right now HFSC is all about scheduling time based more than solely prioritize traffice.

Ermal, if i use the traffic shaping wizard 1 wan multi lan, than in my setup the qLocal queues get assigned a negative bandwidth for some reason and
you'll get errors. No biggie, but i guess i should mention it.