PfSense 2.2.3 - Slow UPLOAD Speed via Squid3

gdsnytech · Jul 17, 2015, 8:03 PM

I'm using an HP proliant server with RAID 1, 6GB RAM, Xeon processor, 4 NICS (only two are being used which are bridged). HDD cache is enabled as i would like some caching done as well.

KOM · Jul 17, 2015, 8:15 PM

Did you set up some monstrously large number of level-1 subdirs in conjunction with a very large cache size?

gdsnytech · Jul 17, 2015, 8:36 PM

@KOM:

Did you set up some monstrously large number of level-1 subdirs in conjunction with a very large cache size?

Level-1 = 16

I have 100GB set for HDD cache, 2GB for Mem cache.

Also using diskd. ipcs and ipcrm were copied from a FreeBSD 10.1 distro to pfsense /usr/local/bin.

KOM · Jul 17, 2015, 8:37 PM

How full is that 100GB? As a test you cold try blowing the cache away, recreate and then see if there is any performance difference.

gdsnytech · Jul 17, 2015, 8:39 PM

@KOM:

How full is that 100GB? As a test you cold try blowing the cache away, recreate and then see if there is any performance difference.

It is nowhere near full. In fact i have cleared it numerous times today.

gdsnytech · Jul 17, 2015, 8:41 PM

There is something completely off ass download speeds hit 85+ while upload speeds hit around 30 - 40. It doesn't make sense.

KOM · Jul 17, 2015, 8:43 PM

I might suggest disabling the disk cache altogether and see if it is disk-related or not. Set the size to minimum (0 or 1) and the file system to null.

gdsnytech · Jul 17, 2015, 10:59 PM

@KOM:

I might suggest disabling the disk cache altogether and see if it is disk-related or not. Set the size to minimum (0 or 1) and the file system to null.

I have made the changes, rebooted and it is still clocking around the same. Nothing changed pretty much.

I have even disabled SquidGuard and the upload speed is still hitting around 30 and 40. More like 30 and 35. It hardly ever hits 40. And this was tested on multiple machines by the way.

KOM · Jul 20, 2015, 1:50 PM

I don't know what to tell you. I also have a 100Mb fibre connection and we don't have those speed issues.

Guest · Jul 20, 2015, 3:23 PM

I don't know what to tell you. I also have a 100Mb fibre connection and we don't have those speed issues.

Would you tell us your hardware parts please?

We where also very disappointed about our Squid throughput indeed! So we want now
setting up a the new pfSense box and then we want to set behind the firewall (pfSense)
a stand alone Squid Proxy & SquidGuard, based on the following numbers:
Linux Based Squid 3

RAID1 (2 HDD/SSD)
RAID5 or RAID10 (4 SSDs) Cache
Intel Xeon E3-1286v3
Intel Quad port NIC
32 GB ECC GB RAM

Also Snort sensors and a dedicated Snort Server would freeing the firewall from more load.

KOM · Jul 20, 2015, 5:15 PM

a stand alone Squid Proxy & SquidGuard

I was going to do this but I ran into the problem of every major distro on Earth packaging old versions of Squid. Even the latest Ubuntu server ships with squid 3.3.8(!) and has a broken squidguard:

https://bugs.launchpad.net/ubuntu/+source/squid3/+bug/1448149

I tried a few others and it was even worse, with squid 3.2 being the favourite shipping version in the top distros. I would rather not have to compile from source and then keep up on it like that. When pfSense 2.2 came out with better squid support, I ended up staying with it instead of spinning off a separate Squid server.

gdsnytech · Jul 20, 2015, 7:32 PM

The speed within the last hour is hitting at 83 for down and 20 for up! :-\

This is in an environment with less than 100 users. :o

Guest · Jul 20, 2015, 8:56 PM

This is in an environment with less than 100 users.

Perhaps pending on the hardware you are using?

gdsnytech · Jul 25, 2015, 12:06 PM

The culprit i have found it in fact to be the "Antivirus", ClamAv and I-cap. The speeds are nearly identical, up above 90/70 with it turned off.

With it on upload in particular is hitting around the 30 mark. Barely over at times.

Any suggestion(s) in tuning ClamAV and I-Cap?