Is cache really improve the connection speed?

iamthed

Mine is :
P5VD2 VM SE ASUS
Interl core2duo 2.04ghz
1gb ram
160HD sata

jigpd
Davao City

wow.. i think that's a waste to put a high speed computer for firewall
cmiiw the firewall only needs a high RAM for data processing..
they don't need a processor like core2duo, quadcore especially hardcore.. lol

well how bout ur internet speed?
mine is 8mbps..

josey

you said waste ;D

i have amd 6000
2gb ram
2x160gb sata drives in raid :)

i have 6mbps link,
set size of HDD cache to 1gb
ram to 256mb
minimum object size 0
maximum 256kb

how big is your cache?
how did you set it up?

this cache setup is not working for me, i did a test, download file 100mb, when finished, start to download it from another comp, same speed, second comp downloading from internet not from cache

jahonix

@josey:

minimum object size 0
maximum 256kb
[…] i did a test, download file 100mb,

Obviously, you set the max. size for cached objects smaller than what you were testing with. So it didn't get cached as by your settings.

jigpe

My net is 2mb up/dl
users: 25
slow inet :(
how to delete cache? old logs too?
i used to delete /var/squid acl/log/cache but same thing..
Is there a way to clear the cache logs?

thanks,
jigp
Davao City

josey

@jahonix:

@josey:

minimum object size 0
maximum 256kb
[…] i did a test, download file 100mb,

Obviously, you set the max. size for cached objects smaller than what you were testing with. So it didn't get cached as by your settings.

no, no, no
one file of 100mb is made of hundreds or more packages!
this is got nothing to do with it.
or do have?

then pfs have wrong description :) on package size :)
"Maximum object size xxx kb
Objects larger than the size specified (in kilobytes) will not be saved on disk. If you wish to increase speed more than you want to save bandwidth, this should be set to a low value. "

to low? no logic at all… it should be contrary?

how large package size did you set?

jigpe

thanks for the quick reply.i set 980970.

thanks,
jigp
Davao City

josey

@jigpe:

thanks for the quick reply**.i set 980970.**

thanks,
jigp
Davao City

you set 980970kb ? for object size ?

jigpe

Yup for object size.

jigp
Davao City

iamthed

i'm confuse about cache..
cmiiw cache in this pfsense is it the same cache as the browser cache? e.g opera,mozzila or chrome?

so tell me what is the best setting for minimum object size and maximum?
my hdd only 20gb do u think it will last long ??
what happen if my cache is overload?

mhab12

The cache is similar to a browser cache, except that it is stored on the server and not on the individual workstation - this way everyone benefits from data that has already been stored. If you set the maximum object size to something like 256MB and min to zero, you will catch nearly all web traffic and most windows updates, application downloads, etc. Just set your max cache size to 10 GB (you mentioned you have a 20GB HD) and it will never 'overload' or fill up completely.

iamthed

@mhab12:

The cache is similar to a browser cache, except that it is stored on the server and not on the individual workstation - this way everyone benefits from data that has already been stored. If you set the maximum object size to something like 256MB and min to zero, you will catch nearly all web traffic and most windows updates, application downloads, etc. Just set your max cache size to 10 GB (you mentioned you have a 20GB HD) and it will never 'overload' or fill up completely.

thx for quick replay then if i'm using max cache size 10gb so the cache will stop working after 10gb right?
and should i delete cache?
or leave it behind?

and one dumb question
if i'm not enable the transparent proxy or proxy is the cache working?

josey

i finally get this….
explanation in pfs is wrong then
"Objects larger than the size specified (in kilobytes) will not be saved on disk. If you wish to increase speed more than you want to save bandwidth, this should be set to a low value."

ok i have 2gb ram, 120gb hdd, and i was playing this morning with cache,

setup
HDD cache size 1000MB
Memory cache size 512MB
Minimum object size 100kb
Maximum object size 50 000kb

and after test download, file od 40mb downloaded in 1 sec :)

but, how to clean cache?
is it automatic? oldest object deleted for new objects? or how ?

thanks

jahonix

@josey:

Minimum object size 100kb

Why don't you cache smaller objects as well?
The background image of this forum is: 1.14 KB (1169 Bytes) and isn't cached with your settings.

@josey:

but, how to clean cache?
is it automatic? oldest object deleted for new objects? or how ?

Yes. Just leave it alone and let it do it's magic.

mhab12

@josey:

oldest object deleted for new objects? or how ?

Go to the 'cache management tab' and read about Cache replacement policy and Memory replacement policy - it's more than you ever wanted to know.

josey

thnx guys i figure it up yesterday :)

set up
hard disck cache size 100GB
hard disk cache system UFS
memory cache size 1GB
minimum object size 0
maximum object size 1GB
memory replacement policy Heap LFUDA

now internet is "fast" like i have 100mbps instead 6mbps :D
it works just great

great product guys, keep up with good work

jigpe

Ok thanks. Is it okay to set 100000? 160GB HD

jigp
Davao City

josey

well, yes, you can put even 140gb,

pfs uses less than 1gb, and + swap is 1gb

iamthed

@josey:

i finally get this….
explanation in pfs is wrong then
"Objects larger than the size specified (in kilobytes) will not be saved on disk. If you wish to increase speed more than you want to save bandwidth, this should be set to a low value."

ok i have 2gb ram, 120gb hdd, and i was playing this morning with cache,

setup
HDD cache size 1000MB
Memory cache size 512MB
Minimum object size 100kb
Maximum object size 50 000kb

and after test download, file od 40mb downloaded in 1 sec :)

why you set minimum object size to 100 kb
and max object size 50000 kb?

i think it's mean max object size per packet..
40mb file that u download it's consist of thousand packet i think

but, how to clean cache?
is it automatic? oldest object deleted for new objects? or how ?

thanks

chudy

First of all Squid is the most powerful and high performance cache.

The question is how you setup your squid…
If you only setup squid as default configuration then forget about squid. stick to your browsers cache.

When using squid:
1. you have to set your refresh pattern to override's servers content expiry(this way that content stays longer to your cache drive), reload-into-ims(check if modified)
2. Increase cache_dir(hdd is the limit), minimm object size to zero, maximum object size to 200MB(some porn has greater than 200MB;D)
This would only give you max saving around 25% you can see if you have mrtg to monitor your squid.

When using full potential it would give you max up to 100% or average of 60% (this includes contents html, php or alike which marked not to cache)
1. use StoreUrlRewrite feature (which you can cache youtube and any CDN servers)

Tikimotel

@josey:

thnx guys i figure it up yesterday :)

set up
hard disck cache size 100GB
hard disk cache system UFS
memory cache size 1GB
minimum object size 0
maximum object size 1GB
memory replacement policy Heap LFUDA

now internet is "fast" like i have 100mbps instead 6mbps :D
it works just great

great product guys, keep up with good work

I'm afraid your experience will degrade over time…
For every GB of HDD cache Squid will allocate approx. an extra 10MB of RAM. (like an index)

(my rig has 1GB ram minus some shared video ram)
Here is my cache setup:

Cache management page :
Hard disk cache size = 2000 MB (more HDD space uses more RAM becarefull not set it too big)
Memory cache size = 128 MB
Minimum object size = 0 KB

Maximum object size = 8192 KB (Squid default is 4096 KB)
set this larger if you want too (32MB maybe) it depends on how much files are how large and how often you download these types of files.
Read the squid visolve manual on caching policy (heap LFUDA). This not always stored in memory, it is the "cache" value!!! It can either be RAM or HDD.

Memory replacement policy = heap LFUDA (RAM cache object handling)
Cache replacement policy = heap LFUDA (HDD cache object handling)

General settings page:
Custom Options =
redirect_program /usr/local/libexec/adzap;redirect_children 10;maximum_object_size_in_memory 128 KB;

maximum_object_size_in_memory; I bumped that value up from the default 64KB because some sites (I visit often) use larger object than 64KB and so this raises the chance of objects being cached from RAM in stead of HDD cache. Play with this value a little in combination with the "Memory cache size" value, remember mine is set to 128MB ram being used. (128MB / 128KB = max. number of "large" objects cached directly from squid RAM. RAM is faster than HDD.) Don't over do these options it will do more harm than good over time…performance will suffer.

I also have "Snort package" running and these options balance my memory consumption nicely. (60 -70 percent average)