A few squid questions
-
Hi all. I don't have Squid, yet. In the next week or so I will be putting up a rig with a 4 core i5, an 80 or 300gb harddrive, and 4gb of ram. Just a few things:
- Does Squid download the entire website you visit, or it only caches the pages you visited?
- If 1 is no, is there a way to force that?
- Does it make more sense to have your cache on an ssd and not worry about how much ram Squid uses so that if pfsense goes down (power, etc) the cache can stay in place?
-
@flybye You might want to rethink squid & caching. The modern web does not have a lot of static content, and squid struggles to cache dynamic content without significant tweaking. Back when I was using a cache, my hit rate was typically in the 4-7% range. That's practically useless. Now I just use squid as a platform for squidguard URL filtering.
To answer your questions:
- Only the pages you visit. Squid is not a spider or crawler. It fetches pages you request on demand.
- No. If you want to download complete sites, look into webcrawlers and site downloaders.
- Considering what I said above about cache effectiveness and hit rates, I don't think it really matters.
-
@kom I'm totally open to rethinking it
. I was reading about what Squid does with caching and figured it would be really useful. But hey if it's not then it's not. One less thing for me to worry about. I'll look into webcrawlers and site downloaders. My connection speed is rarely an issue, but you know our connection to a site is only as fast as the site is. Even then, maybe I will just dump the entire idea. Thx for the reply!
