Possible performance issue?



  • I cannot tell if it's a Squid3 issue or if it's my ethernet card.

    I have a pfSense firewall on an older Acer desktop. The specs are:
    Intel Pentium 4 3.06GHz w/ HT.
    2048 MB RAM (-16MB for video, lowest I can go in the BIOS :().
    70GB HD.
    10/100 built in ethernet (WAN)
    1000 Realtek PCI ethernet (LAN)

    I have it plugged into a gigabit WiFi AP/5 port switch.

    Here's the problem, when I try to download some file, say 50 MB, it'll download just fine. The problem is when I'm testing Squid3, it downloads maybe a maximum of 10MB/s. Shouldn't that number be closer to around 30MB/s to 80MB/s on home network grade hardware?

    The other possible issue is, I don't know if my ethernet card on my desktop is gigabit capable. I've tried Googling it with no answers. It's an nVidia MCP51. I'm using the forcedeth network drivers for my Gentoo box.



  • Regardless of your LAN speed, your WAN determines your download rate.  Depending on your Internet package, 10MB/s may be respectable.  What do you normally get when downloadng the same file from the same location?  What happens if you temporarily disable Squid and then try again with a different large file from the same location?



  • If Squid is turned off, the most I can get is about 1000KB/s on downloads. With Squid turned on and after it's been cached, I get about 10MB/s.

    To my knowledge, if Squid has cached something, it should transmit it over the local network as fast as the weakest link allows.



  • Unless you have changed the defaults, squid won't cache a file that large.  The default cache size is only 100MB to begin with, and I think the maximum object size for file caching is 4KB.



  • i have the same problem on a fresh install of pfsense with no packages installed i have my topic is at https://forum.pfsense.org/index.php?topic=79809.0 if anyone could help me please i really wanna start using this but i might not if i can only get a max of 10mb a sec from the pfsense box and i get 100mb/25 without it



  • @KOM:

    Unless you have changed the defaults, squid won't cache a file that large.  The default cache size is only 100MB to begin with, and I think the maximum object size for file caching is 4KB.

    I changed the defaults.

    Here's the current settings.

    10240MB (10GB) of HD space.
    32 level 1 directories.
    65536KB (64MB) maximum file size to cache.

    For the RAM:
    512MB of space being used for cache.
    1MB is the maximum file size to cache.



  • @Taker418:

    i have the same problem on a fresh install of pfsense with no packages installed i have my topic is at https://forum.pfsense.org/index.php?topic=79809.0 if anyone could help me please i really wanna start using this but i might not if i can only get a max of 10mb a sec from the pfsense box and i get 100mb/25 without it

    I'm not having performance issues downloading files from the Internet like you, my issue is the downloading speed from the cache.



  • What kind of AP and which port did you use. Some times these AP might be gigabit but the WAN is 10/100 which would explain the 100Mbps(10MBps).



  • I'm thinking maybe your RAM is too low.  Squid requires something like 100MB per 1GB of cache, so if you've got a 10GB cache, you need about 1GB RAM or it will start swapping.  That might be killing you right there.



  • You are using bytes/bits interchagably here and it's confusing.

    Can you go back through and give us the following:

    Your ISP speed in Mb/s - Megabits per second.

    Your NIC speed in Mb/s - Megabits per second.

    Your download speed with cache, and without cache in Megabits per second.

    Thanks!



  • Here's a pretty useful converter for bytes to bits.

    I know this seems silly, but we just need to have all of the information laid out and converted properly. Hope you understand!

    http://www.matisse.net/bitcalc/