Regarding Squid (pfSense_Lusca packages by Chudy)



  • Want to discuss here all regarding videocache by lusca

    here my squid output

    HTTP/1.0 200 OK
    Server: Lusca/LUSCA_HEAD r14499 patched by chudy r11
    Date: Thu, 08 Apr 2010 05:53:06 GMT
    Content-Type: text/plain
    Expires: Thu, 08 Apr 2010 05:53:06 GMT
    X-Cache: MISS from gateway.xxx.org.my
    Via: 1.0 gateway.xxx.org.my:3128 (Lusca/LUSCA_HEAD r14499 patched by chudy r11)
    Connection: close

    Squid Object Cache: Version LUSCA_HEAD r14499 patched by chudy r11
    Start Time:    Wed, 07 Apr 2010 14:48:23 GMT
    Current Time:  Thu, 08 Apr 2010 05:53:06 GMT
    Connection information for squid:
            Number of clients accessing cache:      0
            Number of HTTP requests received:      66906
            Number of ICP messages received:        0
            Number of ICP messages sent:    0
            Number of queued ICP replies:  0
            Request failure ratio:  0.00
            Average HTTP requests per minute since start:  74.0
            Average ICP messages per minute since start:    0.0
            Select loop called: 2655339 times, 20.443 ms avg
    Cache information for squid:
            Request Hit Ratios:    5min: 30.8%, 60min: 41.7%
            Byte Hit Ratios:        5min: -133.4%, 60min: -96.4%
            Request Memory Hit Ratios:      5min: 18.1%, 60min: 15.9%
            Request Disk Hit Ratios:        5min: 69.4%, 60min: 50.5%
            Storage Swap size:      1026576 KB
            Storage Mem size:      82776 KB
            Mean Object Size:      9.15 KB
            Requests given to unlinkd:      0
    Median Service Times (seconds)  5 min    60 min:
            HTTP Requests (All):  0.52331  0.22004
            Cache Misses:          1.05672  1.00114
            Cache Hits:            0.00286  0.00179
            Near Hits:            0.22004  0.00379
            Not-Modified Replies:  0.00179  0.00091
            DNS Lookups:          0.00000  0.00000
            ICP Queries:          0.00000  0.00000
    Resource usage for squid:
            UP Time:        54283.043 seconds
            CPU Time:      320.974 seconds
            CPU Usage:      0.59%
            CPU Usage, 5 minute avg:        2.55%
            CPU Usage, 60 minute avg:      2.12%
            Process Data Segment Size via sbrk(): 0 KB
            Maximum Resident Size: 210192 KB
            Page faults with physical i/o: 8
    Memory accounted for:
            Total accounted:      108441 KB
            memPoolAlloc calls: 12410994
            memPoolFree calls: 11753416
    File descriptor usage for squid:
            Maximum number of file descriptors:  7207
            Largest file desc currently in use:    379
            Number of file desc currently in use:  273
            Files queued for open:                  0
            Available number of file descriptors: 6934
            Reserved number of file descriptors:  100
            Store Disk files open:                  6
            IO loop method:                    kqueue
    Internal Data Structures:
            112675 StoreEntries
            20701 StoreEntries with MemObjects
            20655 Hot Object Cache Items
            112189 on-disk objects

    question 1 : why it always view it "Number of clients accessing cache: 0" ?
    question 2 : from my squid.log file. Before installing lusca_cache, youtube log was

    http://v13.lscache8.c.youtube.com/videoplayback?

    after installing lusca_cache

    http://v13.lscache8.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2Cexpire%2Cip%2Cipbits%2Citag%2Calgorithm%2Cburst%2Cfactor%2Coc%3AU0dWRVdNUl9FSkNNNl9PR1ZF&fexp=906204&algorithm=throttle-factor&itag=34&ipbits=0&burst=40&sver=3&expire=1270724400&key=yt1&signature=C7E3966A1CE37924992959454375B87C83C2AB46.A057390D20A4A26EA8E046A7FB46EF22FADB26B3&factor=1.25&id=924027d0fae57447

    is this means it cached corrrectly?



  • question 1 : why it always view it "Number of clients accessing cache: 0" ?

    because client_db off… updated changed to on
    xml reinstall(Reinstall this package's GUI components) will do if you don't want to edit /usr/local/etc/squid/include.conf

    question 2 about access.log

    because strip_query_terms off… for security reason's you can turn this on. my default is off to track down this patterns.



  • thanks..question 1..is solved…
    the question 2, what i asking is actually, how to know this videocache really works or it cached corrrectly?



  • @NeophyteHeaven:

    thanks..question 1..is solved…
    the question 2, what i asking is actually, how to know this videocache really works or it cached corrrectly?

    by the way I haven't used videocache. AFAIK videocache is using url_rewrite.
    to monitor you can tail your access log with some grep or use your broweser.
    Using Developer tools in google chrome. you can see X-Cache:HIT from pfsense at header.
    With firefox you can use firebug plugin.



  • @chudy:

    @NeophyteHeaven:

    thanks..question 1..is solved…
    the question 2, what i asking is actually, how to know this videocache really works or it cached corrrectly?

    by the way I haven't used videocache. AFAIK videocache is using url_rewrite.
    to monitor you can tail your access log with some grep or use your broweser.
    Using Developer tools in google chrome. you can see X-Cache:HIT from pfsense at header.
    With firefox you can use firebug plugin.

    sorry, maybe i got confused lusca was the video cache..i guess im wrong.. many thanks there..my squid works well with lusca



  • Hai Mr Chudy and topic moderator…
    i just want to ask,,,if my Harddrive 80GB and i using 1GB of RAM in Intel Atom Machine 1,6GHZ....
    please give me a best advice to configure my cache management in webGUI...
    i;m using your LUSCA

    give me some explanation about this :

    tail -f /var/squid/log/cache.log

    2010/04/09 07:53:27|        0 Duplicate URLs purged.
    2010/04/09 07:53:27|        0 Swapfile clashes avoided.
    2010/04/09 07:53:27|  Took 1.4 seconds (  0.7 objects/sec).
    2010/04/09 07:53:27| Beginning Validation Procedure
    2010/04/09 07:53:27|  Completed Validation Procedure
    2010/04/09 07:53:27|  Validated 1 Entries
    2010/04/09 07:53:27|  store_swap_size = 2k
    2010/04/09 07:53:28| storeLateRelease: released 0 objects
    2010/04/09 08:08:35| CACHEMGR: <unknown>@127.0.0.1 requesting 'info'
    2010/04/09 08:20:30| squidaio_queue_request: WARNING - Queue congestion</unknown>

    and this :

    squidclient mgr:info

    HTTP/1.0 200 OK
    Server: Lusca/LUSCA_HEAD r14499 patched by chudy r11
    Date: Fri, 09 Apr 2010 00:54:50 GMT
    Content-Type: text/plain
    Expires: Fri, 09 Apr 2010 00:54:50 GMT
    X-Cache: MISS from localhost
    Via: 1.0 localhost:3128 (Lusca/LUSCA_HEAD r14499 patched by chudy r11)
    Connection: close

    Squid Object Cache: Version LUSCA_HEAD r14499 patched by chudy r11
    Start Time:    Thu, 08 Apr 2010 23:53:26 GMT
    Current Time:  Fri, 09 Apr 2010 00:54:50 GMT
    Connection information for squid:
            Number of clients accessing cache:      0
            Number of HTTP requests received:      6058
            Number of ICP messages received:        0
            Number of ICP messages sent:    0
            Number of queued ICP replies:  0
            Request failure ratio:  0.00
            Average HTTP requests per minute since start:  98.7
            Average ICP messages per minute since start:    0.0
            Select loop called: 471925 times, 7.807 ms avg
    Cache information for squid:
            Request Hit Ratios:    5min: 12.2%, 60min: 11.0%
            Byte Hit Ratios:        5min: 1.5%, 60min: 23.0%
            Request Memory Hit Ratios:      5min: 28.3%, 60min: 70.5%
            Request Disk Hit Ratios:        5min: 3.8%, 60min: 12.7%
            Storage Swap size:      154334 KB
            Storage Mem size:      20300 KB
            Mean Object Size:      42.62 KB
            Requests given to unlinkd:      0
    Median Service Times (seconds)  5 min    60 min:
            HTTP Requests (All):  0.85130  1.00114
            Cache Misses:          0.94847  1.17732
            Cache Hits:            0.00379  0.00286
            Near Hits:            0.76407  0.72387
            Not-Modified Replies:  0.00379  0.00179
            DNS Lookups:          0.00000  0.00000
            ICP Queries:          0.00000  0.00000
    Resource usage for squid:
            UP Time:        3684.226 seconds
            CPU Time:      91.372 seconds
            CPU Usage:      2.48%
            CPU Usage, 5 minute avg:        2.32%
            CPU Usage, 60 minute avg:      2.52%
            Process Data Segment Size via sbrk(): 0 KB
            Maximum Resident Size: 53392 KB
            Page faults with physical i/o: 3
    Memory accounted for:
            Total accounted:        23852 KB
            memPoolAlloc calls: 1154184
            memPoolFree calls: 1063451
    File descriptor usage for squid:
            Maximum number of file descriptors:  14745
            Largest file desc currently in use:    49
            Number of file desc currently in use:  34
            Files queued for open:                  0
            Available number of file descriptors: 14711
            Reserved number of file descriptors:  100
            Store Disk files open:                  2
            IO loop method:                    kqueue
    Internal Data Structures:
              3676 StoreEntries
              3478 StoreEntries with MemObjects
              3470 Hot Object Cache Items
              3621 on-disk objects

    Thanks Mr. Chudy


Log in to reply