[SHARE] CACHING FILE MOVIE,AUDIO ETC, FROM INDOWEBSTER



  • bagi yang menggunakan fasiltias
    storeurl_rewrite_program /usr/local/etc/squid/storeurl.pl
    update dengan yang support spesifik domain indowebster.com

    cd /usr/local/etc/squid/
    fetch http://squid-proxy-pkg.googlecode.com/files/storeurl.pl
    chmod +x storeurl.pl

    dan tambahkan di acl nya atau edit dalam file include /usr/local/etc/squid/include.conf

    acl store_rewrite_list_domain_CDN url_regex    ^http://.www[0-9][0-9].indowebster.com/(.*)(rar|zip|flv|wm(a|v)|3gp|mp(4|3)|exe|msi|avi|(mp(e?g|a|e|1|2|3|4)|cab|exe)

    –-dst

    dan pada bagian refresh_pattern

    refresh_pattern ^http://.www[0-9][0-9].indowebster.com/(.*)(mp3|rar|zip|flv|wmv|3gp|mp(4|3)|exe|msi|zip) 43200 99999% 129600 reload-into-ims  ignore-reload override-expire ignore-no-cache

    hasil download sebelumnya miss dan di coba lagi hasilnya hit

    1260696782.673 146782 192.168.56.1 TCP_MISS/200 4208867 GET x - DIRECT/119.110.77.120 audio/mpeg
    1260696866.131  1271 192.168.56.1 TCP_HIT/200 4208878 GET x - NONE/- audio/mpeg

    config lengkap :
    http://squid-proxy-pkg.googlecode.com/files/tunning-update.conf

    dan edit  squid.inc
    tambahkan include /usr/local/etc/squid/tunning-update.conf
    setelah 
    acl dynamic urlpath_regex cgi-bin ?

    jadinya nanti di squid.inc

    acl dynamic urlpath_regex cgi-bin ?
    include /usr/local/etc/squid/include-update.conf

    EOD;

    dan segera update lusca dengan binary file ini :
    http://squid-proxy-pkg.googlecode.com/files/pfsense-lusca-head-r14281_3.tbz

    info :
    pfsense-lusca-head-r14281_3
    support for
    1. refresh_pattern = store-stale (agressiv cache),  ignore-must-revalidate, ignore-no-store, reload-into-ims,  ignore-reload override-expire, override-lastmod, ignore-no-cache, ignore-private,  ignore-auth
    2. patch loop detected
    3. fix bug  http://bugs.squid-cache.org/show_bug.cgi?id=2678
    4. fix bug http://bugs.squid-cache.org/show_bug.cgi?id=2451

    untuk store-stale (agressif cache) tambahkan di semua refresh pattern, dijamin  agressiv

    gateway-xxx# squid -v
    Squid Cache: Version LUSCA_HEAD
    configure options:  '–bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/usr/local/squid' '--sysconfdir=/usr/local/etc/squid' '--enable-removal-policies=heap' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-epoll' '--with-pthreads' '--enable-storeio=aufs coss' '--enable-delay-pools' '--enable-snmp' '--disable-carp' '--disable-wccp' '--disable-ident-lookups' '--enable-arp-acl' '--enable-pf-transparent' '--with-large-files' '--enable-large-cache-files' '--enable-err-languages=English' '--enable-default-err-language=English' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=i386-portbld-freebsd7.2' 'build_alias=i386-portbld-freebsd7.2' 'CC=cc' 'CFLAGS=-O2 -pipe -funroll-loops -ffast-math  -fno-strict-aliasing' 'LDFLAGS=' 'CPPFLAGS='



  • two thumbs up!



  • saya udah coba bos!!! mak nyos!!!



  • ada yg error g waktu nyoba aclnya, krn di punyaku errornya spt ini:

    aclParseRegexList: Invalid regular expression '^http://.www[0-9][0-9].indowebster.com/(.*)(rar|zip|flv|wm(a|v|3gp|mp(4|3)|exe|msi|avi|(mp(e?g|a|e|1|2|3|4)|cab|exe)': Invalid regular expression



  • itu kurang )  boss

    sebelumnya :
    ^http://.www[0-9][0-9].indowebster.com/(.*)(rar|zip|flv|wm(a|v|3gp|mp(4|3)|exe|msi|avi|(mp(e?g|a|e|1|2|3|4)|cab|exe)

    menjadi :
    ^http://.www[0-9][0-9].indowebster.com/(.*)(rar|zip|flv|wm(a|v)|3gp|mp(4|3)|exe|msi|avi|(mp(e?g|a|e|1|2|3|4)|cab|exe)

    untuk yang belum solve, download kembali http://squid-proxy-pkg.googlecode.com/files/tunning-update.conf

    dan segera update lusca dengan binary file ini :
    http://squid-proxy-pkg.googlecode.com/files/pfsense-lusca-head-r14281_3.tbz

    info :
    pfsense-lusca-head-r14281_3
    support for
    1. refresh_pattern = store-stale (agressiv cache),  ignore-must-revalidate, ignore-no-store, reload-into-ims,  ignore-reload override-expire, override-lastmod, ignore-no-cache, ignore-private,  ignore-auth
    2. patch loop detected
    3. fix bug  http://bugs.squid-cache.org/show_bug.cgi?id=2678
    4. fix bug http://bugs.squid-cache.org/show_bug.cgi?id=2451

    untuk store-stale (agressif cache) tambahkan di semua refresh_pattern, dijamin  agressiv

    gateway-xxx# squid -v
    Squid Cache: Version LUSCA_HEAD
    configure options:  '–bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/usr/local/squid' '--sysconfdir=/usr/local/etc/squid' '--enable-removal-policies=heap' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-epoll' '--with-pthreads' '--enable-storeio=aufs coss' '--enable-delay-pools' '--enable-snmp' '--disable-carp' '--disable-wccp' '--disable-ident-lookups' '--enable-arp-acl' '--enable-pf-transparent' '--with-large-files' '--enable-large-cache-files' '--enable-err-languages=English' '--enable-default-err-language=English' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=i386-portbld-freebsd7.2' 'build_alias=i386-portbld-freebsd7.2' 'CC=cc' 'CFLAGS=-O2 -pipe -funroll-loops -ffast-math  -fno-strict-aliasing' 'LDFLAGS=' 'CPPFLAGS='

    nb: sebaiknya hati2, gunakan extention file2 tertentu saja misal mp3 saja biar irit space. atau kurangi besarnya menit waktu dalam option refresh_pattern agar cache cepat di delete setelah lama di simpan, space hardisk cepet penuh, isinya file cache indowebster dan video hiks hiks



  • tail -f /var/squid/log/cache.log

    2009/12/19 05:40:40| httpReadReply: FD 23: skipping 1xx response!
    2009/12/19 05:40:40| httpReadReply: FD 23: skipping 1xx response!
    2009/12/19 05:59:54| ctx: enter level  0: 'http://images.singleboutiquedotcom.multiply.com/image/2/photos/3/500x500/105/sHirLey.jpg?et=FfQDMkmKU1u9kN6c2h4L8A&nmid=43433881'
    2009/12/19 05:59:54| WARNING: Unparseable content-length ''
    2009/12/19 06:39:36| ctx: exit level  0
    2009/12/19 06:39:36| httpReadReply: Unexpected reply body data from "GET http://www4.shoutmix.com/script_basic.php?name=4drian&id=cb7e2e40c4878b236e875b18cb08f7f4"
    2009/12/19 07:57:41| squidaio_queue_request: WARNING - Queue congestion
    2009/12/19 09:58:42| httpReadReply: Unexpected reply body data from "GET http://webcs.msg.yahoo.com/crossdomain.xml"
    2009/12/19 10:25:00| httpReadReply: Unexpected reply body data from "GET http://webcs.msg.yahoo.com/crossdomain.xml"
    2009/12/19 10:39:44| httpAccept: FD 16: accept failure: (53) Software caused connection abort

    bos itu kenapa? apa dari walled gardennya mikritik ya?
    lalu untuk queue congestionnya juga gimana?



  • 2009/12/19 05:59:54| ctx: enter level  0: 'http://images.singleboutiquedotcom.multiply.com/image/2/photos/3/500x500/105/sHirLey.jpg?et=FfQDMkmKU1u9kN6c2h4L8A&nmid=43433881'
    2009/12/19 05:59:54| WARNING: Unparseable content-length ''
    2009/12/19 06:39:36| ctx: exit level  0

    squid tidak bisa memparse nama file di belakang ekstension tertentu yang panjang jadinya HTTP/1.0 responses error, biasanya error ketika memparse file gambar. biarkan saja selama brosing tetep nyaman, atau kalau mau errornya tidak di tampilkan ganti relaxed_header_parser off
    httpReadReply: Unexpected reply body data from "GET http://webcs.msg.yahoo.com/crossdomain.xml"
    cuekin saja, ini karena file di origin servernya

    squidaio_queue_request: WARNING - Queue congestion
    banyak kemungkinan,
    -bottleneck di hardisk, tambahkan hardisk dan memory
    -bottelneck di bandwith, atur kembali bandwith managernya



  • wah cepet amir balesnya!!! makasih ya bos, browsing masih nyaman ko mas.!
    untuk bandwidth managementnya saya pakai mikrotik mas.
    topologi saya
    inet - - - pfsense - - - mikritik - - - - client
    di mikrotik tidak di nat, di pfsense dikasih static routing.
    tapi zph masih terlimit oleng miekrotings ???!!!
    jadi bandwidth managemennya gimana gitu mas.



  • hasil trap squidstats salah satu warnet dengan 11 client , di upgrade squid nya dengan lusca dan  config diatas, baru jalan 3 hari

    HIT Ration 1 day

    Cache Size Ratio 1 day



  • agan sekalian, saya dapat log

    pftpx[429]: #281 proxy cannot connect to server 10.10.10.1: Connection refused
    Dec 20 13:53:18 pftpx[429]: #281 proxy cannot connect to server 10.10.10.1: Connection refused
    Dec 20 13:53:48 pftpx[429]: #282 proxy cannot connect to server 10.10.10.1: Connection refused
    Dec 20 13:53:48 pftpx[429]: #282 proxy cannot connect to server 10.10.10.1: Connection refused

    kira2 ftpnya kenapa ya



  • sekedar info, bagi yang doyan main poker mungkin store.pl nya itu jadi masalah, coz profil di bawah yang menunjukkan "friend" pemain akan terbuka profile orang lain.



  • coba refresh pattern zynga di buat 0 0% 0


Log in to reply