[SHARE] CACHING FILE MOVIE,AUDIO ETC, FROM INDOWEBSTER

grage95

bagi yang menggunakan fasiltias
storeurl_rewrite_program /usr/local/etc/squid/storeurl.pl
update dengan yang support spesifik domain indowebster.com

cd /usr/local/etc/squid/
fetch http://squid-proxy-pkg.googlecode.com/files/storeurl.pl
chmod +x storeurl.pl

dan tambahkan di acl nya atau edit dalam file include /usr/local/etc/squid/include.conf

acl store_rewrite_list_domain_CDN url_regex ^http://.www[0-9][0-9].indowebster.com/(.*)(rar|zip|flv|wm(a|v)|3gp|mp(4|3)|exe|msi|avi|(mp(e?g|a|e|1|2|3|4)|cab|exe)

–-dst

dan pada bagian refresh_pattern

refresh_pattern ^http://.www[0-9][0-9].indowebster.com/(.*)(mp3|rar|zip|flv|wmv|3gp|mp(4|3)|exe|msi|zip) 43200 99999% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache

hasil download sebelumnya miss dan di coba lagi hasilnya hit

1260696782.673 146782 192.168.56.1 TCP_MISS/200 4208867 GET x - DIRECT/119.110.77.120 audio/mpeg
1260696866.131 1271 192.168.56.1 TCP_HIT/200 4208878 GET x - NONE/- audio/mpeg

config lengkap :
http://squid-proxy-pkg.googlecode.com/files/tunning-update.conf

dan edit squid.inc
tambahkan include /usr/local/etc/squid/tunning-update.conf
setelah
acl dynamic urlpath_regex cgi-bin ?

jadinya nanti di squid.inc

acl dynamic urlpath_regex cgi-bin ?
include /usr/local/etc/squid/include-update.conf

EOD;

dan segera update lusca dengan binary file ini :
http://squid-proxy-pkg.googlecode.com/files/pfsense-lusca-head-r14281_3.tbz

info :
pfsense-lusca-head-r14281_3
support for
1. refresh_pattern = store-stale (agressiv cache), ignore-must-revalidate, ignore-no-store, reload-into-ims, ignore-reload override-expire, override-lastmod, ignore-no-cache, ignore-private, ignore-auth
2. patch loop detected
3. fix bug http://bugs.squid-cache.org/show_bug.cgi?id=2678
4. fix bug http://bugs.squid-cache.org/show_bug.cgi?id=2451

untuk store-stale (agressif cache) tambahkan di semua refresh pattern, dijamin agressiv

gateway-xxx# squid -v
Squid Cache: Version LUSCA_HEAD
configure options: '–bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/usr/local/squid' '--sysconfdir=/usr/local/etc/squid' '--enable-removal-policies=heap' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-epoll' '--with-pthreads' '--enable-storeio=aufs coss' '--enable-delay-pools' '--enable-snmp' '--disable-carp' '--disable-wccp' '--disable-ident-lookups' '--enable-arp-acl' '--enable-pf-transparent' '--with-large-files' '--enable-large-cache-files' '--enable-err-languages=English' '--enable-default-err-language=English' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=i386-portbld-freebsd7.2' 'build_alias=i386-portbld-freebsd7.2' 'CC=cc' 'CFLAGS=-O2 -pipe -funroll-loops -ffast-math -fno-strict-aliasing' 'LDFLAGS=' 'CPPFLAGS='

yellowhat89

two thumbs up!

kweteng

saya udah coba bos!!! mak nyos!!!

l0k1

ada yg error g waktu nyoba aclnya, krn di punyaku errornya spt ini:

aclParseRegexList: Invalid regular expression '^http://.www[0-9][0-9].indowebster.com/(.*)(rar|zip|flv|wm(a|v|3gp|mp(4|3)|exe|msi|avi|(mp(e?g|a|e|1|2|3|4)|cab|exe)': Invalid regular expression

grage95

itu kurang ) boss

sebelumnya :
^http://.www[0-9][0-9].indowebster.com/(.*)(rar|zip|flv|wm(a|v|3gp|mp(4|3)|exe|msi|avi|(mp(e?g|a|e|1|2|3|4)|cab|exe)

menjadi :
^http://.www[0-9][0-9].indowebster.com/(.*)(rar|zip|flv|wm(a|v)|3gp|mp(4|3)|exe|msi|avi|(mp(e?g|a|e|1|2|3|4)|cab|exe)

untuk yang belum solve, download kembali http://squid-proxy-pkg.googlecode.com/files/tunning-update.conf

dan segera update lusca dengan binary file ini :
http://squid-proxy-pkg.googlecode.com/files/pfsense-lusca-head-r14281_3.tbz

info :
pfsense-lusca-head-r14281_3
support for
1. refresh_pattern = store-stale (agressiv cache), ignore-must-revalidate, ignore-no-store, reload-into-ims, ignore-reload override-expire, override-lastmod, ignore-no-cache, ignore-private, ignore-auth
2. patch loop detected
3. fix bug http://bugs.squid-cache.org/show_bug.cgi?id=2678
4. fix bug http://bugs.squid-cache.org/show_bug.cgi?id=2451

untuk store-stale (agressif cache) tambahkan di semua refresh_pattern, dijamin agressiv

gateway-xxx# squid -v
Squid Cache: Version LUSCA_HEAD
configure options: '–bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/usr/local/squid' '--sysconfdir=/usr/local/etc/squid' '--enable-removal-policies=heap' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-epoll' '--with-pthreads' '--enable-storeio=aufs coss' '--enable-delay-pools' '--enable-snmp' '--disable-carp' '--disable-wccp' '--disable-ident-lookups' '--enable-arp-acl' '--enable-pf-transparent' '--with-large-files' '--enable-large-cache-files' '--enable-err-languages=English' '--enable-default-err-language=English' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=i386-portbld-freebsd7.2' 'build_alias=i386-portbld-freebsd7.2' 'CC=cc' 'CFLAGS=-O2 -pipe -funroll-loops -ffast-math -fno-strict-aliasing' 'LDFLAGS=' 'CPPFLAGS='

nb: sebaiknya hati2, gunakan extention file2 tertentu saja misal mp3 saja biar irit space. atau kurangi besarnya menit waktu dalam option refresh_pattern agar cache cepat di delete setelah lama di simpan, space hardisk cepet penuh, isinya file cache indowebster dan video hiks hiks

kweteng

tail -f /var/squid/log/cache.log

2009/12/19 05:40:40| httpReadReply: FD 23: skipping 1xx response!
2009/12/19 05:40:40| httpReadReply: FD 23: skipping 1xx response!
2009/12/19 05:59:54| ctx: enter level 0: 'http://images.singleboutiquedotcom.multiply.com/image/2/photos/3/500x500/105/sHirLey.jpg?et=FfQDMkmKU1u9kN6c2h4L8A&nmid=43433881'
2009/12/19 05:59:54| WARNING: Unparseable content-length ''
2009/12/19 06:39:36| ctx: exit level 0
2009/12/19 06:39:36| httpReadReply: Unexpected reply body data from "GET http://www4.shoutmix.com/script_basic.php?name=4drian&id=cb7e2e40c4878b236e875b18cb08f7f4"
2009/12/19 07:57:41| squidaio_queue_request: WARNING - Queue congestion
2009/12/19 09:58:42| httpReadReply: Unexpected reply body data from "GET http://webcs.msg.yahoo.com/crossdomain.xml"
2009/12/19 10:25:00| httpReadReply: Unexpected reply body data from "GET http://webcs.msg.yahoo.com/crossdomain.xml"
2009/12/19 10:39:44| httpAccept: FD 16: accept failure: (53) Software caused connection abort

bos itu kenapa? apa dari walled gardennya mikritik ya?
lalu untuk queue congestionnya juga gimana?

grage95

2009/12/19 05:59:54| ctx: enter level 0: 'http://images.singleboutiquedotcom.multiply.com/image/2/photos/3/500x500/105/sHirLey.jpg?et=FfQDMkmKU1u9kN6c2h4L8A&nmid=43433881'
2009/12/19 05:59:54| WARNING: Unparseable content-length ''
2009/12/19 06:39:36| ctx: exit level 0

squid tidak bisa memparse nama file di belakang ekstension tertentu yang panjang jadinya HTTP/1.0 responses error, biasanya error ketika memparse file gambar. biarkan saja selama brosing tetep nyaman, atau kalau mau errornya tidak di tampilkan ganti relaxed_header_parser off
httpReadReply: Unexpected reply body data from "GET http://webcs.msg.yahoo.com/crossdomain.xml"
cuekin saja, ini karena file di origin servernya

squidaio_queue_request: WARNING - Queue congestion
banyak kemungkinan,
-bottleneck di hardisk, tambahkan hardisk dan memory
-bottelneck di bandwith, atur kembali bandwith managernya

kweteng

wah cepet amir balesnya!!! makasih ya bos, browsing masih nyaman ko mas.!
untuk bandwidth managementnya saya pakai mikrotik mas.
topologi saya
inet - - - pfsense - - - mikritik - - - - client
di mikrotik tidak di nat, di pfsense dikasih static routing.
tapi zph masih terlimit oleng miekrotings ???!!!
jadi bandwidth managemennya gimana gitu mas.

grage95

hasil trap squidstats salah satu warnet dengan 11 client , di upgrade squid nya dengan lusca dan config diatas, baru jalan 3 hari

HIT Ration 1 day

Cache Size Ratio 1 day

kweteng

agan sekalian, saya dapat log

pftpx[429]: #281 proxy cannot connect to server 10.10.10.1: Connection refused
Dec 20 13:53:18 pftpx[429]: #281 proxy cannot connect to server 10.10.10.1: Connection refused
Dec 20 13:53:48 pftpx[429]: #282 proxy cannot connect to server 10.10.10.1: Connection refused
Dec 20 13:53:48 pftpx[429]: #282 proxy cannot connect to server 10.10.10.1: Connection refused

kira2 ftpnya kenapa ya

yellowhat89

sekedar info, bagi yang doyan main poker mungkin store.pl nya itu jadi masalah, coz profil di bawah yang menunjukkan "friend" pemain akan terbuka profile orang lain.

grage95

coba refresh pattern zynga di buat 0 0% 0