Help Videocahce

fauzi · Jul 2, 2010, 11:10 AM

Numbi==> Saya sudah 4x instal pfsense dan 4x configure tapi untuk cahce videonya gak bisa 2

saya sudah ikuti petunjuk di pfsense.org trus sama di johncrackernet.blogspot.com

tapi tetap saja gak bisa,,

help buat senior2 tulung tulung biar bisa di bantu

saya coba instal di Vm ware

Spec: 512 MB memory
160 Gb hardisk virtualnnya

Thk buat senior2 semua atas bantuannya…

anto_DIGIT · Jul 2, 2010, 4:00 PM

@fauzi:

Numbi==> Saya sudah 4x instal pfsense dan 4x configure tapi untuk cahce videonya gak bisa 2

saya sudah ikuti petunjuk di pfsense.org trus sama di johncrackernet.blogspot.com

tapi tetap saja gak bisa,,

help buat senior2 tulung tulung biar bisa di bantu

saya coba instal di Vm ware

Spec: 512 MB memory
160 Gb hardisk virtualnnya

Thk buat senior2 semua atas bantuannya…

Lebih baik menggunakan url_rewrite dng perl saja …
videocache skrg versi berbayar, kalau pakai versi lama, spt youtube malah error karena format url-nya ada yg berubah ...

Kalau lihat spek HW, kalau cache_dir 160GB, butuh memory paling tdk 1GB ..

kakashi · Jul 3, 2010, 5:41 AM

hooh

bener, mendingan pake lusca aja deh …
ke cache juga video2

fauzi · Jul 15, 2010, 3:07 PM

Iya saya dah pake lucsa tuningnya juga dah dimasukin
tapi tetap aja videonya gak ke capture
mungkin apakah versi video cahcenya karna bayar kali ya
jadi gak bisa ke cahce videonya karna gak register?
maaf baru buka lagi baru pulang kampung….

anto_DIGIT · Jul 16, 2010, 2:17 AM

@fauzi:

Iya saya dah pake lucsa tuningnya juga dah dimasukin
tapi tetap aja videonya gak ke capture
mungkin apakah versi video cahcenya karna bayar kali ya
jadi gak bisa ke cahce videonya karna gak register?
maaf baru buka lagi baru pulang kampung….

terang saja kalau pakai versi terbaru dan belum register tdk bisa .. itu kan bukan gratisan ..
kalau pakai versi lama yg belum berbayar, resikonya ada beberapa video yg justru error ..

cukup dng tunning lusca dan penambahan storeurl.pl seharusnya sudah bisa caching video, kalau gagal coba lihat di /var/squid/cache.log

fauzi · Jul 17, 2010, 3:35 PM

maaf mas anto cara liat di /var/squid/cache.log pake tail -f trus yang musti di perhatiin apannya…?
thk atas infonya....
semoga saya jadi bisa mengcaptur video

anto_DIGIT · Jul 18, 2010, 6:48 PM

@fauzi:

maaf mas anto cara liat di /var/squid/cache.log pake tail -f trus yang musti di perhatiin apannya…?
thk atas infonya....
semoga saya jadi bisa mengcaptur video

contoh :
tail -f /var/squid/log/cache.log
2010/07/19 01:37:04| clientCacheHit: Redirect Loop Detected: http://v8.cache3.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2Cexpire%2Cip%2Cipbits%2Citag%2Calgorithm%2Cburst%2Cfactor%2Coc%3AU0dWTlVLT19FSkNNNl9NRVND&algorithm=throttle-factor&itag=34&ipbits=0&burst=40&sver=3&expire=1279501200&key=yt1&signature=76862E2625B171040FFE05ABFAE0DF7DABF4273D.5E98D2676AF99802F357D3B5E5DFB5E6CB71C3DD&factor=1.25&id=632295b2475d26b1&redirect_counter=1

coba saja buka salah satu video youtube melalui browser, kemudian play hingga selesai …kemudian close broser, buka broser ... clear recent history : cache ...
coba akses lagi halaman tadi ... jika memang ter-hit pasti berjalan jauh lebih cepat ..

fauzi · Jul 18, 2010, 11:50 PM

saya dah liat liat storeurl.pl baca baca bolak balik tapi ya belum mudeng juga nich omm
ada link untuk step2nya yang menurut om mudah di mengerti gak?
ato bukinin cara updatenya..
info mesinnya celeron D 2,6 ghz 512mb memori hdd cahce 100gb fisik hdd 250gb trus apa ada yang perlu di tambain biar bisa wuz-wuz

fauzi · Jul 19, 2010, 4:33 AM

saya sudah tuning luscanya dabn sudah pake storeurl.pl dan setalah saya cek pake perinta

tail -f /var/squid/log/cahce.lognya kaya gini mohon penerahan maksud dari loga apa?

tail -f /var/squid/logs/cache.log

2010/07/19 04:25:31| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:25:31| /var/squid/cache/00/8B/00008B9F
2010/07/19 04:25:31| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:25:31| /var/squid/cache/00/8B/00008BCD
2010/07/19 04:25:34| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:25:34| /var/squid/cache/00/4D/00004DB0
2010/07/19 04:25:45| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:25:45| /var/squid/cache/00/12/00001236
2010/07/19 04:26:34| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:26:34| /var/squid/cache/00/0F/00000F28
2010/07/19 04:28:52| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:28:52| /var/squid/cache/00/6C/00006C81
2010/07/19 04:28:52| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:28:52| /var/squid/cache/00/14/000014E3
2010/07/19 04:28:52| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:28:52| /var/squid/cache/00/03/00000330
2010/07/19 04:29:21| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:21| /var/squid/cache/00/8B/00008BB9
2010/07/19 04:29:25| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:25| /var/squid/cache/00/13/00001371
2010/07/19 04:29:26| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:26| /var/squid/cache/00/04/00000445
2010/07/19 04:29:26| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:26| /var/squid/cache/00/13/00001380
2010/07/19 04:29:26| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:26| /var/squid/cache/00/18/0000186C
2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:27| /var/squid/cache/00/01/00000126
2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:27| /var/squid/cache/00/04/00000443
2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:27| /var/squid/cache/00/13/00001387
2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:27| /var/squid/cache/00/13/0000138D
2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:27| /var/squid/cache/00/8F/00008F13
2010/07/19 04:29:28| storeAufsOpenDone: (2) No such file or directory
2010/07/19 04:29:28| /var/squid/cache/00/04/00000472
2010/07/19 04:29:28| storeAufsOpenDone: (2) No such file or directory

fauzi · Jul 19, 2010, 4:51 AM

trus sama ini ketinggalan
terakhir ada

b7e6bc10bfd7ff69cc54ec5g.jpg'
2010/07/19 04:46:00| WARNING: unparseable HTTP header field {"4afbec9a3db7e6bc10bfd7ff69cc54ec.jpg"
}
apa nich maksudnya

thk atas infonya…

fauzi · Jul 19, 2010, 5:08 AM

oh ya lupa !
gini lo om kan katanya si youtub merubah sistem algoritmannya setiap beberapa menit
pake storeurl.pl bisa gak tuch ke cahce trus kalo bisa gimana carannya…
thk atas infonnya....

anto_DIGIT · Jul 19, 2010, 5:38 AM

@fauzi:

oh ya lupa !
gini lo om kan katanya si youtub merubah sistem algoritmannya setiap beberapa menit
pake storeurl.pl bisa gak tuch ke cahce trus kalo bisa gimana carannya…
thk atas infonnya....

memang ada yg berubah, coba deh :

_$|=1;
while (<>) {
@X = split;

$X[1] =~ s/&sig=.*//;

$x = $X[0] . " ";
$_ = $X[1];
$u = $X[1];

if ($url =~ m@^http://([^.].)?bing.[^/]/[^?]?.@i) {

# Replace any previous safe directives
$url =~ s@(adlt=[^&]*&?)@@ig;

# Add safe search directive
$url .= '&adlt=strict&cc=au';

} elsif ($url =~ m@^http://([^.].)?google.[^/]/[^?]?.@i) {

# Replace any previous safe directives
$url =~ s@(safe=[^&]*&?)@@ig;

# Add safe search directive
$url .= '&safe=active';

compatibility for old cached get_video?video_id

} elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
$z = $2; $z =~ s/video_id=/get_video?video_id=/;
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

youtube 1024p HD itag=37, 720p HD itag=22

} elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=37|itag=22).?&(id=[a-zA-Z0-9])/) {
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . "&" . $3 . "\n";

youtube Normal screen always HD itag 35, Normal screen never HD itag 34, itag=18 <–normal?

} elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=[0-9]).?&(id=[a-zA-Z0-9]*)/) {
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $3 . "\n";

} elsif (m/^http://www.google-analytics.com/__utm.gif?.*/) {
print $x . "http://www.google-analytics.com/__utm.gif\n";

} elsif (m/^http://www.gstatic.com/__utm.gif?.*/) {
print $x . "http://www.gstatic.com/__utm.gif\n";

#Cache High Latency Ads
} elsif (m/^http://([a-z0-9.])(.doubleclick.net|.quantserve.com|.googlesyndication.com|yieldmanager|cpxinteractive)(.)/) {
$y = $3;$z = $2;
for ($y) {
s/pixel;./pixel/;
s/activity;./activity/;
s/(imgad[^&])./\1/;
s/;ord=[?0-9]//;
s/;×tamp=[0-9]//;
s/[&?]correlator=[0-9]//;
s/&cookie=[^&]//;
s/&ga_hid=[^&]//;
s/&ga_vid=[^&]//;
s/&ga_sid=[^&]*//;

s/&prev_slotnames=[^&]*//

s/&u_his=[^&]*//;

s/&dt=[^&]//;
s/&dtd=[^&]//;
s/&lmt=[^&]//;
s/(&alternate_ad_url=http%3A%2F%2F[^(%2F)])[^&]/\1/;
s/(&url=http%3A%2F%2F[^(%2F)])[^&]/\1/;
s/(&ref=http%3A%2F%2F[^(%2F)])[^&]/\1/;
s/(&cookie=http%3A%2F%2F[^(%2F)])[^&]/\1/;
s/[;&?]ord=[?0-9]//;
s/[;&]mpvid=[^&;]//;
s/&xpc=[^&]//;

yieldmanager

s/?clickTag=[^&]//;
s/&u=[^&]//;
s/&slotname=[^&]//;
s/&page_slots=[^&]//;
}
print $x . "http://" . $1 . $2 . $y . "\n";

#google map
} elsif (m/kh(.?).google.com(.?)/(.?) /) {
print "http://keyhole-srv.google.com" . $2 . ".SQUIDINTERNAL/" . $3 . "\n";
# print STDERR "KEYHOLE\n";
} elsif (m/mt(.?).google.com(.?)/(.?) /) {
print "http://map-srv.google.com" . $2 . ".SQUIDINTERNAL/" . $3 . "\n";
# print STDERR "MAPSRV\n";

# indowebster added by fahmi[at]airputih.or.id

} elsif (($u =~ /indowebster/) && (m/^http://www[0-9][0-9].indowebster.com./(.?)/)) {

# print $x . "http://cdn.indowebster.com/" . $2 . "\n";

#cache high latency ads
} elsif (m/^http://(.?)/(ads)?(.?)/) {
print $x . "http://" . $1 . "/" . $2 . "\n";

spicific servers starts here….

} elsif (m/^http://(www.ziddu.com..[^/]{3,4})/(.?)/) {
print $x . "http://" . $1 . "\n";

#cdn, varialble 1st path
} elsif (($u =~ /filehippo/) && (m/^http://(.?).(.?)/(.?)/(.).([a-z0-9]{3,4})(?.*)?/)) {
@y = ($1,$2,$4,$5);
$y[0] =~ s/[a-z0-9]{2,5}/cdn./;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

#rapidshare
} elsif (($u =~ /rapidshare/) && (m/^http://(([A-Za-z]+[0-9-.]+)?)([a-z].[^/]{3}/[a-z]/[0-9])/(.*?)/([^/?&]{4,})$/)) {
print $x . "http://cdn." . $3 . "/SQUIDINTERNAL/" . $5 . "\n";

} elsif (($u =~ /maxporn/) && (m/^http://([^/]?)/(.?)/([^/]?)(?.)?$/)) {
print $x . "http://" . $1 . "/SQUIDINTERNAL/" . $3 . "\n";

#like porn hub variables url and center part of the path, filename etention 3 or 4 with or without ? at the end
} elsif (($u =~ /tube8|pornhub|xvideos/) && (m/^http://(([A-Za-z]+[0-9-.]+)?).([a-z][0-9]?.[^/]{3}/[a-z])(.?)((/[a-z])?(/[^/]){4}.[^/?]{3,4})(?.*)?$/)) {
print $x . "http://cdn." . $3 . $5 . "\n";
#…spicific servers end here.

#photos-X.ak.fbcdn.net where X a-z
} elsif (m/^http://photos-[a-z].ak.fbcdn.net/(.*)/) {
print $x . "http://photos.ak.fbcdn.net/" . $1 . "\n";

#general purpose for cdn servers. add above your specific servers.
} elsif (m/^http://([0-9.]?)//(.?).(.)?(.?)/) {
print $x . "http://squid-cdn-url//" . $2 . "." . $3 . "\n";

#for yimg.com doubled
} elsif (m/^http://(.?).yimg.com/(.?).yimg.com/(.?)?(.)/) {
print $x . "http://cdn.yimg.com/" . $3 . "\n";

#for yimg.com with &sig=
} elsif (m/^http://(.?).yimg.com/(.)/) {
@y = ($1,$2);
$y[0] =~ s/[a-z]+[0-9]+/cdn/;
$y[1] =~ s/&sig=.*//;
print $x . "http://" . $y[0] . ".yimg.com/" . $y[1] . "\n";

#generic http://variable.domain.com/path/filename."ext" or "exte" with or withour "?"
} elsif (m/^http://(.)([^.-]?..?)/(.).([^/?&]{3,4})(?.*)?$/) {
@y = ($1,$2,$3,$4);
$y[0] =~ s/(([a-zA-A-]+[0-9-]+)|(.cdn.)|(.cache.))/cdn/;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

generic http://variable.domain.com/…

} elsif (m/^http://(([A-Za-z]+[0-9-]+)?|.cdn.|.cache.).(.?).(.?)/(.)$/) {
print $x . "http://cdn." . $3 . "." . $4 . "/" . $5 . "\n";

spicific extention that ends with ?

} elsif (m/^http://(.?)/(.?).(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|on2)?(.*)/) {
print $x . "http://" . $1 . "/" . $2 . "." . $3 . "\n";

all that ends with ;

} elsif (m/^http://(.?)/(.?);(.*)/) {
print $x . "http://" . $1 . "/" . $2 . "\n";

} else {
print $x . $_ . "\n";
}
}_

onomlakbok · Jul 19, 2010, 8:30 AM

saya sudah pk LUSCA terbaru tp videocache sepertinya belum jalan

tail -f /var/squid/logs/cache.log

2010/07/18 10:51:06| Reconfiguring Squid Cache (version 2.7.STABLE9)…
2010/07/18 10:51:06| FD 17 Closing HTTP connection
2010/07/18 10:51:06| FD 18 Closing HTTP connection
2010/07/18 10:51:06| FD 19 Closing HTCP socket
2010/07/18 10:51:06| FD 20 Closing SNMP socket
2010/07/18 10:51:06| aioSync: flushing pending I/O operations
2010/07/18 10:51:06| aioSync: done
2010/07/18 10:51:06| logfileClose: closing log /dev/null
2010/07/18 10:51:06| Including Configuration File: /usr/local/etc/squid/squid.co nf (depth 0)
2010/07/18 10:51:06| Cache dir '/var/squid/cache' size remains unchanged at 3072 000 KB
mesti dgimanakan lagi om anto_DIGIT???

fauzi · Jul 19, 2010, 8:32 AM

@anto_DIGIT:

@fauzi:

oh ya lupa !
gini lo om kan katanya si youtub merubah sistem algoritmannya setiap beberapa menit
pake storeurl.pl bisa gak tuch ke cahce trus kalo bisa gimana carannya…
thk atas infonnya....

memang ada yg berubah, coba deh :

_$|=1;
while (<>) {
@X = split;

ini di co pas aja untuk menggantikan isi storeurl.plnya yach yang asli di hapus trus diganti sama yang ini..?
thk atas infonya

$X[1] =~ s/&sig=.*//;

$x = $X[0] . " ";
$_ = $X[1];
$u = $X[1];

if ($url =~ m@^http://([^.].)?bing.[^/]/[^?]?.@i) {

# Replace any previous safe directives
$url =~ s@(adlt=[^&]*&?)@@ig;

# Add safe search directive
$url .= '&adlt=strict&cc=au';

} elsif ($url =~ m@^http://([^.].)?google.[^/]/[^?]?.@i) {

# Replace any previous safe directives
$url =~ s@(safe=[^&]*&?)@@ig;

# Add safe search directive
$url .= '&safe=active';

compatibility for old cached get_video?video_id

} elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
$z = $2; $z =~ s/video_id=/get_video?video_id=/;
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

youtube 1024p HD itag=37, 720p HD itag=22

} elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=37|itag=22).?&(id=[a-zA-Z0-9])/) {
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . "&" . $3 . "\n";

youtube Normal screen always HD itag 35, Normal screen never HD itag 34, itag=18 <–normal?

} elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=[0-9]).?&(id=[a-zA-Z0-9]*)/) {
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $3 . "\n";

} elsif (m/^http://www.google-analytics.com/__utm.gif?.*/) {
print $x . "http://www.google-analytics.com/__utm.gif\n";

} elsif (m/^http://www.gstatic.com/__utm.gif?.*/) {
print $x . "http://www.gstatic.com/__utm.gif\n";

#Cache High Latency Ads
} elsif (m/^http://([a-z0-9.])(.doubleclick.net|.quantserve.com|.googlesyndication.com|yieldmanager|cpxinteractive)(.)/) {
$y = $3;$z = $2;
for ($y) {
s/pixel;./pixel/;
s/activity;./activity/;
s/(imgad[^&])./\1/;
s/;ord=[?0-9]//;
s/;×tamp=[0-9]//;
s/[&?]correlator=[0-9]//;
s/&cookie=[^&]//;
s/&ga_hid=[^&]//;
s/&ga_vid=[^&]//;
s/&ga_sid=[^&]*//;

s/&prev_slotnames=[^&]*//

s/&u_his=[^&]*//;

s/&dt=[^&]//;
s/&dtd=[^&]//;
s/&lmt=[^&]//;
s/(&alternate_ad_url=http%3A%2F%2F[^(%2F)])[^&]/\1/;
s/(&url=http%3A%2F%2F[^(%2F)])[^&]/\1/;
s/(&ref=http%3A%2F%2F[^(%2F)])[^&]/\1/;
s/(&cookie=http%3A%2F%2F[^(%2F)])[^&]/\1/;
s/[;&?]ord=[?0-9]//;
s/[;&]mpvid=[^&;]//;
s/&xpc=[^&]//;

yieldmanager

s/?clickTag=[^&]//;
s/&u=[^&]//;
s/&slotname=[^&]//;
s/&page_slots=[^&]//;
}
print $x . "http://" . $1 . $2 . $y . "\n";

#google map
} elsif (m/kh(.?).google.com(.?)/(.?) /) {
print "http://keyhole-srv.google.com" . $2 . ".SQUIDINTERNAL/" . $3 . "\n";
# print STDERR "KEYHOLE\n";
} elsif (m/mt(.?).google.com(.?)/(.?) /) {
print "http://map-srv.google.com" . $2 . ".SQUIDINTERNAL/" . $3 . "\n";
# print STDERR "MAPSRV\n";

# indowebster added by fahmi[at]airputih.or.id

} elsif (($u =~ /indowebster/) && (m/^http://www[0-9][0-9].indowebster.com./(.?)/)) {

# print $x . "http://cdn.indowebster.com/" . $2 . "\n";

#cache high latency ads
} elsif (m/^http://(.?)/(ads)?(.?)/) {
print $x . "http://" . $1 . "/" . $2 . "\n";

spicific servers starts here….

} elsif (m/^http://(www.ziddu.com..[^/]{3,4})/(.?)/) {
print $x . "http://" . $1 . "\n";

#cdn, varialble 1st path
} elsif (($u =~ /filehippo/) && (m/^http://(.?).(.?)/(.?)/(.).([a-z0-9]{3,4})(?.*)?/)) {
@y = ($1,$2,$4,$5);
$y[0] =~ s/[a-z0-9]{2,5}/cdn./;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

#rapidshare
} elsif (($u =~ /rapidshare/) && (m/^http://(([A-Za-z]+[0-9-.]+)?)([a-z].[^/]{3}/[a-z]/[0-9])/(.*?)/([^/?&]{4,})$/)) {
print $x . "http://cdn." . $3 . "/SQUIDINTERNAL/" . $5 . "\n";

} elsif (($u =~ /maxporn/) && (m/^http://([^/]?)/(.?)/([^/]?)(?.)?$/)) {
print $x . "http://" . $1 . "/SQUIDINTERNAL/" . $3 . "\n";

#like porn hub variables url and center part of the path, filename etention 3 or 4 with or without ? at the end
} elsif (($u =~ /tube8|pornhub|xvideos/) && (m/^http://(([A-Za-z]+[0-9-.]+)?).([a-z][0-9]?.[^/]{3}/[a-z])(.?)((/[a-z])?(/[^/]){4}.[^/?]{3,4})(?.*)?$/)) {
print $x . "http://cdn." . $3 . $5 . "\n";
#…spicific servers end here.

#photos-X.ak.fbcdn.net where X a-z
} elsif (m/^http://photos-[a-z].ak.fbcdn.net/(.*)/) {
print $x . "http://photos.ak.fbcdn.net/" . $1 . "\n";

#general purpose for cdn servers. add above your specific servers.
} elsif (m/^http://([0-9.]?)//(.?).(.)?(.?)/) {
print $x . "http://squid-cdn-url//" . $2 . "." . $3 . "\n";

#for yimg.com doubled
} elsif (m/^http://(.?).yimg.com/(.?).yimg.com/(.?)?(.)/) {
print $x . "http://cdn.yimg.com/" . $3 . "\n";

#for yimg.com with &sig=
} elsif (m/^http://(.?).yimg.com/(.)/) {
@y = ($1,$2);
$y[0] =~ s/[a-z]+[0-9]+/cdn/;
$y[1] =~ s/&sig=.*//;
print $x . "http://" . $y[0] . ".yimg.com/" . $y[1] . "\n";

#generic http://variable.domain.com/path/filename."ext" or "exte" with or withour "?"
} elsif (m/^http://(.)([^.-]?..?)/(.).([^/?&]{3,4})(?.*)?$/) {
@y = ($1,$2,$3,$4);
$y[0] =~ s/(([a-zA-A-]+[0-9-]+)|(.cdn.)|(.cache.))/cdn/;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

generic http://variable.domain.com/…

} elsif (m/^http://(([A-Za-z]+[0-9-]+)?|.cdn.|.cache.).(.?).(.?)/(.)$/) {
print $x . "http://cdn." . $3 . "." . $4 . "/" . $5 . "\n";

spicific extention that ends with ?

} elsif (m/^http://(.?)/(.?).(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|on2)?(.*)/) {
print $x . "http://" . $1 . "/" . $2 . "." . $3 . "\n";

all that ends with ;

} elsif (m/^http://(.?)/(.?);(.*)/) {
print $x . "http://" . $1 . "/" . $2 . "\n";

} else {
print $x . $_ . "\n";
}
}_

fauzi · Jul 19, 2010, 8:34 AM

yang ini di pake untuk menggantikan isi file storeurl.pl yach mas direplae gitu ?

thk atas infonya

anto_DIGIT · Jul 19, 2010, 9:06 AM

@fauzi:

yang ini di pake untuk menggantikan isi file storeurl.pl yach mas direplae gitu ?

thk atas infonya

betul

fauzi · Jul 19, 2010, 11:01 AM

saya dah masukan isi nya..

tapi malah loading squidnnya kaga jalan jalan xixixix

instal ulang lagi dulu dah… ingung nyariinya....

fauzi · Jul 19, 2010, 1:58 PM

Instal ulang sudah di laksanakan ….
dan caceing sudah berjalan untuk proxynya lancar dan maknyus keliatannya sangat cepat / agresif geto....

wus wus mantab

dan untuk storeurl.plnya sudah muncul ready to serve requests

sekarang lagi coba buka web youtube dan dapat dipastikan cachingnya berjalan

sebab sudah muncul dengan perintah tail -f /var/squid/log/cahe.log

2010/07/19 13:55:16| storeAufsOpenDone: (2) No such file or directory
2010/07/19 13:55:16| /var/squid/cache/00/81/00008159

terima kasih banyak om anto_DIGIT atas info - infonya yang di replay sangat cepat sekali

secepat lusca WUZ WUZ ;D

sekali lagi maturnuwun sebanyak banyaknya kuadrat, ixixixixixixixix....

fauzi · Jul 19, 2010, 2:43 PM

om saya sudah test youtube putar sampe selesai trus saca clear cahce tapi pas play proxy hit di mikrotiknya gak kelihatan jalan malah dia pake bandwith internaional lagi dah saya ulang2 tapi sama juga tetap gak ngambil dari cahcenya malah ambil dari youtub lagi…

trus isi tunin.confnya kek gini betul apa gak atau ada yang perlu ditambain
solannya saya saya instalnya atu atu...

vi /usr/local/etc/squid/tunning.conf

acl store_rewrite_list urlpath_regex /(get_video|videoplayback?id|videoplayback.id) .(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|fl
v|wmv|3gp|mp(4|3)|exe|msi|zip|on2|mar)(=|?|;&)+
acl store_rewrite_list_domain url_regex ^http://([A-Za-z-]+[0-9]+).[A-Za-z].[A-Za-z]
acl store_rewrite_list_domain url_regex (([a-z]{1,2}[0-9]{1,3})|([0-9]{1,3}[a-z]{1,2})).[a-z][0-9]?.[a-z]{3}
acl store_rewrite_list_path urlpath_regex .(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|avc|zip|mp3|3gp|rar|on2|mar)$
acl store_rewrite_list_domain_CDN url_regex ^http://[a-z]+[0-9].google.co(m|.uk) .rapidshare.com./[0-9]/./[^/]*
^http://(www.ziddu.com..[^/]{3,4})/(.) .doubleclick.net.ord= ^http://[.a-z0-9].photobucket.com.*.[a-z]{3}$

acl rapidurl url_regex .rapidshare.com./[0-9]/[0-9]/[^/]
acl video urlpath_regex .((mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|qt|wmv|m\dv|rv|vob|asx|ogm|flv|3gp)(?.)?)$ (get_video?|vid
eoplayback?|videodownload?|.flv(?.)?)
acl html url_regex .((html|htm|php|js|css|aspx)(?.)?)$ .com/$ .com$
acl images urlpath_regex .((jp(e?g|e|2)|gif|png|tiff?|bmp|ico)(?.)?)$
acl dontrewrite url_regex [a-z0-9]{3}.photobucket.com redbot.org

acl store_rewrite_list urlpath_regex /(get_video|videoplayback?id|videoplayback.id) .(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|fl
v|wmv|3gp|mp(4|3)|exe|msi|zip|on2|mar)(=|?|;&)+
acl store_rewrite_list_domain url_regex ^http://([A-Za-z-]+[0-9]+).[A-Za-z].[A-Za-z]
acl store_rewrite_list_domain url_regex (([a-z]{1,2}[0-9]{1,3})|([0-9]{1,3}[a-z]{1,2})).[a-z][0-9]?.[a-z]{3}
acl store_rewrite_list_path urlpath_regex .(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|avc|zip|mp3|3gp|rar|on2|mar)$
acl store_rewrite_list_domain_CDN url_regex ^http://[a-z]+[0-9].google.co(m|.uk) .rapidshare.com./[0-9]/./[^/]*
^http://(www.ziddu.com..[^/]{3,4})/(.) .doubleclick.net.ord= ^http://[.a-z0-9].photobucket.com.*.[a-z]{3}$

acl rapidurl url_regex .rapidshare.com./[0-9]/[0-9]/[^/]
acl video urlpath_regex .((mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|qt|wmv|m\dv|rv|vob|asx|ogm|flv|3gp)(?.)?)$ (get_video?|vid
eoplayback?|videodownload?|.flv(?.)?)
acl html url_regex .((html|htm|php|js|css|aspx)(?.)?)$ .com/$ .com$
acl images urlpath_regex .((jp(e?g|e|2)|gif|png|tiff?|bmp|ico)(?.)?)$
acl dontrewrite url_regex [a-z0-9]{3}.photobucket.com redbot.org
#acl reload req_header Cache-Control max-age=0
#header_access Cache-Control deny reload

storeurl_access deny dontrewrite
storeurl_access allow store_rewrite_list_domain_CDN
storeurl_access allow store_rewrite_list
storeurl_access allow store_rewrite_list_domain store_rewrite_list_path
storeurl_access deny all
storeurl_rewrite_program /usr/local/etc/squid/storeurl.pl
storeurl_rewrite_children 4
storeurl_rewrite_concurrency 99

1 year = 525600 mins, 1 month = 43800 mins

refresh_pattern windowsupdate.com/..(cab|exe) 40320 100% 43200 reload-into-ims
refresh_pattern update.microsoft.com/..(cab|exe) 40320 100% 43200 reload-into-ims
refresh_pattern download.microsoft.com/.*.(cab|exe) 40320 100% 43200 reload-into-ims

#partial flv content may only poisoned the cache
#refresh_pattern porn..flv 5259487 90% 5259487 override-expire override-lastmod max-stale=5259487
refresh_pattern imeem..flv 0 0% 0
refresh_pattern ^ftp: 40320 20% 40320 override-expire reload-into-ims
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern .rapidshare./[0-9]/./[^/] 161280 90% 161280 ignore-reload
refresh_pattern (get_video?|videoplayback?|videodownload?|.flv?) 5259487 99999999% 5259487 override-expire ignore-reload
refresh_pattern .(ico|video-stats) 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache ignore-private i
gnore-auth override-lastmod negative-ttl=10080
refresh_pattern .etology? 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache
refresh_pattern galleries.video(?|sz) 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache
refresh_pattern brazzers? 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache
refresh_pattern .adtology? 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache
refresh_pattern ^.(utm.gif|ads?|advertising.com|ad.yieldmanager.com|doubleclick.net|adserving.cpxinteractive.com) 525
9487 999999% 5259487 ignore-no-cache ignore-private override-expire override-lastmod ignore-reload ignore-auth
refresh_pattern ^.safebrowsing.clients.clients.com/safebrowsing 5259487 999999% 5259487 override-expire ignore-reload ig
nore-no-cache ignore-private ignore-auth negative-ttl=10080
refresh_pattern ^http://((cbk|mt|khm)[0-9]?).google.co(m|.uk) 5259487 999999% 5259487 override-expire ignore-reload
refresh_pattern ytimg.com..jpg 5259487 999999% 5259487 override-expire ignore-reload
refresh_pattern (avgate|avira).(idx|gz)$ 5259487 999999% 5259487 ignore-no-cache reload
-into-ims
refresh_pattern kaspersky..avc$ 5259487 999999% 5259487 ignore-reload
refresh_pattern kaspersky 1440 50% 161280 ignore-no-cache
refresh_pattern images.friendster.com..(png|gif) 5259487 999999% 5259487 override-expire ignore-reload
refresh_pattern facebook.com..(png|gif) 5259487 999999% 5259487 override-expire ignore-reload
refresh_pattern garena.com 5259487 999999% 5259487 override-expire reload-into-ims
refresh_pattern photobucket..(jp(e?g|e|2)|tiff?|bmp|gif|png) 5259487 999999% 5259487 override-expire ignore-reload
refresh_pattern vid.akm.dailymotion.com..on2? 5259487 999999% 5259487 ignore-no-cache override-expire override-lastmod
refresh_pattern profile.ak.fbcdn.net..jpg 40320 20% 40320 ignore-reload

refresh_pattern -i .(ico|js)$ 5259487 999999% 5259487 ignore-reload override-expire override-lastmod
refresh_pattern -i .(mov|mpg|mpeg|flv|avi|mp3|3gp|sis|wma) 5259487 999999% 5259487 reload-into-ims override-lastmod
refresh_pattern -i .(zip|rar|ace|bz|bz2|tar|gz|exe) 5259487 999999% 5259487 reload-into-ims override-lastmod
refresh_pattern -i (.*html$|.*htm|.*shtml|.*aspx|.*asp) 5259487 999999% 5259487 reload-into-ims override-lastmod
refresh_pattern -i .(class|css|js|gif|jpg)$ 5259487 999999% 5259487 override-expire override-lastmod
refresh_pattern -i .(jpe|jpeg|png|bmp|tif)$ 5259487 999999% 5259487 override-expire override-lastmod
refresh_pattern -i .(tiff|mov|avi|qt|mpeg)$ 5259487 999999% 5259487 override-expire override-lastmod
refresh_pattern -i .(mpg|mpe|wav|au|mid)$ 5259487 999999% 5259487 override-expire override-lastmod
refresh_pattern -i .(zip|gz|arj|lha|lzh)$ 5259487 999999% 5259487 override-expire override-lastmod
refresh_pattern -i .(rar|tgz|tar|exe|bin)$ 5259487 999999% 5259487 override-expire override-lastmod
refresh_pattern -i .(hqx|pdf|rtf|doc|swf)$ 5259487 999999% 5259487 override-expire override-lastmod
refresh_pattern -i .(inc|cab|ad|txt|dll)$ 5259487 999999% 5259487 override-expire override-lastmod

refresh_pattern .(jp(e?g|e|2)|tiff?|bmp|gif|png) 5259487 999999% 525948
7 reload-into-ims override-expire
refresh_pattern .(z(ip|[0-9]{2})|r(ar|[0-9]{2})|jar|bz2|gz|tar|rpm|vpu) 5259487 999999% 5259487 override-expir
e reload-into-ims
refresh_pattern .(mp3|wav|og(g|a)|flac|midi?|rm|aac|wma|mka|ape) 5259487 999999% 5259487 override-expire reload
-into-ims ignore-reload
refresh_pattern .(exe|msi|dmg|bin|xpi|iso|swf|mar|psf|cab) 5259487 999999% 5259487 override-expire reload
-into-ims
refresh_pattern .(mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|wmv|m\dv|rv|vob|asx|ogm|flv|3gp|on2) 5259487 9999999% 5259487 override
-expire reload-into-ims
refresh_pattern -i (cgi-bin) 0 0% 0
refresh_pattern .(php|jsp|cgi|asx)? 0 0% 0
refresh_pattern .(php|jsp) 0 0% 0
refresh_pattern . 0 50% 161280

error_directory /usr/local/etc/squid/errors/English
icon_directory /usr/local/etc/squid/icons
half_closed_clients off
dns_timeout 1 minutes
check_hostnames off
dns_testnames 127.0.0.1
negative_ttl 0 seconds
positive_dns_ttl 12 hours
negative_dns_ttl 1 minutes
ipcache_size 8192
ipcache_low 98
ipcache_high 99
fqdncache_size 8192
quick_abort_min 0
quick_abort_max 0
quick_abort_pct 98
memory_pools off
memory_pools_limit 0
forwarded_for off
cachemgr_passwd none all
reload_into_ims on
pipeline_prefetch on
strip_query_terms off
client_db off
maximum_single_addr_tries 5
retry_on_error off
#retry_on_error on
ie_refresh off
#ie_refresh on
max_filedescriptors 8192
zero_buffers on
logfile_rotate 1
unique_hostname proxy.pfsense
range_offset_limit 0
vary_ignore_expire on
zero_buffers on
windows_ipaddrchangemonitor on

###tunning hanya untuk lusca
n_aiops_threads 16
download_fastest_client_speed on

anto_DIGIT · Apr 26, 2014, 3:44 AM

Lakukan ini saja …

<admin edit:="" removed="" harmful="" instructions="">nanti otomatis membuat file include.conf dll ..
Tinggal tambahkan jika ada squid zph .., misal
zph_mode tos
zph_local 0x30
zph_parent 0
zph_option 136

mikrotiknya difungsikan buat apa ?</admin>