Ada yang tahu Cara membuat Yotube lebih kencang di Pfsense .. share disini

kambeeng · Sep 5, 2009, 3:11 PM

Silahkan bro.. untuk kemajuan pfindonesa (itu nama group kita)

yellowhat89 · Sep 5, 2009, 4:27 PM

OK mulai aja untuk cacheboy nya, apa c cacheboy… cari aja di forum.pfsense.com untuk infonya...
apa saja yang dirubah oleh cacheboy pada squid?
1. squid.inc
2. penambahan usr/local/etc/squid/include.conf untuk di load ke dalam squid.conf melalui squid.inc
3. lain2 bisa dilihat pada package... terlalu banyak kalau jelasin satu2...
step by step:
1. pastikan squid ver 2 terinstall di mesin setan kecil anda (tidak untuk ver 3).
2. download file di http://code.google.com/p/pfsense-cacheboy/downloads/list
3. upload file pfsense.cacheboy.tar.gz ke pfsense melalui diagnostics>command>upload. Lalu pindahkan ke / (mv /tmp/pfsense.cacheboy.tar.gz /)
4. masuk ke shell di pfsense box dan jalankan:
a.) cd /
b.) tar -xvf pfsense.cacheboy.tar.gz
c.) ./cacheboy.sh
5. masuk ke services>proxy server dan tekan tombol save untuk memperbarui squid.conf
finish dech... eazy kan...
pada prakteknya mungkin akan ada pesan :
Squid Cache (Version CACHEBOY_1.6): Terminated abnormally.
can't find cache_dir /cache0

untuk master2 squid tentu udah tahu apa maksudnya.... kalau saya sendiri kurang paham, tapi terselesaikan dengan membuat folder cache0 di /
dan cacheboy berjalan lancar...

dulu aku pernah bilang kalau delay pool untuk bandwidth limiter untuk file2 tertentu nggak jalan, setelah tanya2 ke beberapa sumber masalah ada di script tambahan cacheboy di bagian squid.inc yakni delay_body_max_size 32768 1 allow all. solusi aku hapus, atau kalau tidak gitu ganti/tambah dengan delay_body_max_size 32768 1 allow !download (dimana download adalah acl yang dibuat).
untuk fitur lainnya, sepertinya nunggu lagi ya... masih explore... and please CMIIW...
masih nubi nech... and absolutely stay foolish...

ps:
Perlu diperhatikan selain streaming caching, cacheboy merupakan "hacking" squid untuk greedy cache (cache dynamic content)... jadi kemungkinan nanti situs bandwidth test yang notabene dynamic anda akan dicache... hasilnya? lumayan speedtest saya menjadi 50.80 Mbit/s :D ;D

Thanks...

xaviero · Sep 5, 2009, 5:02 PM

cobain donk brow, cache site lytogame.com dan lakukan registrasi user …. ane selalu mental bolak balik page awal....

deddychan · Sep 9, 2009, 5:24 AM

bro yellowhat89 ….

masih bingung nihh tuk langkah/step no 3 dan 4. secara ane newbie pake pfsense.
klo langkah no 3 pake winscp bisa ga sihh?jadi saya download di PC trus upload pake winscp.
bener ga???

thanks.

yellowhat89 · Sep 9, 2009, 6:57 AM

bisa aja bro… yang penting selamat sampai tujuan ;D

serangku · Sep 9, 2009, 7:24 AM

sangat … sangat bisa om @deddy
hati2 ... jangan sampe ketuker foldernya yah ...

yellowhat89 · Sep 9, 2009, 9:33 AM

Temen2 yang suka cache youtube (atau pakai apapun), ada berita sedikit tidak menyenangkan.
yaitu, youtube merubah algoritma pengalamatannya (kemungkinan setiap beberapa menit), tapi dari discussion board youtube caching di squid ada yang perlu dirubah untuk mengatasi ini, terbukti atau tidak terus terang saya sendiri belum mencoba.
berikut codingnya:

#Untuk yang memakai cacheboy edit di include.conf
# Semua kata kunci dari file video youtube adalah "get_video?", "videodownload?" dan "videoplayback" ditambah id-nya, jadi tambahkan acl berikut di include.conf (untuk cacheboy).
acl store_rewrite_list urlpath_regex /(get_video?|videodownload?|videoplayback.*id)

#edit di squid.inc
#tambahkan line ini sebelum cache deny
acl QUERY2 urlpath_regex get_video? videoplayback? videodownload?
cache allow QUERY2
#ini adalah default deny url yang mempunyai cgi-bin dan ? untuk squid sebelum versi 2.7
acl QUERY urlpath_regex cgi-bin ?
cache deny QUERY

edit di include.conf
refresh_pattern (get_video?|videoplayback?|videodownload?) 5259487 99999999% 5259487 override-expire ignore-reload

edit di include.conf
storeurl_access allow store_rewrite_list
storeurl_access deny all
storeurl_rewrite_program /usr/local/etc/squid/storeurl.pl
storeurl_rewrite_children 1
storeurl_rewrite_concurrency 10

Storeurl script
#your perl location in here, mine is #!/bin/perl
$|=1;
while (<>) {
@X = split;
$x = $X[0];
$_ = $X[1];

compatibility from old cached get_video?video_id

if (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
$z = $2; $z =~ s/video_id=/get_video?video_id=/;
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

youtube HD itag=22

} elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=22).?&(id=[a-zA-Z0-9])/) {
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . "&" . $3 . "\n";

youtube Normal screen always HD itag 35, Normal screen never HD itag 34, itag=18 <–normal?

} elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=[0-9]).?&(id=[a-zA-Z0-9]*)/) {
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $3 . "\n";

} else {
print $x . $_ . "\n";
}
}

sedikit tune
minimum_object_size 512 bytes

bagian yang tidak aku pahami, katanya ini diff file, dan diberi Judul FIX
–- src/client_side.c 2008-10-30 07:37:56 +0800
+++ src/client_side.c 2008-11-05 23:44:55 +0800
@@ -2399,6 +2399,18 @@
is_modified = 0;
}
}
+ /* bug fix for 302 moved_temporarily loop bug when using storeurl*/
+ if (mem->reply->sline.status == HTTP_MOVED_TEMPORARILY) {
+ const char cloc = httpHeaderGetStr(&e->mem_obj->reply->header, HDR_LOCATION);
+ if (!strcmp(http->uri,cloc)) {
+ debug(33, 1) ("Loop Detected: %s Redirect to: %s\n",
+ http->uri,cloc);
+ http->log_type = LOG_TCP_MISS;
+ clientProcessMiss(http);
+ return;
+ }
+ }
+ / bug fix end here*/
stale = refreshCheckHTTPStale(e, r);
debug(33, 2) ("clientCacheHit: refreshCheckHTTPStale returned %d\n", stale);
if (stale == 0) {

Bagi para master tolong kasih penjelasan untuk diff file di atas…

Oh ya bagi om2 yang ingin meng-cache dari filehippo silahkan tambahkan di storeurl script line di bawah ini:

} elsif (($u =~ /filehippo/) && (m/^http://(.?).(.?)/(.?)/(.).([a-z0-9]{3,4})(?.*)?/)) {
@y = ($1,$2,$4,$5);
$y[0] =~ s/[a-z0-9]{2,5}/cdn./;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

kambeeng · Sep 10, 2009, 3:17 AM

wew dengan alasan apa youtube merubah .. addrees, oh mungkin agar situsnya dikunjungi terus menerus :D

xaviero · Sep 10, 2009, 3:29 AM

yah biasalah…. patch kalik.... :D

serangku · Sep 10, 2009, 4:44 PM

capek deh … :D

avanthe · Mar 29, 2010, 11:28 AM

Setup a VideoCache on pfSense
This howto covers the process of installing videocache on pfSense. Now, you have already installed Squid proxy on pfSense.
1.Firstly, you need to install Python.
•Use Shell terminal or ssh to PFsense and use the following command:

pkg_add -r python

•Install the additional needed libraries.

pkg_add -r py25-bsddb

pkg_add -r py25-gdbm

pkg_add -r py25-sqlite3

pkg_add -r py25-tkinter

2.After that, install URLGrabber.
•Download the latest version of urlgrabber from URLGrabber Download Archive.

fetch http:/linux.duke.edu/projects/urlgrabber/download/urlgrabber-x.x.x.tar.gz

tar -xzf urlgrabber-x.x.x.tar.gz

cd urlgrabber-x.x.x

python setup.py bdist_rpm

python setup.py install

3.Then, install Iniparse.
Download the latest version of python-iniparse from Iniparse Project Website.

fetch http:/iniparse.googlecode.com/files/iniparse-x.x.x.tar.gz

tar -xzf iniparse-x.x.x.tar.gz

cd iniparse-x.x.x

python setup.py bdist_rpm

python setup.py install

4.Then, install VideoCache.

fetch http:/cachevideos.com/sites/default/files/pub/videocache/videocache

/x.x.tar.gz

tar -xvzf videocache-x.x.tar.gz

python setup.py install

5.Configure VideoCache
•Using VI edit the /etc/videocache.conf file and edit the following options in the
file.
-proxy: Set the IP address and port on which squid is listening on PFsense.
-cache_host: The IP address of PFsense.
6.Configure Squid
Now add the following lines to /usr/local/pkg/squid.inc after acl.

–BEGIN-- videocache config for squid

url_rewrite_program /usr/bin/python /usr/share/videocache/videocache.py
url_rewrite_children 10
acl videocache_allow_url url_regex -i .youtube.com/get_video
acl videocache_allow_url url_regex -i .cache[a-z0-9]?[a-z0-9]?[a-z0-9]?
.googlevideo.com/videoplayback
acl videocache_allow_url url_regex -i .cache[a-z0-9]?[a-z0-9]?[a-z0-9]?
.googlevideo.com/get_video
acl videocache_allow_url url_regex -i proxy-[0-9][0-9].dailymotion.com/
acl videocache_allow_url url_regex -i [a-z0-9][0-9a-z][0-9a-z]?[0-9a-z]?[0-9a-
z]?.xtube.com/(.)flv
acl videocache_allow_url url_regex -i bitcast.vimeo.com/vimeo/videos/
acl videocache_allow_url url_regex -i va.wrzuta.pl/wa[0-9][0-9][0-9][0-9]?
acl videocache_allow_url url_regex -i .files.youporn.com/(.)/flv/
acl videocache_allow_url url_regex -i .msn.com.edgesuite.net/(.*).flv
acl videocache_allow_dom dstdomain v.mccont.com vp.video.google.com dl.redtube.com
acl videocache_deny_url url_regex -i http://[a-z][a-z].youtube.com http:/
/www.youtube.com
url_rewrite_access deny videocache_deny_url
url_rewrite_access allow videocache_allow_url
url_rewrite_access allow videocache_allow_dom
redirector_bypass on

–END-- videocache config for squid

• Save and restart squid service and you have videocache running on your PFsense.
P/s: You need to disable the https option in the General Setup Settings.

sumber: http://johncrackernet.blogspot.com/2009/02/howto-installing-squid-proxy-in-pfsense.html

kambeeng · Mar 30, 2010, 9:14 AM

@avanthe:

Setup a VideoCache on pfSense
This howto covers the process of installing videocache on pfSense. Now, you have already installed Squid proxy on pfSense.
1.Firstly, you need to install Python.
•Use Shell terminal or ssh to PFsense and use the following command:

pkg_add -r python

•Install the additional needed libraries.

pkg_add -r py25-bsddb

pkg_add -r py25-gdbm

pkg_add -r py25-sqlite3

pkg_add -r py25-tkinter

2.After that, install URLGrabber.
•Download the latest version of urlgrabber from URLGrabber Download Archive.

fetch http:/linux.duke.edu/projects/urlgrabber/download/urlgrabber-x.x.x.tar.gz

tar -xzf urlgrabber-x.x.x.tar.gz

cd urlgrabber-x.x.x

python setup.py bdist_rpm

python setup.py install

3.Then, install Iniparse.
Download the latest version of python-iniparse from Iniparse Project Website.

fetch http:/iniparse.googlecode.com/files/iniparse-x.x.x.tar.gz

tar -xzf iniparse-x.x.x.tar.gz

cd iniparse-x.x.x

python setup.py bdist_rpm

python setup.py install

4.Then, install VideoCache.

fetch http:/cachevideos.com/sites/default/files/pub/videocache/videocache

/x.x.tar.gz

tar -xvzf videocache-x.x.tar.gz

python setup.py install

5.Configure VideoCache
•Using VI edit the /etc/videocache.conf file and edit the following options in the
file.
-proxy: Set the IP address and port on which squid is listening on PFsense.
-cache_host: The IP address of PFsense.
6.Configure Squid
Now add the following lines to /usr/local/pkg/squid.inc after acl.

–BEGIN-- videocache config for squid

url_rewrite_program /usr/bin/python /usr/share/videocache/videocache.py
url_rewrite_children 10
acl videocache_allow_url url_regex -i .youtube.com/get_video
acl videocache_allow_url url_regex -i .cache[a-z0-9]?[a-z0-9]?[a-z0-9]?
.googlevideo.com/videoplayback
acl videocache_allow_url url_regex -i .cache[a-z0-9]?[a-z0-9]?[a-z0-9]?
.googlevideo.com/get_video
acl videocache_allow_url url_regex -i proxy-[0-9][0-9].dailymotion.com/
acl videocache_allow_url url_regex -i [a-z0-9][0-9a-z][0-9a-z]?[0-9a-z]?[0-9a-
z]?.xtube.com/(.)flv
acl videocache_allow_url url_regex -i bitcast.vimeo.com/vimeo/videos/
acl videocache_allow_url url_regex -i va.wrzuta.pl/wa[0-9][0-9][0-9][0-9]?
acl videocache_allow_url url_regex -i .files.youporn.com/(.)/flv/
acl videocache_allow_url url_regex -i .msn.com.edgesuite.net/(.*).flv
acl videocache_allow_dom dstdomain v.mccont.com vp.video.google.com dl.redtube.com
acl videocache_deny_url url_regex -i http://[a-z][a-z].youtube.com http:/
/www.youtube.com
url_rewrite_access deny videocache_deny_url
url_rewrite_access allow videocache_allow_url
url_rewrite_access allow videocache_allow_dom
redirector_bypass on

–END-- videocache config for squid

• Save and restart squid service and you have videocache running on your PFsense.
P/s: You need to disable the https option in the General Setup Settings.

sumber: http://johncrackernet.blogspot.com/2009/02/howto-installing-squid-proxy-in-pfsense.html

sumber aslinnya ada di pfsense

http://doc.pfsense.org/index.php/Setup_VideoCache_with_Squid