Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Help Videocahce

    Scheduled Pinned Locked Moved Indonesian
    22 Posts 4 Posters 10.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A
      anto_DIGIT
      last edited by

      @fauzi:

      Iya saya dah pake lucsa tuningnya juga dah dimasukin
      tapi tetap aja videonya gak ke capture
      mungkin apakah versi video cahcenya karna bayar kali ya
      jadi gak bisa ke cahce videonya karna gak register?
      maaf baru buka lagi baru pulang kampung….

      terang saja kalau pakai versi terbaru dan belum register tdk bisa .. itu kan bukan gratisan ..
      kalau pakai versi lama yg belum berbayar, resikonya ada beberapa video yg justru error ..

      cukup dng tunning lusca dan penambahan storeurl.pl seharusnya sudah bisa caching video, kalau gagal coba lihat di /var/squid/cache.log

      1 Reply Last reply Reply Quote 0
      • F
        fauzi
        last edited by

        maaf mas anto cara liat di /var/squid/cache.log pake tail -f trus yang musti di perhatiin apannya…?
        thk atas infonya....
        semoga saya jadi bisa mengcaptur video

        1 Reply Last reply Reply Quote 0
        • A
          anto_DIGIT
          last edited by

          @fauzi:

          maaf mas anto cara liat di /var/squid/cache.log pake tail -f trus yang musti di perhatiin apannya…?
          thk atas infonya....
          semoga saya jadi bisa mengcaptur video

          contoh :
          tail -f /var/squid/log/cache.log
          2010/07/19 01:37:04| clientCacheHit: Redirect Loop Detected: http://v8.cache3.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2Cexpire%2Cip%2Cipbits%2Citag%2Calgorithm%2Cburst%2Cfactor%2Coc%3AU0dWTlVLT19FSkNNNl9NRVND&algorithm=throttle-factor&itag=34&ipbits=0&burst=40&sver=3&expire=1279501200&key=yt1&signature=76862E2625B171040FFE05ABFAE0DF7DABF4273D.5E98D2676AF99802F357D3B5E5DFB5E6CB71C3DD&factor=1.25&id=632295b2475d26b1&redirect_counter=1

          coba saja buka salah satu video youtube melalui browser, kemudian play hingga selesai …kemudian close broser, buka broser ... clear recent history : cache ...
          coba akses lagi halaman tadi  ... jika memang ter-hit pasti  berjalan jauh lebih cepat ..

          1 Reply Last reply Reply Quote 0
          • F
            fauzi
            last edited by

            saya dah liat liat storeurl.pl baca baca bolak balik tapi ya belum mudeng juga nich omm
            ada link untuk step2nya yang menurut om mudah di mengerti gak?
            ato bukinin cara updatenya..
            info mesinnya celeron D 2,6 ghz 512mb memori hdd cahce 100gb fisik hdd 250gb trus apa ada yang perlu di tambain biar bisa wuz-wuz

            1 Reply Last reply Reply Quote 0
            • F
              fauzi
              last edited by

              saya sudah tuning luscanya dabn sudah pake storeurl.pl dan setalah saya cek pake perinta

              tail -f /var/squid/log/cahce.lognya kaya gini mohon penerahan maksud dari loga apa?

              tail -f /var/squid/logs/cache.log

              2010/07/19 04:25:31| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:25:31|    /var/squid/cache/00/8B/00008B9F
              2010/07/19 04:25:31| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:25:31|    /var/squid/cache/00/8B/00008BCD
              2010/07/19 04:25:34| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:25:34|    /var/squid/cache/00/4D/00004DB0
              2010/07/19 04:25:45| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:25:45|    /var/squid/cache/00/12/00001236
              2010/07/19 04:26:34| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:26:34|    /var/squid/cache/00/0F/00000F28
              2010/07/19 04:28:52| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:28:52|    /var/squid/cache/00/6C/00006C81
              2010/07/19 04:28:52| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:28:52|    /var/squid/cache/00/14/000014E3
              2010/07/19 04:28:52| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:28:52|    /var/squid/cache/00/03/00000330
              2010/07/19 04:29:21| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:21|    /var/squid/cache/00/8B/00008BB9
              2010/07/19 04:29:25| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:25|    /var/squid/cache/00/13/00001371
              2010/07/19 04:29:26| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:26|    /var/squid/cache/00/04/00000445
              2010/07/19 04:29:26| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:26|    /var/squid/cache/00/13/00001380
              2010/07/19 04:29:26| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:26|    /var/squid/cache/00/18/0000186C
              2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:27|    /var/squid/cache/00/01/00000126
              2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:27|    /var/squid/cache/00/04/00000443
              2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:27|    /var/squid/cache/00/13/00001387
              2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:27|    /var/squid/cache/00/13/0000138D
              2010/07/19 04:29:27| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:27|    /var/squid/cache/00/8F/00008F13
              2010/07/19 04:29:28| storeAufsOpenDone: (2) No such file or directory
              2010/07/19 04:29:28|    /var/squid/cache/00/04/00000472
              2010/07/19 04:29:28| storeAufsOpenDone: (2) No such file or directory

              1 Reply Last reply Reply Quote 0
              • F
                fauzi
                last edited by

                trus sama ini ketinggalan
                terakhir ada

                b7e6bc10bfd7ff69cc54ec5g.jpg'
                2010/07/19 04:46:00| WARNING: unparseable HTTP header field {"4afbec9a3db7e6bc10bfd7ff69cc54ec.jpg"
                }
                apa nich maksudnya

                thk atas infonya…

                1 Reply Last reply Reply Quote 0
                • F
                  fauzi
                  last edited by

                  oh ya lupa !
                  gini lo om kan katanya si youtub merubah sistem algoritmannya setiap beberapa menit
                  pake storeurl.pl bisa gak tuch ke cahce trus kalo bisa gimana carannya…
                  thk atas infonnya....

                  1 Reply Last reply Reply Quote 0
                  • A
                    anto_DIGIT
                    last edited by

                    @fauzi:

                    oh ya lupa !
                    gini lo om kan katanya si youtub merubah sistem algoritmannya setiap beberapa menit
                    pake storeurl.pl bisa gak tuch ke cahce trus kalo bisa gimana carannya…
                    thk atas infonnya....

                    memang ada yg berubah, coba deh :

                    _$|=1;
                    while (<>) {
                        @X = split;

                    $X[1] =~ s/&sig=.*//;

                    $x = $X[0] . " ";
                    $_ = $X[1];
                    $u = $X[1];

                    if ($url =~ m@^http://([^.].)?bing.[^/]/[^?]?.@i) {

                    # Replace any previous safe directives
                        $url =~ s@(adlt=[^&]*&?)@@ig;

                    # Add safe search directive
                        $url .= '&adlt=strict&cc=au';

                    } elsif ($url =~ m@^http://([^.].)?google.[^/]/[^?]?.@i) {

                    # Replace any previous safe directives
                        $url =~ s@(safe=[^&]*&?)@@ig;

                    # Add safe search directive
                        $url .= '&safe=active';

                    compatibility for old cached get_video?video_id

                    } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
                    $z = $2; $z =~ s/video_id=/get_video?video_id=/;
                    print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

                    youtube 1024p HD itag=37, 720p HD itag=22

                    } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=37|itag=22).?&(id=[a-zA-Z0-9])/) {
                    print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . "&" . $3 . "\n";

                    youtube Normal screen always HD itag 35, Normal screen never HD itag 34, itag=18 <–normal?

                    } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=[0-9]).?&(id=[a-zA-Z0-9]*)/) {
                    print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $3 . "\n";

                    } elsif (m/^http://www.google-analytics.com/__utm.gif?.*/) {
                    print $x . "http://www.google-analytics.com/__utm.gif\n";

                    } elsif (m/^http://www.gstatic.com/__utm.gif?.*/) {
                    print $x . "http://www.gstatic.com/__utm.gif\n";

                    #Cache High Latency Ads
                    } elsif (m/^http://([a-z0-9.])(.doubleclick.net|.quantserve.com|.googlesyndication.com|yieldmanager|cpxinteractive)(.)/) {
                    $y = $3;$z = $2;
                    for ($y) {
                    s/pixel;./pixel/;
                    s/activity;.
                    /activity/;
                    s/(imgad[^&])./\1/;
                    s/;ord=[?0-9]//;
                    s/;×tamp=[0-9]
                    //;
                    s/[&?]correlator=[0-9]//;
                    s/&cookie=[^&]
                    //;
                    s/&ga_hid=[^&]//;
                    s/&ga_vid=[^&]
                    //;
                    s/&ga_sid=[^&]*//;

                    s/&prev_slotnames=[^&]*//

                    s/&u_his=[^&]*//;

                    s/&dt=[^&]//;
                    s/&dtd=[^&]
                    //;
                    s/&lmt=[^&]//;
                    s/(&alternate_ad_url=http%3A%2F%2F[^(%2F)]
                    )[^&]/\1/;
                    s/(&url=http%3A%2F%2F[^(%2F)]
                    )[^&]/\1/;
                    s/(&ref=http%3A%2F%2F[^(%2F)]
                    )[^&]/\1/;
                    s/(&cookie=http%3A%2F%2F[^(%2F)]
                    )[^&]/\1/;
                    s/[;&?]ord=[?0-9]
                    //;
                    s/[;&]mpvid=[^&;]//;
                    s/&xpc=[^&]
                    //;

                    yieldmanager

                    s/?clickTag=[^&]//;
                    s/&u=[^&]
                    //;
                    s/&slotname=[^&]//;
                    s/&page_slots=[^&]
                    //;
                    }
                    print $x . "http://" . $1 . $2 . $y . "\n";

                    #google map
                    } elsif (m/kh(.?).google.com(.?)/(.?) /) {
                          print "http://keyhole-srv.google.com" . $2 . ".SQUIDINTERNAL/" . $3 . "\n";
                                    # print STDERR "KEYHOLE\n";
                    } elsif (m/mt(.
                    ?).google.com(.?)/(.?) /) {
                            print "http://map-srv.google.com" . $2 . ".SQUIDINTERNAL/" . $3 . "\n";
                                    # print STDERR "MAPSRV\n";

                    # indowebster added by fahmi[at]airputih.or.id

                    } elsif (($u =~ /indowebster/) && (m/^http://www[0-9][0-9].indowebster.com./(.?)/)) {

                    #        print $x . "http://cdn.indowebster.com/" . $2 . "\n";

                    #cache high latency ads
                    } elsif (m/^http://(.?)/(ads)?(.?)/) {
                    print $x . "http://" . $1 . "/" . $2  . "\n";

                    spicific servers starts here….

                    } elsif (m/^http://(www.ziddu.com..[^/]{3,4})/(.?)/) {
                    print $x . "http://" . $1 . "\n";

                    #cdn, varialble 1st path
                    } elsif (($u =~ /filehippo/) && (m/^http://(.?).(.?)/(.?)/(.).([a-z0-9]{3,4})(?.*)?/)) {
                    @y = ($1,$2,$4,$5);
                    $y[0] =~ s/[a-z0-9]{2,5}/cdn./;
                    print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                    #rapidshare
                    } elsif (($u =~ /rapidshare/) && (m/^http://(([A-Za-z]+[0-9-.]+)?)([a-z].[^/]{3}/[a-z]/[0-9])/(.*?)/([^/?&]{4,})$/)) {
                    print $x . "http://cdn." . $3 . "/SQUIDINTERNAL/" . $5 . "\n";

                    } elsif (($u =~ /maxporn/) && (m/^http://([^/]?)/(.?)/([^/]?)(?.)?$/)) {
                    print $x . "http://" . $1 . "/SQUIDINTERNAL/" . $3 . "\n";

                    #like porn hub variables url and center part of the path, filename etention 3 or 4 with or without ? at the end
                    } elsif (($u =~ /tube8|pornhub|xvideos/) && (m/^http://(([A-Za-z]+[0-9-.]+)?).([a-z][0-9]?.[^/]{3}/[a-z])(.?)((/[a-z])?(/[^/]){4}.[^/?]{3,4})(?.*)?$/)) {
                    print $x . "http://cdn." . $3 . $5 . "\n";
                    #…spicific servers end here.

                    #photos-X.ak.fbcdn.net where X a-z
                    } elsif (m/^http://photos-[a-z].ak.fbcdn.net/(.*)/) {
                    print $x . "http://photos.ak.fbcdn.net/" . $1  . "\n";

                    #general purpose for cdn servers. add above your specific servers.
                    } elsif (m/^http://([0-9.]?)//(.?).(.)?(.?)/) {
                    print $x . "http://squid-cdn-url//" . $2  . "." . $3 . "\n";

                    #for yimg.com doubled
                    } elsif (m/^http://(.?).yimg.com/(.?).yimg.com/(.?)?(.)/) {
                    print $x . "http://cdn.yimg.com/"  . $3 . "\n";

                    #for yimg.com with &sig=
                    } elsif (m/^http://(.?).yimg.com/(.)/) {
                    @y = ($1,$2);
                    $y[0] =~ s/[a-z]+[0-9]+/cdn/;
                    $y[1] =~ s/&sig=.*//;
                    print $x . "http://" . $y[0] . ".yimg.com/"  . $y[1] . "\n";

                    #generic http://variable.domain.com/path/filename."ext" or "exte" with or withour "?"
                    } elsif (m/^http://(.)([^.-]?..?)/(.).([^/?&]{3,4})(?.*)?$/) {
                    @y = ($1,$2,$3,$4);
                    $y[0] =~ s/(([a-zA-A-]+[0-9-]+)|(.cdn.)|(.cache.))/cdn/;
                    print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                    generic http://variable.domain.com/…

                    } elsif (m/^http://(([A-Za-z]+[0-9-]+)?|.cdn.|.cache.).(.?).(.?)/(.)$/) {
                    print $x . "http://cdn." . $3 . "." . $4 . "/" . $5 .  "\n";

                    spicific extention that ends with ?

                    } elsif (m/^http://(.?)/(.?).(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|on2)?(.*)/) {
                    print $x . "http://" . $1 . "/" . $2  . "." . $3 . "\n";

                    all that ends with ;

                    } elsif (m/^http://(.?)/(.?);(.*)/) {
                    print $x . "http://" . $1 . "/" . $2  . "\n";

                    } else {
                    print $x . $_ . "\n";
                    }
                    }_

                    1 Reply Last reply Reply Quote 0
                    • O
                      onomlakbok
                      last edited by

                      saya sudah pk LUSCA terbaru tp videocache sepertinya belum jalan

                      tail -f /var/squid/logs/cache.log

                      2010/07/18 10:51:06| Reconfiguring Squid Cache (version 2.7.STABLE9)…
                      2010/07/18 10:51:06| FD 17 Closing HTTP connection
                      2010/07/18 10:51:06| FD 18 Closing HTTP connection
                      2010/07/18 10:51:06| FD 19 Closing HTCP socket
                      2010/07/18 10:51:06| FD 20 Closing SNMP socket
                      2010/07/18 10:51:06| aioSync: flushing pending I/O operations
                      2010/07/18 10:51:06| aioSync: done
                      2010/07/18 10:51:06| logfileClose: closing log /dev/null
                      2010/07/18 10:51:06| Including Configuration File: /usr/local/etc/squid/squid.co                                              nf (depth 0)
                      2010/07/18 10:51:06| Cache dir '/var/squid/cache' size remains unchanged at 3072                                              000 KB
                      mesti dgimanakan lagi om anto_DIGIT???

                      1 Reply Last reply Reply Quote 0
                      • F
                        fauzi
                        last edited by

                        @anto_DIGIT:

                        @fauzi:

                        oh ya lupa !
                        gini lo om kan katanya si youtub merubah sistem algoritmannya setiap beberapa menit
                        pake storeurl.pl bisa gak tuch ke cahce trus kalo bisa gimana carannya…
                        thk atas infonnya....

                        memang ada yg berubah, coba deh :

                        _$|=1;
                        while (<>) {
                            @X = split;

                        ini di co pas aja untuk menggantikan isi storeurl.plnya yach yang asli di hapus trus diganti sama yang ini..?
                        thk atas infonya

                        $X[1] =~ s/&sig=.*//;

                        $x = $X[0] . " ";
                        $_ = $X[1];
                        $u = $X[1];

                        if ($url =~ m@^http://([^.].)?bing.[^/]/[^?]?.@i) {

                        # Replace any previous safe directives
                            $url =~ s@(adlt=[^&]*&?)@@ig;

                        # Add safe search directive
                            $url .= '&adlt=strict&cc=au';

                        } elsif ($url =~ m@^http://([^.].)?google.[^/]/[^?]?.@i) {

                        # Replace any previous safe directives
                            $url =~ s@(safe=[^&]*&?)@@ig;

                        # Add safe search directive
                            $url .= '&safe=active';

                        compatibility for old cached get_video?video_id

                        } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
                        $z = $2; $z =~ s/video_id=/get_video?video_id=/;
                        print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

                        youtube 1024p HD itag=37, 720p HD itag=22

                        } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=37|itag=22).?&(id=[a-zA-Z0-9])/) {
                        print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . "&" . $3 . "\n";

                        youtube Normal screen always HD itag 35, Normal screen never HD itag 34, itag=18 <–normal?

                        } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?&(itag=[0-9]).?&(id=[a-zA-Z0-9]*)/) {
                        print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $3 . "\n";

                        } elsif (m/^http://www.google-analytics.com/__utm.gif?.*/) {
                        print $x . "http://www.google-analytics.com/__utm.gif\n";

                        } elsif (m/^http://www.gstatic.com/__utm.gif?.*/) {
                        print $x . "http://www.gstatic.com/__utm.gif\n";

                        #Cache High Latency Ads
                        } elsif (m/^http://([a-z0-9.])(.doubleclick.net|.quantserve.com|.googlesyndication.com|yieldmanager|cpxinteractive)(.)/) {
                        $y = $3;$z = $2;
                        for ($y) {
                        s/pixel;./pixel/;
                        s/activity;.
                        /activity/;
                        s/(imgad[^&])./\1/;
                        s/;ord=[?0-9]//;
                        s/;×tamp=[0-9]
                        //;
                        s/[&?]correlator=[0-9]//;
                        s/&cookie=[^&]
                        //;
                        s/&ga_hid=[^&]//;
                        s/&ga_vid=[^&]
                        //;
                        s/&ga_sid=[^&]*//;

                        s/&prev_slotnames=[^&]*//

                        s/&u_his=[^&]*//;

                        s/&dt=[^&]//;
                        s/&dtd=[^&]
                        //;
                        s/&lmt=[^&]//;
                        s/(&alternate_ad_url=http%3A%2F%2F[^(%2F)]
                        )[^&]/\1/;
                        s/(&url=http%3A%2F%2F[^(%2F)]
                        )[^&]/\1/;
                        s/(&ref=http%3A%2F%2F[^(%2F)]
                        )[^&]/\1/;
                        s/(&cookie=http%3A%2F%2F[^(%2F)]
                        )[^&]/\1/;
                        s/[;&?]ord=[?0-9]
                        //;
                        s/[;&]mpvid=[^&;]//;
                        s/&xpc=[^&]
                        //;

                        yieldmanager

                        s/?clickTag=[^&]//;
                        s/&u=[^&]
                        //;
                        s/&slotname=[^&]//;
                        s/&page_slots=[^&]
                        //;
                        }
                        print $x . "http://" . $1 . $2 . $y . "\n";

                        #google map
                        } elsif (m/kh(.?).google.com(.?)/(.?) /) {
                              print "http://keyhole-srv.google.com" . $2 . ".SQUIDINTERNAL/" . $3 . "\n";
                                        # print STDERR "KEYHOLE\n";
                        } elsif (m/mt(.
                        ?).google.com(.?)/(.?) /) {
                                print "http://map-srv.google.com" . $2 . ".SQUIDINTERNAL/" . $3 . "\n";
                                        # print STDERR "MAPSRV\n";

                        # indowebster added by fahmi[at]airputih.or.id

                        } elsif (($u =~ /indowebster/) && (m/^http://www[0-9][0-9].indowebster.com./(.?)/)) {

                        #        print $x . "http://cdn.indowebster.com/" . $2 . "\n";

                        #cache high latency ads
                        } elsif (m/^http://(.?)/(ads)?(.?)/) {
                        print $x . "http://" . $1 . "/" . $2  . "\n";

                        spicific servers starts here….

                        } elsif (m/^http://(www.ziddu.com..[^/]{3,4})/(.?)/) {
                        print $x . "http://" . $1 . "\n";

                        #cdn, varialble 1st path
                        } elsif (($u =~ /filehippo/) && (m/^http://(.?).(.?)/(.?)/(.).([a-z0-9]{3,4})(?.*)?/)) {
                        @y = ($1,$2,$4,$5);
                        $y[0] =~ s/[a-z0-9]{2,5}/cdn./;
                        print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                        #rapidshare
                        } elsif (($u =~ /rapidshare/) && (m/^http://(([A-Za-z]+[0-9-.]+)?)([a-z].[^/]{3}/[a-z]/[0-9])/(.*?)/([^/?&]{4,})$/)) {
                        print $x . "http://cdn." . $3 . "/SQUIDINTERNAL/" . $5 . "\n";

                        } elsif (($u =~ /maxporn/) && (m/^http://([^/]?)/(.?)/([^/]?)(?.)?$/)) {
                        print $x . "http://" . $1 . "/SQUIDINTERNAL/" . $3 . "\n";

                        #like porn hub variables url and center part of the path, filename etention 3 or 4 with or without ? at the end
                        } elsif (($u =~ /tube8|pornhub|xvideos/) && (m/^http://(([A-Za-z]+[0-9-.]+)?).([a-z][0-9]?.[^/]{3}/[a-z])(.?)((/[a-z])?(/[^/]){4}.[^/?]{3,4})(?.*)?$/)) {
                        print $x . "http://cdn." . $3 . $5 . "\n";
                        #…spicific servers end here.

                        #photos-X.ak.fbcdn.net where X a-z
                        } elsif (m/^http://photos-[a-z].ak.fbcdn.net/(.*)/) {
                        print $x . "http://photos.ak.fbcdn.net/" . $1  . "\n";

                        #general purpose for cdn servers. add above your specific servers.
                        } elsif (m/^http://([0-9.]?)//(.?).(.)?(.?)/) {
                        print $x . "http://squid-cdn-url//" . $2  . "." . $3 . "\n";

                        #for yimg.com doubled
                        } elsif (m/^http://(.?).yimg.com/(.?).yimg.com/(.?)?(.)/) {
                        print $x . "http://cdn.yimg.com/"  . $3 . "\n";

                        #for yimg.com with &sig=
                        } elsif (m/^http://(.?).yimg.com/(.)/) {
                        @y = ($1,$2);
                        $y[0] =~ s/[a-z]+[0-9]+/cdn/;
                        $y[1] =~ s/&sig=.*//;
                        print $x . "http://" . $y[0] . ".yimg.com/"  . $y[1] . "\n";

                        #generic http://variable.domain.com/path/filename."ext" or "exte" with or withour "?"
                        } elsif (m/^http://(.)([^.-]?..?)/(.).([^/?&]{3,4})(?.*)?$/) {
                        @y = ($1,$2,$3,$4);
                        $y[0] =~ s/(([a-zA-A-]+[0-9-]+)|(.cdn.)|(.cache.))/cdn/;
                        print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                        generic http://variable.domain.com/…

                        } elsif (m/^http://(([A-Za-z]+[0-9-]+)?|.cdn.|.cache.).(.?).(.?)/(.)$/) {
                        print $x . "http://cdn." . $3 . "." . $4 . "/" . $5 .  "\n";

                        spicific extention that ends with ?

                        } elsif (m/^http://(.?)/(.?).(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|on2)?(.*)/) {
                        print $x . "http://" . $1 . "/" . $2  . "." . $3 . "\n";

                        all that ends with ;

                        } elsif (m/^http://(.?)/(.?);(.*)/) {
                        print $x . "http://" . $1 . "/" . $2  . "\n";

                        } else {
                        print $x . $_ . "\n";
                        }
                        }_

                        1 Reply Last reply Reply Quote 0
                        • F
                          fauzi
                          last edited by

                          yang ini di pake untuk menggantikan isi file storeurl.pl yach mas direplae gitu ?

                          thk atas infonya

                          1 Reply Last reply Reply Quote 0
                          • A
                            anto_DIGIT
                            last edited by

                            @fauzi:

                            yang ini di pake untuk menggantikan isi file storeurl.pl yach mas direplae gitu ?

                            thk atas infonya

                            betul

                            1 Reply Last reply Reply Quote 0
                            • F
                              fauzi
                              last edited by

                              saya dah masukan isi nya..

                              tapi malah loading squidnnya kaga jalan jalan xixixix

                              instal ulang lagi dulu dah… ingung nyariinya....

                              1 Reply Last reply Reply Quote 0
                              • F
                                fauzi
                                last edited by

                                Instal ulang sudah di laksanakan ….
                                dan caceing sudah berjalan untuk proxynya lancar dan maknyus keliatannya sangat cepat / agresif geto....

                                wus wus mantab

                                dan untuk storeurl.plnya sudah muncul ready to serve requests

                                sekarang lagi coba buka web youtube dan dapat dipastikan cachingnya berjalan

                                sebab sudah muncul dengan perintah tail -f /var/squid/log/cahe.log

                                2010/07/19 13:55:16| storeAufsOpenDone: (2) No such file or directory
                                2010/07/19 13:55:16|    /var/squid/cache/00/81/00008159

                                terima kasih banyak om anto_DIGIT  atas info - infonya yang di replay sangat cepat sekali

                                secepat lusca WUZ WUZ  ;D

                                sekali lagi maturnuwun sebanyak banyaknya kuadrat, ixixixixixixixix....

                                1 Reply Last reply Reply Quote 0
                                • F
                                  fauzi
                                  last edited by

                                  om saya sudah test youtube putar sampe selesai trus saca clear cahce tapi pas play proxy hit di mikrotiknya gak kelihatan jalan malah dia pake bandwith internaional lagi dah saya ulang2 tapi sama juga tetap gak ngambil dari cahcenya malah ambil dari youtub lagi…

                                  trus isi tunin.confnya kek gini betul apa gak atau ada yang perlu ditambain
                                  solannya saya saya instalnya atu atu...

                                  vi /usr/local/etc/squid/tunning.conf

                                  acl store_rewrite_list urlpath_regex /(get_video|videoplayback?id|videoplayback.id) .(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|fl
                                  v|wmv|3gp|mp(4|3)|exe|msi|zip|on2|mar)(=|?|;&)+
                                  acl store_rewrite_list_domain url_regex ^http://([A-Za-z-]+[0-9]+)
                                  .[A-Za-z].[A-Za-z]
                                  acl store_rewrite_list_domain url_regex (([a-z]{1,2}[0-9]{1,3})|([0-9]{1,3}[a-z]{1,2})).[a-z][0-9]?.[a-z]{3}
                                  acl store_rewrite_list_path urlpath_regex .(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|avc|zip|mp3|3gp|rar|on2|mar)$
                                  acl store_rewrite_list_domain_CDN url_regex ^http://[a-z]+[0-9].google.co(m|.uk) .rapidshare.com.
                                  /[0-9]/./[^/]*
                                  ^http://(www.ziddu.com..[^/]{3,4})/(.) .doubleclick.net.ord= ^http://[.a-z0-9].photobucket.com.*.[a-z]{3}$

                                  acl rapidurl url_regex .rapidshare.com./[0-9]/[0-9]/[^/]
                                  acl video urlpath_regex .((mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|qt|wmv|m\dv|rv|vob|asx|ogm|flv|3gp)(?.)?)$ (get_video?|vid
                                  eoplayback?|videodownload?|.flv(?.
                                  )?)
                                  acl html url_regex .((html|htm|php|js|css|aspx)(?.)?)$ .com/$ .com$
                                  acl images urlpath_regex .((jp(e?g|e|2)|gif|png|tiff?|bmp|ico)(?.
                                  )?)$
                                  acl dontrewrite url_regex [a-z0-9]{3}.photobucket.com redbot.org

                                  acl store_rewrite_list urlpath_regex /(get_video|videoplayback?id|videoplayback.id) .(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|fl
                                  v|wmv|3gp|mp(4|3)|exe|msi|zip|on2|mar)(=|?|;&)+
                                  acl store_rewrite_list_domain url_regex ^http://([A-Za-z-]+[0-9]+)
                                  .[A-Za-z].[A-Za-z]
                                  acl store_rewrite_list_domain url_regex (([a-z]{1,2}[0-9]{1,3})|([0-9]{1,3}[a-z]{1,2})).[a-z][0-9]?.[a-z]{3}
                                  acl store_rewrite_list_path urlpath_regex .(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|avc|zip|mp3|3gp|rar|on2|mar)$
                                  acl store_rewrite_list_domain_CDN url_regex ^http://[a-z]+[0-9].google.co(m|.uk) .rapidshare.com.
                                  /[0-9]/./[^/]*
                                  ^http://(www.ziddu.com..[^/]{3,4})/(.) .doubleclick.net.ord= ^http://[.a-z0-9].photobucket.com.*.[a-z]{3}$

                                  acl rapidurl url_regex .rapidshare.com./[0-9]/[0-9]/[^/]
                                  acl video urlpath_regex .((mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|qt|wmv|m\dv|rv|vob|asx|ogm|flv|3gp)(?.)?)$ (get_video?|vid
                                  eoplayback?|videodownload?|.flv(?.
                                  )?)
                                  acl html url_regex .((html|htm|php|js|css|aspx)(?.)?)$ .com/$ .com$
                                  acl images urlpath_regex .((jp(e?g|e|2)|gif|png|tiff?|bmp|ico)(?.
                                  )?)$
                                  acl dontrewrite url_regex [a-z0-9]{3}.photobucket.com redbot.org
                                  #acl reload req_header Cache-Control max-age=0
                                  #header_access Cache-Control deny reload

                                  storeurl_access deny dontrewrite
                                  storeurl_access allow store_rewrite_list_domain_CDN
                                  storeurl_access allow store_rewrite_list
                                  storeurl_access allow store_rewrite_list_domain store_rewrite_list_path
                                  storeurl_access deny all
                                  storeurl_rewrite_program /usr/local/etc/squid/storeurl.pl
                                  storeurl_rewrite_children 4
                                  storeurl_rewrite_concurrency 99

                                  1 year = 525600 mins, 1 month = 43800 mins

                                  refresh_pattern windowsupdate.com/..(cab|exe) 40320 100% 43200 reload-into-ims
                                  refresh_pattern update.microsoft.com/.
                                  .(cab|exe) 40320 100% 43200 reload-into-ims
                                  refresh_pattern download.microsoft.com/.*.(cab|exe) 40320 100% 43200 reload-into-ims

                                  #partial flv content may only poisoned the cache
                                  #refresh_pattern porn..flv 5259487 90% 5259487 override-expire  override-lastmod max-stale=5259487
                                  refresh_pattern imeem.
                                  .flv 0 0% 0
                                  refresh_pattern ^ftp:                          40320  20%    40320 override-expire reload-into-ims
                                  refresh_pattern ^gopher:                        1440    0%      1440
                                  refresh_pattern .rapidshare./[0-9]/./[^/] 161280      90%    161280 ignore-reload
                                  refresh_pattern (get_video?|videoplayback?|videodownload?|.flv?) 5259487 99999999% 5259487 override-expire ignore-reload
                                  refresh_pattern .(ico|video-stats)    5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache ignore-private i
                                  gnore-auth override-lastmod    negative-ttl=10080
                                  refresh_pattern .etology?            5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache
                                  refresh_pattern galleries.video(?|sz) 5259487 999999% 5259487        override-expire ignore-reload ignore-no-cache
                                  refresh_pattern brazzers?              5259487 999999% 5259487        override-expire ignore-reload ignore-no-cache
                                  refresh_pattern .adtology?            5259487 999999% 5259487        override-expire ignore-reload ignore-no-cache
                                  refresh_pattern ^.(utm.gif|ads?|advertising.com|ad.yieldmanager.com|doubleclick.net|adserving.cpxinteractive.com) 525
                                  9487 999999% 5259487 ignore-no-cache ignore-private override-expire override-lastmod ignore-reload ignore-auth
                                  refresh_pattern ^.safebrowsing.clients.clients.com/safebrowsing 5259487 999999% 5259487  override-expire ignore-reload ig
                                  nore-no-cache ignore-private ignore-auth    negative-ttl=10080
                                  refresh_pattern ^http://((cbk|mt|khm)[0-9]?).google.co(m|.uk) 5259487 999999% 5259487 override-expire ignore-reload
                                  refresh_pattern ytimg.com.
                                  .jpg                                      5259487 999999% 5259487 override-expire ignore-reload
                                  refresh_pattern (avgate|avira).
                                  (idx|gz)$                                      5259487 999999% 5259487 ignore-no-cache reload
                                  -into-ims
                                  refresh_pattern kaspersky..avc$                                      5259487 999999% 5259487 ignore-reload
                                  refresh_pattern kaspersky                                                      1440 50% 161280 ignore-no-cache
                                  refresh_pattern images.friendster.com.
                                  .(png|gif) 5259487 999999% 5259487    override-expire ignore-reload
                                  refresh_pattern facebook.com..(png|gif)              5259487 999999% 5259487 override-expire ignore-reload
                                  refresh_pattern garena.com                        5259487 999999% 5259487    override-expire reload-into-ims
                                  refresh_pattern photobucket.
                                  .(jp(e?g|e|2)|tiff?|bmp|gif|png) 5259487 999999% 5259487 override-expire ignore-reload
                                  refresh_pattern vid.akm.dailymotion.com..on2? 5259487 999999% 5259487 ignore-no-cache override-expire override-lastmod
                                  refresh_pattern profile.ak.fbcdn.net.
                                  .jpg    40320  20%    40320    ignore-reload

                                  refresh_pattern -i .(ico|js)$ 5259487 999999% 5259487 ignore-reload override-expire override-lastmod
                                  refresh_pattern -i .(mov|mpg|mpeg|flv|avi|mp3|3gp|sis|wma) 5259487 999999% 5259487 reload-into-ims override-lastmod
                                  refresh_pattern -i .(zip|rar|ace|bz|bz2|tar|gz|exe) 5259487 999999% 5259487 reload-into-ims override-lastmod
                                  refresh_pattern -i (.*html$|.*htm|.*shtml|.*aspx|.*asp) 5259487 999999% 5259487 reload-into-ims override-lastmod
                                  refresh_pattern -i .(class|css|js|gif|jpg)$ 5259487 999999% 5259487 override-expire override-lastmod
                                  refresh_pattern -i .(jpe|jpeg|png|bmp|tif)$ 5259487 999999% 5259487 override-expire override-lastmod
                                  refresh_pattern -i .(tiff|mov|avi|qt|mpeg)$ 5259487 999999% 5259487 override-expire override-lastmod
                                  refresh_pattern -i .(mpg|mpe|wav|au|mid)$ 5259487 999999% 5259487 override-expire override-lastmod
                                  refresh_pattern -i .(zip|gz|arj|lha|lzh)$ 5259487 999999% 5259487 override-expire override-lastmod
                                  refresh_pattern -i .(rar|tgz|tar|exe|bin)$ 5259487 999999% 5259487 override-expire override-lastmod
                                  refresh_pattern -i .(hqx|pdf|rtf|doc|swf)$ 5259487 999999% 5259487 override-expire override-lastmod
                                  refresh_pattern -i .(inc|cab|ad|txt|dll)$  5259487 999999% 5259487 override-expire override-lastmod

                                  refresh_pattern .(jp(e?g|e|2)|tiff?|bmp|gif|png)                                                      5259487 999999% 525948
                                  7      reload-into-ims override-expire
                                  refresh_pattern .(z(ip|[0-9]{2})|r(ar|[0-9]{2})|jar|bz2|gz|tar|rpm|vpu)                5259487 999999% 5259487 override-expir
                                  e reload-into-ims
                                  refresh_pattern .(mp3|wav|og(g|a)|flac|midi?|rm|aac|wma|mka|ape)              5259487 999999% 5259487 override-expire reload
                                  -into-ims ignore-reload
                                  refresh_pattern .(exe|msi|dmg|bin|xpi|iso|swf|mar|psf|cab)                    5259487 999999% 5259487 override-expire reload
                                  -into-ims
                                  refresh_pattern .(mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|wmv|m\dv|rv|vob|asx|ogm|flv|3gp|on2) 5259487 9999999% 5259487 override
                                  -expire reload-into-ims
                                  refresh_pattern -i (cgi-bin) 0 0% 0
                                  refresh_pattern .(php|jsp|cgi|asx)? 0 0% 0
                                  refresh_pattern .(php|jsp) 0 0% 0
                                  refresh_pattern . 0 50% 161280

                                  error_directory /usr/local/etc/squid/errors/English
                                  icon_directory /usr/local/etc/squid/icons
                                  half_closed_clients off
                                  dns_timeout 1 minutes
                                  check_hostnames off
                                  dns_testnames 127.0.0.1
                                  negative_ttl 0 seconds
                                  positive_dns_ttl 12 hours
                                  negative_dns_ttl 1 minutes
                                  ipcache_size 8192
                                  ipcache_low 98
                                  ipcache_high 99
                                  fqdncache_size 8192
                                  quick_abort_min 0
                                  quick_abort_max 0
                                  quick_abort_pct 98
                                  memory_pools off
                                  memory_pools_limit 0
                                  forwarded_for off
                                  cachemgr_passwd none all
                                  reload_into_ims on
                                  pipeline_prefetch on
                                  strip_query_terms off
                                  client_db off
                                  maximum_single_addr_tries 5
                                  retry_on_error off
                                  #retry_on_error on
                                  ie_refresh off
                                  #ie_refresh on
                                  max_filedescriptors 8192
                                  zero_buffers on
                                  logfile_rotate 1
                                  unique_hostname proxy.pfsense
                                  range_offset_limit 0
                                  vary_ignore_expire on
                                  zero_buffers on
                                  windows_ipaddrchangemonitor on

                                  ###tunning hanya untuk lusca
                                  n_aiops_threads 16
                                  download_fastest_client_speed on

                                  1 Reply Last reply Reply Quote 0
                                  • A
                                    anto_DIGIT
                                    last edited by

                                    Lakukan ini saja …

                                    <admin edit:="" removed="" harmful="" instructions="">nanti otomatis membuat file include.conf dll ..
                                    Tinggal tambahkan jika ada squid zph .., misal
                                    zph_mode tos
                                    zph_local 0x30
                                    zph_parent 0
                                    zph_option 136

                                    mikrotiknya difungsikan buat apa ?</admin>

                                    1 Reply Last reply Reply Quote 0
                                    • F
                                      fauzi
                                      last edited by

                                      woke seep tak coba dulu om

                                      mikrotik saya pake untuk router Bandwith management + radio wirles(alix3d2)

                                      pfsensenya saya pake untuk squid box

                                      1 Reply Last reply Reply Quote 0
                                      • F
                                        fauzi
                                        last edited by

                                        Om boleh minta tutorial dari awal setalah squid pakage terinstal biar video cahce storeurlnya jalan… please

                                        soalnya saya dah berkali kali test ada yang gak jalan mungkin saya ada salah di seting storeurlnya

                                        dah gitu pas mau masuk squid pakagenya lama banget bisa 20 menitan lebih..

                                        thk b4.

                                        1 Reply Last reply Reply Quote 0
                                        • First post
                                          Last post
                                        Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.