Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    (SHARE) MENGATASI ERROR BUKA YOUTUBE

    Scheduled Pinned Locked Moved Indonesian
    136 Posts 36 Posters 200.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A
      arisap3
      last edited by

      @kaptenhook:

      Untuk nyang kemaren link dari Vevo belum hit, coba storeurl.pl nya di update lagi, bagian ini:

      @meunara.net:

      #ini untuk cache partial
      } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(id=[a-zA-Z0-9]).?&(range=[0-9])./) {
              print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . $3 . "\n";

      # compatibility for old cached get_video?video_id
      } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
              $z = $2; $z =~ s/video_id=/get_video?video_id=/;
              print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";
             
                                    # youtube All itag (semua resolusi)
      } elsif ($X[1] =~ /(youtube|google).*videoplayback?/){
              @itag = m/&?/;
              @id = m/&?/;
              @range = m/&?/;
              print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/@itag&@id&@range\n";

      diganti dengan ini:

      #youtube All itag (semua resolusi)
      } elsif ($X[1] =~ /(youtube|google).*videoplayback?/){
              @itag = m/&?/;
              @id = m/&?/;
              @range = m/&?/;
              @begin = m/&?/;
              @redirect = m/&?/;
              print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/@itag&@id&@range@begin@redirect\n";

      Sukses gan…kapten! ane dah follow petunjukmu n hasilnya
      buka http://www.youtube.com/watch?v=jKOjcqoZRRs lancar jaya wan diem saja

      ![hit proxy.JPG](/public/imported_attachments/1/hit proxy.JPG)
      ![hit proxy.JPG_thumb](/public/imported_attachments/1/hit proxy.JPG_thumb)
      ![youtube cache.JPG](/public/imported_attachments/1/youtube cache.JPG)
      ![youtube cache.JPG_thumb](/public/imported_attachments/1/youtube cache.JPG_thumb)

      1 Reply Last reply Reply Quote 0
      • 9
        9m2pju
        last edited by

        storeurl.pl yang lengkap om please…

        1 Reply Last reply Reply Quote 0
        • C
          chiboik
          last edited by

          @arisap3:

          @kaptenhook:

          Untuk nyang kemaren link dari Vevo belum hit, coba storeurl.pl nya di update lagi, bagian ini:

          @meunara.net:

          #ini untuk cache partial
          } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(id=[a-zA-Z0-9]).?&(range=[0-9])./) {
                  print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . $3 . "\n";

          # compatibility for old cached get_video?video_id
          } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
                  $z = $2; $z =~ s/video_id=/get_video?video_id=/;
                  print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";
               
                                        # youtube All itag (semua resolusi)
          } elsif ($X[1] =~ /(youtube|google).*videoplayback?/){
                  @itag = m/&?/;
                  @id = m/&?/;
                  @range = m/&?/;
                  print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/@itag&@id&@range\n";

          diganti dengan ini:

          #youtube All itag (semua resolusi)
          } elsif ($X[1] =~ /(youtube|google).*videoplayback?/){
                  @itag = m/&?/;
                  @id = m/&?/;
                  @range = m/&?/;
                  @begin = m/&?/;
                  @redirect = m/&?/;
                  print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/@itag&@id&@range@begin@redirect\n";

          Sukses gan…kapten! ane dah follow petunjukmu n hasilnya
          buka http://www.youtube.com/watch?v=jKOjcqoZRRs lancar jaya wan diem saja

          saya sudah coba ganti dengan petunjuk di atas, youtube nya lancar tapi tidak di cache sama lusca..
          salah nya nya dimana yah mas ?

          1 Reply Last reply Reply Quote 0
          • K
            kiripiksireum
            last edited by

            buat agan semua yang masih error youtubenya ataupun yang WAN masih tetep minta klip walaupun klip youtube udah ga dimainkan bisa coba script ini :

            #ini untuk cache partial
            } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(id=[a-zA-Z0-9]).?&(range=[0-9])./) {
                    print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . $3 . "\n";

            # compatibility for old cached get_video?video_id
            } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
                    $z = $2; $z =~ s/video_id=/get_video?video_id=/;
                    print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

            # youtube All itag (semua resolusi)
            } elsif ($X[1] =~ /(youtube|google).*videoplayback?/){
                    @itag = m/&?/;
                    @id = m/&?/;
                    @range = m/&?/;
                    @begin = m/&?/;
                    @redirect = m/&?/;
                    print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/@itag&@id&@range@begin@redirect\n";

            script sama aja kek yang agan semua pada pasang, tapi entah kenapa di mesin ane script yang itu berhasil tanpa error dan WAN diem ketika ada yang buka klip yang sama dari youtube.

            sebelumnya, ane ga rubah sama sekali script dari om chuddy, pure standart. klip youtube hit semua, mau klip biasa sampe klip vevo hit semua. beberapa hari kebelakang, ga ada satu pun klip yang hit, selalu TCP MISS.

            ane ikutin cara sama kek agan meunara.net ane pasang hanya script dibawah ini,

            youtube All itag (semua resolusi)

            } elsif ($X[1] =~ /(youtube|google).*videoplayback?/){
                    @itag = m/&?/;
                    @id = m/&?/;
                    @range = m/&?/;
                    @begin = m/&?/;
                    @redirect = m/&?/;
                    print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/@itag&@id&@range@begin@redirect\n";

            beberapa klip hit, vevo pun ada beberapa yang hit, tapiiii…. ketika ane close klip sebelum klip beres, lusca masih minta klip sampe beres ke WAN. tapi ketika di play lagi, ga ada hit sama sekali. padahal kan WAN minta klip tersebut sampe beres, ya kan? ga ngerti kenapa  ???

            kena pending dulu progress cara supaya youtube bisa hit (anak sakit sampe masuk rumah sakit). seudah anak bisa ganggu ama teriakin adiknya di kamarnya, ane ngoprek lagi. cari sana sini, inget ada script yang belum ane coba di forum ini. coba edit storeurl pake yang diatas tadi, tes beberapa klip, alhamdulillah youtube hit lagi. cuman yang ane ga ngerti sampe sekarang, biasanya kalo ada hit bandwidth ngalir terus sampe klip abis. nah ini ngga, ane test di laptop (windows), hp (android), tab (android juga), masing-masing ane limit di 20mbps, bandwidth ga pernah nyampe ke 20mbps. paling banter 8mbps terus turun ke 512kbps beberapa detik kemudian naek lagi 8mbps turun lagi ke 512kbps, gitu terus hingga klip youtube itu beres.

            sebelumnya waktu pake script bawaan om chuddy, bandwidth 20mbps terus sampe klip beres.

            spek mesin ane :
            IBM A52
            4GB physical memory (DDR2)
            40GB hdd (system, PATA)
            40GB coss (PATA)
            80GB cache1 (SATA)
            80GB cache2 (SATA)
            80GB cache3 (SATA)
            80GB cache4 (SATA)
            ethernet intel gigabit (seri lupa, bawaan board, hanya pake 1ethernet (LAN+WAN di set VLAN)

            ketika ane pasang di mesin AMD rakitan
            board GA-K8NXP-SLI
            memory sama 4GB (DDR1)
            untuk harddisk hanya pasang 2 (1 system + 1cache tanpa coss)
            ethernet bawaan board (onboard ada 2unit lancard gigabit)

            dikedua mesin tersebut ane hanya pasang paket lusca. di intel, youtube hit semua. di AMD, hanya beberapa yang hit. ga paham kenapa, padahal script sama semua.

            udah dulu ahh, kepanjangan sekian reportnya ;D

            1 Reply Last reply Reply Quote 0
            • J
              jokodmc
              last edited by

              Saya barusan install pfsense 2.0.2  i386 di mesin intel dual core  3.0 GHZ dengan memory 8gb, package :  lusca  r14850. disk cache 3 x 500 GB, 2 : aufs, 1 coss, setingan lusca default dari chudy F. lusca berhasil mencache video sperti vimeo dan dailymotion. tetapi lusca sama sekali tidak bisa bisa mencache youtube. apakah ada yang sudah punya pengalaman untuk mengatasi  ini. kalau boleh bagi dong tips triknya…..

              1 Reply Last reply Reply Quote 0
              • P
                poscom
                last edited by

                @jokodmc:

                Saya barusan install pfsense 2.0.2  i386 di mesin intel dual core  3.0 GHZ dengan memory 8gb, package :  lusca  r14850. disk cache 3 x 500 GB, 2 : aufs, 1 coss, setingan lusca default dari chudy F. lusca berhasil mencache video sperti vimeo dan dailymotion. tetapi lusca sama sekali tidak bisa bisa mencache youtube. apakah ada yang sudah punya pengalaman untuk mengatasi  ini. kalau boleh bagi dong tips triknya…..

                sama saja pak..bisa

                1 Reply Last reply Reply Quote 0
                • O
                  olop99
                  last edited by

                  klo ane pakenya yang ini untuk storeurl.pl

                  mantap semuanya ke HIT

                  #!/usr/bin/perl

                  store rewrite originally writen by chudy_fernandez@yahoo.com bersama adik2nya di STIKI

                  modified to satisfy common and dynamic content.

                  Suwun loh cak Chudy Fernandez…... kapan2 nongkrong maneh yo sampek isuk....

                  $|=1;
                  while (<>) {
                      @X = split;
                  #      $X[1] =~ s/&sig=.*//;
                          $x = $X[0] . " ";
                          $_ = $X[1];
                          $u = $X[1];

                  #speedtest
                  if (m/^http://(.)/speedtest/(..(jpg|txt))?(.*)/) {
                          print $x . "http://www.speedtest.net.SQUIDINTERNAL/speedtest/" . $2 . "\n";

                  #mediafire
                  }elsif (m/^http://199.91.15\d.\d*/\w{12}/(\w*)/(.*)/) {
                          print $x . "http://www.mediafire.com.SQUIDINTERNAL/" . $1 ."/" . $2 . "\n";

                  #fileserve
                  }elsif (m/^http://fs\w*.fileserve.com/file/(\w*)/[\w-]./(.)/) {
                          print $x . "http://www.fileserve.com.SQUIDINTERNAL/" . $1 . "./" . $2 . "\n";

                  #filesonic
                  }elsif (m/^http://s[0-9].filesonic.com/download/([0-9])/(.*)/) {
                          print $x . "http://www.filesonic.com.SQUIDINTERNAL/" . $1 . "\n";

                  #4shared
                  }elsif (m/^http://[a-zA-Z]{2}\d*.4shared.com(:8080|)/download/(.)/(...)?./) {
                          print $x . "http://www.4shared.com.SQUIDINTERNAL/download/$2/$3\n";

                  #4shared preview
                  }elsif (m/^http://[a-zA-Z]{2}\d*.4shared.com(:8080|)/img/(\d*)/\w*/dlink__2Fdownload_2F(\w*)_3Ftsid_3D[\w-]/preview.mp3?sId=\w/) {
                          print $x . "http://www.4shared.com.SQUIDINTERNAL/$2\n";

                  #photos-X.ak.fbcdn.net where X a-z
                  }elsif (m/^http://photos-a-z(/./)(..jpg)/) {
                          print $x . "http://photos" . $1 . "/" . $2 . $3  . "\n";

                  #YX.sphotos.ak.fbcdn.net where X 1-9, Y a-z
                  } elsif (m/^http://[a-z][0-9].sphotos.ak.fbcdn.net/(.)/(.)/) {
                  print $x . "http://photos.ak.fbcdn.net/" . $1  ."/". $2 . "\n";

                  #maps.google.com
                  } elsif (m/^http://(cbk|mt|khm|mlt|tbn)[0-9]?(.google.co(m|.uk|.id).*)/) {
                          print $x . "http://" . $1  . $2 . "\n";

                  # compatibility for old cached get_video?video_id
                  } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
                          $z = $2; $z =~ s/video_id=/get_video?video_id=/;
                          print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

                  youtube fix

                  } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com)/videoplayback?(.)/) {
                          $p_str = $2;
                  $tag = "";
                  $alg = "";
                  $id = "";
                  $range = "";
                  if ($p_str =~ m/(itag=[0-9])/){$tag = "&".$1}
                  if ($p_str =~ m/(algorithm=[a-z]                  -[a-z])/){$alg = "&".$1}
                  if ($p_str =~ m/(id=[a-zA-Z0-9]                  )/){$id = "&".$1}
                  if ($p_str =~ m/(range=[0-9-]*)/){$range = "&".$1; $range =~ s/-//; $range =~ s/range=//; }
                  print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $tag . "&" . $alg . "&" . $id . "&" . $range . "\n";

                  } elsif (m/^http://www.google-analytics.com/__utm.gif?.*/) {
                          print $x . "http://www.google-analytics.com/__utm.gif\n";

                  #Cache High Latency Ads
                  } elsif (m/^http://([a-z0-9.])(.doubleclick.net|.quantserve.com|.googlesyndication.com|yieldmanager|cpxinteractive)(.)/) {
                          $y = $3;$z = $2;
                          for ($y) {
                          s/pixel;./pixel/;
                          s/activity;.                  /activity/;
                          s/(imgad[^&])./\1/;
                          s/;ord=[?0-9]//;
                          s/;×tamp=[0-9]                  //;
                          s/[&?]correlator=[0-9]//;
                          s/&cookie=[^&]                  //;
                          s/&ga_hid=[^&]//;
                          s/&ga_vid=[^&]                  //;
                          s/&ga_sid=[^&]//;
                          # s/&prev_slotnames=[^&]                  //
                          # s/&u_his=[^&]//;
                          s/&dt=[^&]                  //;
                          s/&dtd=[^&]//;
                          s/&lmt=[^&]                  //;
                          s/(&alternate_ad_url=http%3A%2F%2F[^(%2F)])[^&]/\1/;
                          s/(&url=http%3A%2F%2F[^(%2F)])[^&]/\1/;
                          s/(&ref=http%3A%2F%2F[^(%2F)])[^&]/\1/;
                          s/(&cookie=http%3A%2F%2F[^(%2F)])[^&]/\1/;
                          s/[;&?]ord=[?0-9]//;
                          s/[;&]mpvid=[^&;]                  //;
                          s/&xpc=[^&]//;
                          # yieldmanager
                          s/?clickTag=[^&]                  //;
                          s/&u=[^&]//;
                          s/&slotname=[^&]                  //;
                          s/&page_slots=[^&]*//;
                          }
                          print $x . "http://" . $1 . $2 . $y . "\n";

                  #cache high latency ads
                  } elsif (m/^http://(.?)/(ads)?(.?)/) {
                          print $x . "http://" . $1 . "/" . $2  . "\n";

                  # spicific servers starts here….
                  } elsif (m/^http://(www.ziddu.com..[^/]{3,4})/(.?)/) {
                          print $x . "http://" . $1 . "\n";

                  #cdn, varialble 1st path
                  } elsif (($u =~ /filehippo/) && (m/^http://(.?).(.?)/(.?)/(.).([a-z0-9]{3,4})(?.*)?/)) {
                          @y = ($1,$2,$4,$5);
                          $y[0] =~ s/[a-z0-9]{2,5}/cdn./;
                          print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                  #rapidshare
                  } elsif (($u =~ /rapidshare/) && (m/^http://(([A-Za-z]+[0-9-.]+)?)([a-z].[^/]{3}/[a-z]/[0-9])/(.*?)/([^/?&]{4,})$/)) {
                          print $x . "http://cdn." . $3 . "/SQUIDINTERNAL/" . $5 . "\n";

                  } elsif (($u =~ /maxporn/) && (m/^http://([^/]?)/(.?)/([^/]?)(?.)?$/)) {
                          print $x . "http://" . $1 . "/SQUIDINTERNAL/" . $3 . "\n";

                  #like porn hub variables url and center part of the path, filename etention 3 or 4 with or without ? at the end
                  } elsif (($u =~ /tube8|pornhub|xvideos/) && (m/^http://(([A-Za-z]+[0-9-.]+)?(.[a-z])?).([a-z][0-9]?.[^/]{3}/[a-z])(.?)((/[a-z])?(/[^/]){4}.[^/?]{3,4})(?.)?$/)) {
                          print $x . "http://cdn." . $4 . $6 . "\n";
                                          #…spicific servers end here.

                  #photos-X.ak.fbcdn.net where X a-z
                  } elsif (m/^http://photos-[a-z].ak.fbcdn.net/(.*)/) {
                          print $x . "http://photos.ak.fbcdn.net/" . $1  . "\n";

                  #for yimg.com video
                  } elsif (m/^http://(.yimg.com)//(.)/([^/?&]/[^/?&].[^/?&]{3,4})(?.*)?$/) {
                          print $x . "http://cdn.yimg.com//" . $3 . "\n";

                  #for yimg.com doubled
                  } elsif (m/^http://(.?).yimg.com/(.?).yimg.com/(.?)?(.)/) {
                          print $x . "http://cdn.yimg.com/"  . $3 . "\n";

                  #for yimg.com with &sig=
                  } elsif (m/^http://(.?).yimg.com/(.)/) {
                          @y = ($1,$2);
                          $y[0] =~ s/[a-z]+[0-9]+/cdn/;
                          $y[1] =~ s/&sig=.*//;
                          print $x . "http://" . $y[0] . ".yimg.com/"  . $y[1] . "\n";

                  #youjizz. We use only domain and filename
                  } elsif (($u =~ /media[0-9]{2,5}.youjizz/) && (m/^http://(.)(.[^.-]?..?)/(.)/([^/?&]).([^/?&]{3,4})((?|%).)?$/)) {
                          @y = ($1,$2,$4,$5);
                          $y[0] =~ s/(([a-zA-A]+[0-9]+(-[a-zA-Z])?$)|(.cdn.)|(.cache.))/cdn/;
                          print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                  #general purpose for cdn servers. add above your specific servers.
                  } elsif (m/^http://([0-9.]?)//(.?).(.)?(.?)/) {
                          print $x . "http://squid-cdn-url//" . $2  . "." . $3 . "\n";

                  #generic http://variable.domain.com/path/filename."ex" "ext" or "exte" with or withour "? or %"
                  } elsif (m/^http://(.)(.[^.-]?..?)/(.).([^/?&]{2,4})((?|%).*)?$/) {
                          @y = ($1,$2,$3,$4);
                          $y[0] =~ s/(([a-zA-A]+[0-9]+(-[a-zA-Z])?$)|(.cdn.)|(.cache.))/cdn/;
                          print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                  # generic http://variable.domain.com/…
                  } elsif (m/^http://(([A-Za-z]+[0-9-]+)?|.cdn.|.cache.).(.?).(.?)/(.)$/) {
                          print $x . "http://cdn." . $3 . "." . $4 . "/" . $5 .  "\n";

                  # spicific extention that ends with ?
                  } elsif (m/^http://(.?)/(.?).(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|on2)(.*)/) {
                          print $x . "http://" . $1 . "/" . $2  . "." . $3 . "\n";

                  # all that ends with ;
                  } elsif (m/^http://(.?)/(.?);(.*)/) {
                          print $x . "http://" . $1 . "/" . $2  . "\n";

                  } else {
                          print $x . $_ . "sucks\n";
                  }
                  }

                  1 Reply Last reply Reply Quote 0
                  • P
                    poscom
                    last edited by

                    sip lah.. semua ada di forum ini tinggal test.. ada yg cepet ada yg lambat youtubenya, (storeurl, refresh, include/tunning) perhatikan 3 file ini..

                    1 Reply Last reply Reply Quote 0
                    • E
                      eyditharen
                      last edited by

                      Dah di coba semua blom ada satu pun store url yg bisa nge hit cache youtube untuk sekarang, tolong para master berkenan sharing di sini

                      1 Reply Last reply Reply Quote 0
                      • P
                        pfz
                        last edited by

                        Pfsense versi ?
                        Conf squid ?
                        Rules ?
                        Paste sini

                        Barangkali nanti ada yg mengkoreksi nya .

                        1 Reply Last reply Reply Quote 0
                        • E
                          eyditharen
                          last edited by

                          Pfsense : 2.0.2-RELEASE (amd64)

                          STore Url :

                          #!/usr/bin/perl

                          $Rev$

                          by chudy_fernandez@yahoo.com

                          Youtube updates at http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube/Discussion

                          $|=1;
                          while (<>) {
                              @X = split;

                          $X[1] =~ s/&sig=.*//;

                          $x = $X[0] . " ";
                          $_ = $X[1];
                          $u = $X[1];

                          #photos-X.ak.fbcdn.net where X a-z
                          if (m/^http://photos-[a-z]?(.ak.fbcdn.net.*)/) {
                          print $x . "http://photos" . $1  . "\n";

                          #maps.google.com
                          } elsif (m/^http://(khm|mt)[0-9]?(.google.com.*)/) {
                          print $x . "http://" . $1  . $2 . "\n";

                          compatibility for old cached get_video?video_id

                          } elsif (m/^http://([0-9.]{4}|..youtube.com|..googlevideo.com|..video.google.com).?(videoplayback?id=.?|video_id=.?)&(.*?)/) {
                          $z = $2; $z =~ s/video_id=/get_video?video_id=/;
                          print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

                          youtube All itag (semua resolusi)

                          } elsif ($X[1] =~ /(youtube|google).*videoplayback?/){
                                  @itag = m/&?/;
                                  @id = m/&?/;
                                  @range = m/&?/;
                                  print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/@itag&@id&@range\n";

                          End youtube All itag (semua resolusi)

                          } elsif (m/^http://www.google-analytics.com/__utm.gif?.*/) {
                          print $x . "http://www.google-analytics.com/__utm.gif\n";

                          #Cache High Latency Ads
                          } elsif (m/^http://([a-z0-9.])(.doubleclick.net|.quantserve.com|.googlesyndication.com|yieldmanager|cpxinteractive)(.)/) {
                          $y = $3;$z = $2;
                          for ($y) {
                          s/pixel;./pixel/;
                          s/activity;.                          /activity/;
                          s/(imgad[^&])./\1/;
                          s/;ord=[?0-9]//;
                          s/;×tamp=[0-9]                          //;
                          s/[&?]correlator=[0-9]//;
                          s/&cookie=[^&]                          //;
                          s/&ga_hid=[^&]//;
                          s/&ga_vid=[^&]                          //;
                          s/&ga_sid=[^&]*//;

                          s/&prev_slotnames=[^&]*//

                          s/&u_his=[^&]*//;

                          s/&dt=[^&]//;
                          s/&dtd=[^&]                          //;
                          s/&lmt=[^&]//;
                          s/(&alternate_ad_url=http%3A%2F%2F[^(%2F)]                          )[^&]/\1/;
                          s/(&url=http%3A%2F%2F[^(%2F)]                          )[^&]/\1/;
                          s/(&ref=http%3A%2F%2F[^(%2F)]                          )[^&]/\1/;
                          s/(&cookie=http%3A%2F%2F[^(%2F)]                          )[^&]/\1/;
                          s/[;&?]ord=[?0-9]                          //;
                          s/[;&]mpvid=[^&;]//;
                          s/&xpc=[^&]                          //;

                          yieldmanager

                          s/?clickTag=[^&]//;
                          s/&u=[^&]                          //;
                          s/&slotname=[^&]//;
                          s/&page_slots=[^&]                          //;
                          }
                          print $x . "http://" . $1 . $2 . $y . "\n";

                          #cache high latency ads
                          } elsif (m/^http://(.?)/(ads)?(.?)/) {
                          print $x . "http://" . $1 . "/" . $2  . "\n";

                          } elsif (m/^http://(www.ziddu.com..[^/]{3,4})/(.?)/) {
                          print $x . "http://" . $1 . "\n";

                          #cdn, varialble 1st path
                          } elsif (($u =~ /filehippo/) && (m/^http://(.?).(.?)/(.?)/(.).([a-z0-9]{3,4})(?.*)?/)) {
                          @y = ($1,$2,$4,$5);
                          $y[0] =~ s/[a-z0-9]{2,5}/cdn./;
                          print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                          #rapidshare
                          } elsif (($u =~ /rapidshare/) && (m/^http://(([A-Za-z]+[0-9-.]+)?)([a-z].[^/]{3}/[a-z]/[0-9])/(.*?)/([^/?&]{4,})$/)) {
                          print $x . "http://cdn." . $3 . "/SQUIDINTERNAL/" . $5 . "\n";

                          } elsif (($u =~ /maxporn/) && (m/^http://([^/]?)/(.?)/([^/]?)(?.)?$/)) {
                          print $x . "http://" . $1 . "/SQUIDINTERNAL/" . $3 . "\n";

                          #domain/path/./path/filename
                          } elsif (($u =~ /fucktube/) && (m/^http://(.                          ?)(.[^.-]?[^/]/[^/])/(.)/([^/])/([^/?&]).([^/?&]{3,4})(?.*?)$/)) {
                          @y = ($1,$2,$4,$5,$6);
                          $y[0] =~ s/(([a-zA-A]+[0-9]+(-[a-zA-Z])?$)|([^.]cdn[^.])|([^.]cache[^.]))/cdn/;
                          print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "/" . $y[3] . "." . $y[4] . "\n";

                          #like porn hub variables url and center part of the path, filename etention 3 or 4 with or without ? at the end
                          } elsif (($u =~ /tube8|pornhub|xvideos/) && (m/^http://(([A-Za-z]+[0-9-.]+)?(.[a-z])?).([a-z][0-9]?.[^/]{3}/[a-z])(.?)((/[a-z])?(/[^/]){4}.[^/?]{3,4})(?.)?$/)) {
                          print $x . "http://cdn." . $4 . $6 . "\n";

                          #for yimg.com video
                          } elsif (m/^http://(.yimg.com)//(.)/([^/?&]/[^/?&].[^/?&]{3,4})(?.*)?$/) {
                          print $x . "http://cdn.yimg.com//" . $3 . "\n";

                          #for yimg.com doubled
                          } elsif (m/^http://(.?).yimg.com/(.?).yimg.com/(.?)?(.)/) {
                          print $x . "http://cdn.yimg.com/"  . $3 . "\n";

                          #for yimg.com with &sig=
                          } elsif (m/^http://([^.]).yimg.com/(.)/) {
                          @y = ($1,$2);
                          $y[0] =~ s/[a-z]+([0-9]+)?/cdn/;
                          $y[1] =~ s/&sig=.*//;
                          print $x . "http://" . $y[0] . ".yimg.com/"  . $y[1] . "\n";

                          #youjizz. We use only domain and filename
                          } elsif (($u =~ /media[0-9]{1,5}.youjizz/) && (m/^http://(.?)(.[^.-]?.[^/])/(.)/([^/?&]).([^/?&]{3,4})(?.?)$/)) {
                          @y = ($1,$2,$4,$5);
                          $y[0] =~ s/(([a-zA-A]+[0-9]+(-[a-zA-Z])?$)|([^.]cdn[^.])|([^.]cache[^.]))/cdn/;
                          print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                          #general purpose for cdn servers. add above your specific servers.
                          } elsif (m/^http://([0-9.]?)//(.?).(.)?(.?)/) {
                          print $x . "http://squid-cdn-url//" . $2  . "." . $3 . "\n";

                          spicific extention

                          } elsif (m/^http://(.?).(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|wmv|3gp|mp(4|3)|exe|msi|zip|on2|mar|swf).?/) {

                          @y = ($1,$2);

                          $y[0] =~ s/((cache|cdn)[-\d])|([a-zA-A]+-?[0-9]+(-[a-zA-Z])?)/cdn/;

                          print $x . "http://" . $y[0] . "." . $y[1] . "\n";

                          #generic http://variable.domain.com/path/filename."ex", "ext" or "exte"
                          #http://cdn1-28.projectplaylist.com
                          #http://s1sdlod041.bcst.cdn.s1s.yimg.com
                          } elsif (m/^http://(.?)(.[^.-]?..?)/([^?&=]).([\w\d]{2,4})??.$/) {
                          @y = ($1,$2,$3,$4);
                          $y[0] =~ s/([a-z][0-9][a-z]dlod[\d]{3})|((cache|cdn)[-\d]                          )|([a-zA-A]+-?[0-9]+(-[a-zA-Z]*)?)/cdn/;
                          print $x . "storeurl://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

                          all that ends with ;

                          } elsif (m/^http://(.?)/(.?);(.*)/) {
                          print $x . "http://" . $1 . "/" . $2  . "\n";

                          } else {
                          print $x . $_ . "\n";
                          }
                          }

                          include Conf :

                          Custom Option Caching Video

                          acl videocache_allow_url url_regex -i .youtube.com/get_video?
                          acl videocache_allow_url url_regex -i .youtube.com/videoplayback .youtube.com/videoplay .youtube.com/get_video?
                          acl videocache_allow_url url_regex -i .youtube.[a-z][a-z]/videoplayback .youtube.[a-z][a-z]/videoplay .youtube.[a-z][a-z]/get_video?
                          acl videocache_allow_url url_regex -i .googlevideo.com/videoplayback .googlevideo.com/videoplay .googlevideo.com/get_video?
                          acl videocache_allow_url url_regex -i .google.com/videoplayback .google.com/videoplay .google.com/get_video?
                          acl videocache_allow_url url_regex -i .google.[a-z][a-z]/videoplayback .google.[a-z][a-z]/videoplay .google.[a-z][a-z]/get_video?
                          acl videocache_allow_url url_regex -i proxy[a-z0-9-][a-z0-9][a-z0-9][a-z0-9]?.dailymotion.com/
                          acl videocache_allow_url url_regex -i vid.akm.dailymotion.com/
                          acl videocache_allow_url url_regex -i [a-z0-9][0-9a-z][0-9a-z]?[0-9a-z]?[0-9a-z]?.xtube.com/(.)flv
                          acl videocache_allow_url url_regex -i .vimeo.com/(.                          ).(flv|mp4)
                          acl videocache_allow_url url_regex -i va.wrzuta.pl/wa[0-9][0-9][0-9][0-9]?
                          acl videocache_allow_url url_regex -i .youporn.com/(.).flv
                          acl videocache_allow_url url_regex -i .msn.com.edgesuite.net/(.                          ).flv
                          acl videocache_allow_url url_regex -i .tube8.com/(.).(flv|3gp)
                          acl videocache_allow_url url_regex -i .mais.uol.com.br/(.                          ).flv
                          acl videocache_allow_url url_regex -i .blip.tv/(.).(flv|avi|mov|mp3|m4v|mp4|wmv|rm|ram|m4v)
                          acl videocache_allow_url url_regex -i .apniisp.com/(.                          ).(flv|avi|mov|mp3|m4v|mp4|wmv|rm|ram|m4v)
                          acl videocache_allow_url url_regex -i .break.com/(.).(flv|mp4)
                          acl videocache_allow_url url_regex -i redtube.com/(.                          ).flv
                          acl videocache_allow_dom dstdomain .mccont.com .metacafe.com .cdn.dailymotion.com
                          acl videocache_deny_dom  dstdomain .download.youporn.com .static.blip.tv
                          acl dontrewrite url_regex redbot.org .php
                          acl getmethod method GET
                          storeurl_access deny dontrewrite
                          storeurl_access deny !getmethod
                          storeurl_access deny videocache_deny_dom
                          storeurl_access allow videocache_allow_url
                          storeurl_access allow videocache_allow_dom
                          storeurl_access deny all

                          End Custom Option Caching Video

                          Custom Option storeurl

                          storeurl_rewrite_program /usr/local/etc/squid/storeurl.pl
                          storeurl_rewrite_children 7
                          storeurl_rewrite_concurrency 10
                          negative ttl 0 seconds

                          End Custom Option storeurl

                          acl snmppublic snmp_community public
                          cachemgr_passwd none config reconfigure

                          #work around for fragment videos of msn
                          acl msnvideo url_regex QualityLevel.*Fragment
                          http_access deny msnvideo

                          #always_direct allow html
                          #cache_peer localhost parent 4001 0 carp login=PASS name=backend-1
                          max_stale 10 years

                          include /usr/local/etc/squid/refresh.conf

                          #acl shoutcast rep_header X-HTTP09-First-Line ^ICY.[0-9]
                          #upgrade_http0.9 deny shoutcast
                          acl apache rep_header Server ^Apache
                          broken_vary_encoding allow apache

                          #read_ahead_gap 0 KB

                          #ie_refresh on
                          reload_into_ims on

                          strip_query_terms off
                          deny_info TCP_RESET localnet
                          negative_dns_ttl 1 second
                          negative_ttl 1 second
                          snmp_port 3401
                          snmp_access allow snmppublic all
                          maximum_single_addr_tries 2
                          retry_on_error on
                          n_aiops_threads 64
                          #request_header_max_size 128 KB
                          #reply_header_max_size 128 KB
                          #range_offset_limit 10 MB
                          vary_ignore_expire on
                          #client_db off # this needs to be on for acl maxconn to work
                          ipcache_size 4096
                          fqdncache_size 20
                          #tcp_recv_bufsize 64 KB
                          pipeline_prefetch on
                          #half_closed_clients off

                          0x10 no delay, 0x08 throughput, 0x04 reliability

                          0x10      10000    (minimize delay)          Use delay metric

                          0x08      01000    (maximize throughput)      Use default metric

                          0x04      00100    (maximize reliability)    Use reliability metric

                          0x02      00010    (minimize monetary cost)  Use cost metric

                          dscp squidtos+ECN

                          56 0xE0 11100000

                          48 0xc0 11000000

                          08 0x20 00100000

                          32 0x80 10000000

                          16 0x40 01000000

                          #tcp_outgoing_tos 0x03 video
                          #tcp_outgoing_tos 0xb8 html
                          #tcp_outgoing_tos 0x20 images
                          #tcp_outgoing_tos 0x02 all

                          #zph_mode tos
                          #zph_local 0xb8
                          #zph_parent 0x08

                          #acl monitor url_regex avira
                          #logformat chudy %ts.%03tu %6tr %>a %Ss/%03Hs %<st %rm="" %ru="" %mt="" http%rv="" rq[%="">h] Rp[%<h]<br>#access_log /var/squid/log/access2.log chudy monitor

                          #buffered_logs on
                          #download_fastest_client_speed on
                          #acl text rep_header Content-Type -i text/
                          #acl hit rep_header X-Cache -i hit
                          #acl partial rep_header Content-Range .*
                          #log_access deny partial
                          #log_access deny php
                          #log_access deny text
                          #log_access deny hit
                          #log_access deny html
                          #log_access deny !getmethod
                          high_page_fault_warning 50
                          #log_access deny manager

                          Custom Option Youtube non-range (utuh)

                          quick_abort_min -1 KB
                          acl ytrange url_regex ^.*youtube.com/videoplayback.range=.$
                          http_access deny ytrange

                          End Custom Option Youtube non-range (utuh)

                          refresh Conf :

                          $Rev$

                          chudy_fernandez@yahoo.com

                          1 year = 525600 mins, 1 month = 43800 mins

                          refresh_pattern (get_video|videoplayback|videodownload|.flv).(begin|start)=[1-9][0-9] 0 0% 0
                          refresh_pattern imeem..flv 0 0% 0 override-lastmod override-expire
                          refresh_pattern ^ftp: 40320 20% 40320 override-expire reload-into-ims store-stale
                          refresh_pattern ^gopher: 1440 0% 1440
                          refresh_pattern code.googlec.com.                          (svn|download) 0 50% 1440 reload-into-ims

                          #ads
                          refresh_pattern ^.(streamate.doublepimp.com..js?|utm.gif|ads?|rmxads.com|ad.z5x.net|bh.contextweb.com|bstats.adbrite.com|a1.interclick.com|ad.trafficmp.com|ads.cubics.com|ad.xtendmedia.com|.googlesyndication.com|advertising.com|yieldmanager|game-advertising.com|pixel.quantserve.com|adperium.com|doubleclick.net|adserving.cpxinteractive.com|syndication.com|media.fastclick.net).* 5259487 20% 5259487 ignore-no-cache ignore-no-store ignore-private override-expire ignore-reload ignore-auth ignore-must-revalidate store-stale negative-ttl=40320 max-stale=1440

                          #antivirus
                          refresh_pattern avast.com..vpx 40320 50% 161280 store-stale reload-into-ims
                          refresh_pattern (avgate|avira).                          .(idx|gz)$ 1440 90% 1440 ignore-reload ignore-no-cache ignore-no-store store-stale ignore-must-revalidate
                          refresh_pattern kaspersky..avc$ 5259487 999999% 5259487 ignore-reload store-stale
                          refresh_pattern kaspersky 1440 50% 161280 ignore-no-cache store-stale
                          refresh_pattern mbamupdates.com.                          .ref 1440 50% 161280 reload-into-ims store-stale

                          #specific sites
                          refresh_pattern .rapidshare./[0-9]/./[^/] 161280 90% 161280 ignore-reload store-stale
                          refresh_pattern (get_video?|videoplayback?|videodownload?|.flv?|.fid?) 5259487 99999999% 5259487 override-expire ignore-reload store-stale ignore-private negative-ttl=0
                          refresh_pattern .(ico|video-stats) 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache ignore-no-store ignore-private ignore-auth override-lastmod ignore-must-revalidate negative-ttl=10080 store-stale
                          refresh_pattern .etology? 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache store-stale
                          refresh_pattern galleries.video(?|sz) 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache store-stale
                          refresh_pattern brazzers? 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache store-stale
                          refresh_pattern .adtology? 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache store-stale
                          refresh_pattern ^.safebrowsing.google 5259487 999999% 5259487 override-expire ignore-reload ignore-no-cache ignore-no-store ignore-private ignore-auth ignore-must-revalidate negative-ttl=10080 store-stale
                          refresh_pattern ^http://((cbk|mt|khm|mlt)[0-9]?).google.co(m|.uk) 5259487 999999% 5259487 override-expire ignore-reload store-stale ignore-private negative-ttl=10080
                          refresh_pattern ytimg.com.                          .(jpg|png) 5259487 999999% 5259487 override-expire ignore-reload store-stale
                          refresh_pattern images.friendster.com.                          .(png|gif) 5259487 999999% 5259487 override-expire ignore-reload store-stale
                          refresh_pattern ((facebook.com)|(85.131.151.39))..(png|gif) 5259487 999999% 5259487 override-expire ignore-reload store-stale
                          refresh_pattern garena.com 5259487 999999% 5259487 override-expire reload-into-ims store-stale
                          refresh_pattern photobucket.                          .(jp(e?g|e|2)|tiff?|bmp|gif|png) 5259487 999999% 5259487 override-expire ignore-reload store-stale
                          refresh_pattern vid.akm.dailymotion.com..on2? 5259487 999999% 5259487 ignore-no-cache override-expire override-lastmod store-stale
                          refresh_pattern .fbcdn.net.                          .(jpg|gif|png) 5259487 999999% 5259487 ignore-no-cache override-expire ignore-reload store-stale negative-ttl=0
                          refresh_pattern ^http://images|pics|thumbs[0-9]. 5259487 999999% 5259487 ignore-no-cache ignore-no-store ignore-reload override-expire store-stale
                          refresh_pattern ^http://www.onemanga.com./ 5259487 999999% 5259487 reload-into-ims override-expire store-stale
                          refresh_pattern mediafire.com/images.                          .(jp(e?g|e|2)|tiff?|bmp|gif|png) 5259487 999999% 5259487 reload-into-ims override-expire ignore-private store-stale

                          #general
                          refresh_pattern .(jp(e?g|e|2)|tiff?|bmp|gif|png) 5259487 999999% 5259487 ignore-no-cache ignore-no-store reload-into-ims override-expire ignore-must-revalidate store-stale
                          refresh_pattern .(z(ip|[0-9]{2})|r(ar|[0-9]{2})|jar|bz2|gz|tar|rpm|vpu) 5259487 999999% 5259487 override-expire reload-into-ims
                          refresh_pattern .(mp3|wav|og(g|a)|flac|midi?|rm|aac|wma|mka|ape) 5259487 999999% 5259487 override-expire reload-into-ims ignore-reload
                          refresh_pattern .(exe|msi|dmg|bin|xpi|iso|swf|mar|psf|cab) 5259487 999999% 5259487 override-expire reload-into-ims ignore-no-cache ignore-must-revalidate
                          refresh_pattern .(mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|wmv|m\dv|rv|vob|asx|ogm|flv|3gp|on2) 5259487 9999999% 5259487 override-expire reload-into-ims
                          refresh_pattern -i (cgi-bin) 0 0% 0
                          refresh_pattern .(php|jsp|cgi|asx)? 0 0% 0
                          refresh_pattern . 0 50% 161280 store-stale

                          Mohon bantuan Pada Master sekalian …</h]<br></st>

                          1 Reply Last reply Reply Quote 0
                          • P
                            pfz
                            last edited by

                            Include.conf
                            Refresh.conf
                            Storeurl.pl diatas saya coba test berjalan. Youtube tercache.

                            Nah.. Seandainya belum tercache coba di cek
                            Squid.conf ?
                            Firewall rules ?

                            1 Reply Last reply Reply Quote 0
                            • N
                              ngraseh
                              last edited by

                              mau nanya gan proxy tadinya baik aja bisa hit youtube, sejak kemaren tiap buka youtube yang keluar klip yang sama…???
                              trs saya rubah storeurl.pl dari chudy_fernandez@yahoo.com defoult youtube g bisa cache???
                              dan itu terjadi pada yang lain dengan masalah yang sama minta solusi gan??
                              apa bener youtube lg update system???
                              maklum nuwbie..................

                              1 Reply Last reply Reply Quote 0
                              • S
                                serangku
                                last edited by

                                repot deh kalo maenan dengan youtube2 an …

                                kembali ke konsep awal lagi saja, sembari ngarepin koneksi broadband di kita terus membaik.
                                after all ... emang jadi tantangan tersendiri dan kepuasan tersendiri juga ngoprek untuk terus2 an berusaha HIT
                                pasti akan sampe pada titik boring deh ...

                                keep explore, happy oprek ...

                                1 Reply Last reply Reply Quote 0
                                • R
                                  reezq665
                                  last edited by

                                  @serangku:

                                  repot deh kalo maenan dengan youtube2 an …

                                  kembali ke konsep awal lagi saja, sembari ngarepin koneksi broadband di kita terus membaik.
                                  after all ... emang jadi tantangan tersendiri dan kepuasan tersendiri juga ngoprek untuk terus2 an berusaha HIT
                                  pasti akan sampe pada titik boring deh ...

                                  keep explore, happy oprek ...

                                  Om Serangku, ada clue dari Om Syaifuddin JW….
                                  Mudah2an bisa diterapkan di Pfsense....

                                  di U***** server:
                                  build squid dengan opsi "–enable-referer-log"
                                  lalu install paket pendukungnya
                                  apt-get install libfile-readbackwards-perl

                                  squid config
                                  referer_log /var/log/squid/referer.log

                                  storeurl.pl (revisi untuk youtube yg sudah ada)

                                  kode pastebin http://pastebin.com/TGLBtZ5Z

                                  dan bagian akhir file  tambahkan ini

                                  sub GetID{
                                  use File::ReadBackwards;
                                  my $ref_log = File::ReadBackwards->new('/var/log/squid/referer.log');
                                  while (defined($line = $ref_log->readline)){
                                  if ($line =~ m/.youtube./watch?.v=([a-zA-Z0-9-_]).*\s.id=$IDS[0]./){
                                  $id = $1;
                                  last;
                                  }
                                  if ($line =~ m/.youtube./ptracking.cpn=$CPN[0].video_id=([a-zA-Z0-9-_])./){
                                  $id = $1;
                                  last;
                                  }
                                  if ($line =~ m/.youtube./ptracking.video_id=([a-zA-Z0-9-_]).cpn=$CPN[0]./){
                                  $id = $1;
                                  last;
                                  }
                                  }
                                  $ref_log->close();
                                  return $id;
                                  }

                                  Menunggu pencerahan dari Om Master2 PFSENSE….berharap mode on

                                  1 Reply Last reply Reply Quote 0
                                  • N
                                    ngraseh
                                    last edited by

                                    ikut nunggu ah…....... :o :o :o :o

                                    1 Reply Last reply Reply Quote 0
                                    • H
                                      herymulyo
                                      last edited by

                                      SIAPKAN KOPI PANAS BUAT PARA MASTER….. :o :o :o :o

                                      1 Reply Last reply Reply Quote 0
                                      • O
                                        olop99
                                        last edited by

                                        hasilnya bagaimana dengan storeurl ini mas…??

                                        ada yang bisa share

                                        terus yang ane tanyakan koq ane lihat link ini http://pastebin.com/TGLBtZ5Z katanya "Private Paste ID: TGLBtZ5Z" padahal ane udah ada accountnya…

                                        apakah ane perlu minta izin ke yang punya klo ane harus minta izin ane dengan memohon minta dong dengan pemilik file ini supaya di bukakan lagi hak aksesnya..

                                        terima kasih

                                        1 Reply Last reply Reply Quote 0
                                        • B
                                          bato234
                                          last edited by

                                          mohon petunjuk master….(post diatas)  ;D

                                          1 Reply Last reply Reply Quote 0
                                          • H
                                            herymulyo
                                            last edited by

                                            refresh…............

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.