Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Squidguard blacklist download not working 2.0-RC1

    Scheduled Pinned Locked Moved pfSense Packages
    23 Posts 8 Posters 28.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P
      probsd
      last edited by

      Hi Everyone,

      Please help!!! Ever since the update within squidguard where the blacklist was changed to it's own tab I have had the following issue. I just downloaded the latest PFSense 2.0 rc1 03/16/2011 and I just noticed when I go into Squidguard, enable blacklist, add the url "http://urlblacklist.com/cgi-bin/commercialdownload.pl?type=download&file=bigblacklist", click save then apply then go to the blacklist tab and click the download button nothing happens. I have waited over 15 minutes without navigating away from page and still nothing. If I paste the url into firefox or IE8 the file downloads fine just not though Squidguard. Does anyone have any ideas? PLEASE.

      Thank you,
      ProBSD

      Thank you,
      ProBSD

      1 Reply Last reply Reply Quote 0
      • D
        DigitalJer
        last edited by

        There are other lists you could try:

        http://www.squidguard.org/blacklists.html

        –------------------------------------------------
        2.4.3-RELEASE (amd64)
        built on Mon Mar 26 18:02:04 CDT 2018
        FreeBSD 11.1-RELEASE-p7
        VM in ESXi 5.5
        1 x 1000baseTX (WAN)
        1 x 1000baseTX (LAN)

        1 Reply Last reply Reply Quote 0
        • D
          djchem
          last edited by

          I am having exactly the same problem.  I subscribe to urlblacklist.com so really need to get this working.  I have successfully installed Shalla's list http://www.shallalist.de/Downloads/shallalist.tar.gz and the log window reported the download and installation successfully.  As ProBSD reported nothing seems to be happening with the urlblacklist url.

          Any ideas would be appreciated

          Thanks
          DJChem

          1 Reply Last reply Reply Quote 0
          • P
            probsd
            last edited by

            Hi DigitalJer,

            I also subscribe to urlblacklist.com, just as DJChem. I have tried many lists and have found the list provided by urlblacklist.com to be the most complete and accurate per category. I would appreciate any assistance you or anyone else can provide.

            Best regards,
            Rick Mullis

            Thank you,
            ProBSD

            1 Reply Last reply Reply Quote 0
            • N
              NegoroX
              last edited by

              not working blacklist in squidguard - help  :(

              1 Reply Last reply Reply Quote 0
              • D
                dvserg
                last edited by

                2 probsd
                With you url problem exists.
                You can download manually, copy to pfsense as /tmp/blacklist.tar.gz, and from GUI doenload from this path.

                2 NegoroX
                What are your problems?

                SquidGuardDoc EN  RU Tutorial
                Localization ru_PFSense

                1 Reply Last reply Reply Quote 0
                • N
                  NegoroX
                  last edited by

                  Download or put is /tmp/blacklist.tar.gz not a problem, and then nothing happens and there is no log ( tab log squidguard - it looks like the problem is the squidguard

                  1 Reply Last reply Reply Quote 0
                  • D
                    dvserg
                    last edited by

                    @NegoroX:

                    Download or put is /tmp/blacklist.tar.gz not a problem, and then nothing happens and there is no log ( tab log squidguard - it looks like the problem is the squidguard

                    After in Blacklist TAB enter /tmp/blacklist.tar.gz and press Download button.

                    Exists problem with URL's, what contains '? and &' symbols in the path.

                    SquidGuardDoc EN  RU Tutorial
                    Localization ru_PFSense

                    1 Reply Last reply Reply Quote 1
                    • P
                      probsd
                      last edited by

                      Thank you for the suggestion, however I have downloaded and copied bigblacklist.tar.gz to /tmp and entered /tmp/bigblacklist.tar.gz into the address field and when I click download, still, nothing happens. I have even tried to download the other packages and when i hit download nothing happens. i have waited for 15 mins in case it takes a while to decompress the gz file but still nothing. There is also nothing in any of the logs.

                      ProBSD

                      Thank you,
                      ProBSD

                      1 Reply Last reply Reply Quote 0
                      • D
                        dvserg
                        last edited by

                        @probsd:

                        Thank you for the suggestion, however I have downloaded and copied bigblacklist.tar.gz to /tmp and entered /tmp/bigblacklist.tar.gz into the address field and when I click download, still, nothing happens. I have even tried to download the other packages and when i hit download nothing happens. i have waited for 15 mins in case it takes a while to decompress the gz file but still nothing. There is also nothing in any of the logs.

                        ProBSD

                        Understandable :(. Have to wait for error correction

                        SquidGuardDoc EN  RU Tutorial
                        Localization ru_PFSense

                        1 Reply Last reply Reply Quote 0
                        • P
                          probsd
                          last edited by

                          Is there any way to manually decompress the gzip and put the folders into place so I can have the filter working?

                          ProBSD

                          Thank you,
                          ProBSD

                          1 Reply Last reply Reply Quote 0
                          • P
                            probsd
                            last edited by

                            I am close. I can extract the black list from URLBlacklist and copy to /var/db/squidGuard but as soon as I click apply in the gui the directory disappears and I can not get it to list the blacklists in the squidguard gui. There has to be something to point to it maybe from the config.xml or maybe I need to enter something into the database?

                            Any ideas????

                            Thank you,
                            ProBSD

                            Thank you,
                            ProBSD

                            1 Reply Last reply Reply Quote 0
                            • P
                              probsd
                              last edited by

                              Found this:

                              Initializing the blacklists –--
                              squidGuard -C all
                              chown -R proxy:proxy /var/db/squidGuard/*

                              But when i run this it deletes the contents of /var/db/squidGuard.

                              ProBSD

                              Thank you,
                              ProBSD

                              1 Reply Last reply Reply Quote 0
                              • P
                                probsd
                                last edited by

                                I got the manaul install for urlblacklist.com to work.

                                Download bigblacklist.tar.gz > copy to /var/tmp/ > in squidguard gui go to General tab and in Blacklist URL enter /var/tmp/bigblacklist.tar.gz > click save > go to Blacklist tab > click download, when "Blacklist update complete" appears at the bottom of window then go to Common ACL > click green arrow where it says "Target Rules List (click here)" and make the appropreiate changes > click save at bottom of page > go to General Tab and click apply. That's it. All works great. Now if maintainer can get SquidGuard to download from URLBlacklist directly we will be in great shape. And yes a setting to configure a background cron job to automatically download and update the blacklist at specified times would make this package fantastic!

                                ProBSD

                                Thank you,
                                ProBSD

                                1 Reply Last reply Reply Quote 0
                                • N
                                  NegoroX
                                  last edited by

                                  Yes! version pfSense-2.0-RC1-i386-20110317-0727.iso.gz  - blacklist work  :)

                                  1 Reply Last reply Reply Quote 0
                                  • P
                                    probsd
                                    last edited by

                                    I use the 64-bit version, but I will check tonight to see. Thanks for the heads up.

                                    ProBSD

                                    Thank you,
                                    ProBSD

                                    1 Reply Last reply Reply Quote 0
                                    • D
                                      DigitalJer
                                      last edited by

                                      @probsd:

                                      …a setting to configure a background cron job to automatically download and update the blacklist at specified times would make this package fantastic!

                                      Perhaps not such a capital idea.

                                      This blacklist, is, yes, comprehensive and effective.  HOWEVER it's also commercial.  Not free.  Pretty sure the maintainers don't mind a few downloads here and there, but regular downloads - as specified on their web page - are a subscription service.  You have to pay for downloading at one-week intervals.  Personally, I update it about once every six months (if that often), and even with that I'm considering tossing them a few $$.  Does me fine, and if you watch the logs, you'll see what I mean.

                                      I'd be careful to avoid drawing too much attention, aka hitting their download server at regular and frequent intervals - as they may tighten up their honour system and render it unavailable.  That would make me a sad panda.

                                      There are other freely available lists (mentioned earlier) that likely wouldn't care as much, as they don't expect a monetary return.

                                      Just some food for thought :)

                                      –------------------------------------------------
                                      2.4.3-RELEASE (amd64)
                                      built on Mon Mar 26 18:02:04 CDT 2018
                                      FreeBSD 11.1-RELEASE-p7
                                      VM in ESXi 5.5
                                      1 x 1000baseTX (WAN)
                                      1 x 1000baseTX (LAN)

                                      1 Reply Last reply Reply Quote 0
                                      • N
                                        NegoroX
                                        last edited by

                                        @DigitalJer:

                                        This blacklist, is, yes, comprehensive and effective.  HOWEVER it's also commercial.  Not free….....

                                        Ready blacklists for the lazy - I have created, analyzing the traffic of users. me free  ;D

                                        1 Reply Last reply Reply Quote 0
                                        • P
                                          probsd
                                          last edited by

                                          Even though I may only download and update once, sometimes twice a month, I do pay an annual fee for 2 downloads per week, for my home network. This way I know I can help support that project and it will continue. Just as the $100.00 annual donation I provide for PFSense/FreeBSD.

                                          I personally feel PFSense is the best firewall for home thru mid-size organizations, I don't have enterprise experience so I can't speak for that. I have it installed at about a dozen of my customer's locations including 2 police departments and 1 village hall. One police department is utilizing Squid and Squidguard with blacklists through captive portal and the chief regularly checks lightsquid to see where his employess navagate to. We have 3 LANs tied to his box using dual port server nics and it runs perfect. His original Sonicwall would only allow 7 Mbps and he just upgraded to a comcast cable internet with speed tests pushing 111Mbps so I put this in place and he loves it. He is now getting 93Mbps for his networks. Now that I can get his blacklist updated will have him sign up for urlblacklist too. If it were a scheduled cron job you could specify how often it should download and update as to not go beyond the subscription he chooses. I will have to manually update his as he would have a problem performing all of the steps.

                                          ProBSD

                                          Thank you,
                                          ProBSD

                                          1 Reply Last reply Reply Quote 0
                                          • D
                                            DigitalJer
                                            last edited by

                                            Most awesome!!  Great to see ppl supporting open source projects.

                                            Just had to do a quick morality check - nothing to see here, move along :)

                                            –------------------------------------------------
                                            2.4.3-RELEASE (amd64)
                                            built on Mon Mar 26 18:02:04 CDT 2018
                                            FreeBSD 11.1-RELEASE-p7
                                            VM in ESXi 5.5
                                            1 x 1000baseTX (WAN)
                                            1 x 1000baseTX (LAN)

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.