Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Squidguard blacklist download not working 2.0-RC1

    Scheduled Pinned Locked Moved pfSense Packages
    23 Posts 8 Posters 28.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D
      djchem
      last edited by

      I am having exactly the same problem.  I subscribe to urlblacklist.com so really need to get this working.  I have successfully installed Shalla's list http://www.shallalist.de/Downloads/shallalist.tar.gz and the log window reported the download and installation successfully.  As ProBSD reported nothing seems to be happening with the urlblacklist url.

      Any ideas would be appreciated

      Thanks
      DJChem

      1 Reply Last reply Reply Quote 0
      • P
        probsd
        last edited by

        Hi DigitalJer,

        I also subscribe to urlblacklist.com, just as DJChem. I have tried many lists and have found the list provided by urlblacklist.com to be the most complete and accurate per category. I would appreciate any assistance you or anyone else can provide.

        Best regards,
        Rick Mullis

        Thank you,
        ProBSD

        1 Reply Last reply Reply Quote 0
        • N
          NegoroX
          last edited by

          not working blacklist in squidguard - help  :(

          1 Reply Last reply Reply Quote 0
          • D
            dvserg
            last edited by

            2 probsd
            With you url problem exists.
            You can download manually, copy to pfsense as /tmp/blacklist.tar.gz, and from GUI doenload from this path.

            2 NegoroX
            What are your problems?

            SquidGuardDoc EN  RU Tutorial
            Localization ru_PFSense

            1 Reply Last reply Reply Quote 0
            • N
              NegoroX
              last edited by

              Download or put is /tmp/blacklist.tar.gz not a problem, and then nothing happens and there is no log ( tab log squidguard - it looks like the problem is the squidguard

              1 Reply Last reply Reply Quote 0
              • D
                dvserg
                last edited by

                @NegoroX:

                Download or put is /tmp/blacklist.tar.gz not a problem, and then nothing happens and there is no log ( tab log squidguard - it looks like the problem is the squidguard

                After in Blacklist TAB enter /tmp/blacklist.tar.gz and press Download button.

                Exists problem with URL's, what contains '? and &' symbols in the path.

                SquidGuardDoc EN  RU Tutorial
                Localization ru_PFSense

                1 Reply Last reply Reply Quote 1
                • P
                  probsd
                  last edited by

                  Thank you for the suggestion, however I have downloaded and copied bigblacklist.tar.gz to /tmp and entered /tmp/bigblacklist.tar.gz into the address field and when I click download, still, nothing happens. I have even tried to download the other packages and when i hit download nothing happens. i have waited for 15 mins in case it takes a while to decompress the gz file but still nothing. There is also nothing in any of the logs.

                  ProBSD

                  Thank you,
                  ProBSD

                  1 Reply Last reply Reply Quote 0
                  • D
                    dvserg
                    last edited by

                    @probsd:

                    Thank you for the suggestion, however I have downloaded and copied bigblacklist.tar.gz to /tmp and entered /tmp/bigblacklist.tar.gz into the address field and when I click download, still, nothing happens. I have even tried to download the other packages and when i hit download nothing happens. i have waited for 15 mins in case it takes a while to decompress the gz file but still nothing. There is also nothing in any of the logs.

                    ProBSD

                    Understandable :(. Have to wait for error correction

                    SquidGuardDoc EN  RU Tutorial
                    Localization ru_PFSense

                    1 Reply Last reply Reply Quote 0
                    • P
                      probsd
                      last edited by

                      Is there any way to manually decompress the gzip and put the folders into place so I can have the filter working?

                      ProBSD

                      Thank you,
                      ProBSD

                      1 Reply Last reply Reply Quote 0
                      • P
                        probsd
                        last edited by

                        I am close. I can extract the black list from URLBlacklist and copy to /var/db/squidGuard but as soon as I click apply in the gui the directory disappears and I can not get it to list the blacklists in the squidguard gui. There has to be something to point to it maybe from the config.xml or maybe I need to enter something into the database?

                        Any ideas????

                        Thank you,
                        ProBSD

                        Thank you,
                        ProBSD

                        1 Reply Last reply Reply Quote 0
                        • P
                          probsd
                          last edited by

                          Found this:

                          Initializing the blacklists –--
                          squidGuard -C all
                          chown -R proxy:proxy /var/db/squidGuard/*

                          But when i run this it deletes the contents of /var/db/squidGuard.

                          ProBSD

                          Thank you,
                          ProBSD

                          1 Reply Last reply Reply Quote 0
                          • P
                            probsd
                            last edited by

                            I got the manaul install for urlblacklist.com to work.

                            Download bigblacklist.tar.gz > copy to /var/tmp/ > in squidguard gui go to General tab and in Blacklist URL enter /var/tmp/bigblacklist.tar.gz > click save > go to Blacklist tab > click download, when "Blacklist update complete" appears at the bottom of window then go to Common ACL > click green arrow where it says "Target Rules List (click here)" and make the appropreiate changes > click save at bottom of page > go to General Tab and click apply. That's it. All works great. Now if maintainer can get SquidGuard to download from URLBlacklist directly we will be in great shape. And yes a setting to configure a background cron job to automatically download and update the blacklist at specified times would make this package fantastic!

                            ProBSD

                            Thank you,
                            ProBSD

                            1 Reply Last reply Reply Quote 0
                            • N
                              NegoroX
                              last edited by

                              Yes! version pfSense-2.0-RC1-i386-20110317-0727.iso.gz  - blacklist work  :)

                              1 Reply Last reply Reply Quote 0
                              • P
                                probsd
                                last edited by

                                I use the 64-bit version, but I will check tonight to see. Thanks for the heads up.

                                ProBSD

                                Thank you,
                                ProBSD

                                1 Reply Last reply Reply Quote 0
                                • D
                                  DigitalJer
                                  last edited by

                                  @probsd:

                                  …a setting to configure a background cron job to automatically download and update the blacklist at specified times would make this package fantastic!

                                  Perhaps not such a capital idea.

                                  This blacklist, is, yes, comprehensive and effective.  HOWEVER it's also commercial.  Not free.  Pretty sure the maintainers don't mind a few downloads here and there, but regular downloads - as specified on their web page - are a subscription service.  You have to pay for downloading at one-week intervals.  Personally, I update it about once every six months (if that often), and even with that I'm considering tossing them a few $$.  Does me fine, and if you watch the logs, you'll see what I mean.

                                  I'd be careful to avoid drawing too much attention, aka hitting their download server at regular and frequent intervals - as they may tighten up their honour system and render it unavailable.  That would make me a sad panda.

                                  There are other freely available lists (mentioned earlier) that likely wouldn't care as much, as they don't expect a monetary return.

                                  Just some food for thought :)

                                  –------------------------------------------------
                                  2.4.3-RELEASE (amd64)
                                  built on Mon Mar 26 18:02:04 CDT 2018
                                  FreeBSD 11.1-RELEASE-p7
                                  VM in ESXi 5.5
                                  1 x 1000baseTX (WAN)
                                  1 x 1000baseTX (LAN)

                                  1 Reply Last reply Reply Quote 0
                                  • N
                                    NegoroX
                                    last edited by

                                    @DigitalJer:

                                    This blacklist, is, yes, comprehensive and effective.  HOWEVER it's also commercial.  Not free….....

                                    Ready blacklists for the lazy - I have created, analyzing the traffic of users. me free  ;D

                                    1 Reply Last reply Reply Quote 0
                                    • P
                                      probsd
                                      last edited by

                                      Even though I may only download and update once, sometimes twice a month, I do pay an annual fee for 2 downloads per week, for my home network. This way I know I can help support that project and it will continue. Just as the $100.00 annual donation I provide for PFSense/FreeBSD.

                                      I personally feel PFSense is the best firewall for home thru mid-size organizations, I don't have enterprise experience so I can't speak for that. I have it installed at about a dozen of my customer's locations including 2 police departments and 1 village hall. One police department is utilizing Squid and Squidguard with blacklists through captive portal and the chief regularly checks lightsquid to see where his employess navagate to. We have 3 LANs tied to his box using dual port server nics and it runs perfect. His original Sonicwall would only allow 7 Mbps and he just upgraded to a comcast cable internet with speed tests pushing 111Mbps so I put this in place and he loves it. He is now getting 93Mbps for his networks. Now that I can get his blacklist updated will have him sign up for urlblacklist too. If it were a scheduled cron job you could specify how often it should download and update as to not go beyond the subscription he chooses. I will have to manually update his as he would have a problem performing all of the steps.

                                      ProBSD

                                      Thank you,
                                      ProBSD

                                      1 Reply Last reply Reply Quote 0
                                      • D
                                        DigitalJer
                                        last edited by

                                        Most awesome!!  Great to see ppl supporting open source projects.

                                        Just had to do a quick morality check - nothing to see here, move along :)

                                        –------------------------------------------------
                                        2.4.3-RELEASE (amd64)
                                        built on Mon Mar 26 18:02:04 CDT 2018
                                        FreeBSD 11.1-RELEASE-p7
                                        VM in ESXi 5.5
                                        1 x 1000baseTX (WAN)
                                        1 x 1000baseTX (LAN)

                                        1 Reply Last reply Reply Quote 0
                                        • I
                                          irfanyildiz
                                          last edited by

                                          Hello from Turkiye !

                                          The problem is Microsoft Internet Explorer. It is working on Firefox !

                                          1 Reply Last reply Reply Quote 0
                                          • A
                                            amdamd
                                            last edited by

                                            this problems is IE, l change to use chrome, l solve this problems ;D

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.