Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Squid, SquidGuard, Lightsquid status on 2.3

    2.3-RC Snapshot Feedback and Issues - ARCHIVED
    14
    61
    40.6k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • jimpJ
      jimp Rebel Alliance Developer Netgate
      last edited by

      I fixed up some issues in the GUI for squid, squidGuard, and Lightsquid though some yet remain.

      • In squid, the monitor page has been converted to Bootstrap. The others pages are XML and do not need conversion, but there were some rendering issues with form field text that should be resolved in current snapshots.
      • In squidGaurd, the blacklist and log page to Bootstrap and I made a few other relevant adjustments to other items to be Bootstrap-friendly. Still could use some tweaks but it's generally functional at least. As with squid, there were some rendering issues that require being on a new snapshot to solve.
      • In lightsquid, there is less progress. The change to nginx introduces a problem here because lightsquid wants to use perl CGI, which nginx does not support, so we'll need to figure out how to best solve that. I fixed some rendering issues with the sqstat page but it also seems to have a more fundamental issue in that it doesn't seem to be properly polling squid.

      Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

      Need help fast? Netgate Global Support!

      Do not Chat/PM for help!

      1 Reply Last reply Reply Quote 0
      • jimpJ
        jimp Rebel Alliance Developer Netgate
        last edited by

        Looks like some of the changes aren't in the latest snap yet, but it should be up soon. In the meantime an update and then gitsync should do it.

        Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

        Need help fast? Netgate Global Support!

        Do not Chat/PM for help!

        1 Reply Last reply Reply Quote 0
        • J
          jwt Netgate
          last edited by

          @jimp:

          I fixed up some issues in the GUI for squid, squidGuard, and Lightsquid though some yet remain.

          • In squid, the monitor page has been converted to Bootstrap. The others pages are XML and do not need conversion, but there were some rendering issues with form field text that should be resolved in current snapshots.
          • In squidGaurd, the blacklist and log page to Bootstrap and I made a few other relevant adjustments to other items to be Bootstrap-friendly. Still could use some tweaks but it's generally functional at least. As with squid, there were some rendering issues that require being on a new snapshot to solve.
          • In lightsquid, there is less progress. The change to nginx introduces a problem here because lightsquid wants to use perl CGI, which nginx does not support, so we'll need to figure out how to best solve that. I fixed some rendering issues with the sqstat page but it also seems to have a more fundamental issue in that it doesn't seem to be properly polling squid.

          It' not clear to me that we need 3 packages for squid, but then, I'm not a squid fan.

          Given that we have nginx, and Lua why not just run the BSD licensed Ledge https://github.com/pintsized/ledge

          1 Reply Last reply Reply Quote 0
          • jimpJ
            jimp Rebel Alliance Developer Netgate
            last edited by

            Squid is the base proxy, squidGuard just does URL filtering in combination with squid (it is not itself a proxy) and lightsquid parses the logs to produce access reports.

            I'd love to see something native in nginx+lua but all I've seen so far with nginx+lua like Ledge or OpenResty is a reverse proxy (like haproxy, varnish, and the "squid-reverse" parts) but I haven't seen anything like a client forward proxy to arbitrary remote servers with access controls like squid+squidGuard does.

            Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

            Need help fast? Netgate Global Support!

            Do not Chat/PM for help!

            1 Reply Last reply Reply Quote 0
            • M
              maverick_slo
              last edited by

              Hi!
              Tested squid and it works (looks) great now.
              Lightsquid as you mentioned is useless right now.
              Reports are not working (cgi) realtime data also not working.

              Btw, will sarg be ported? Its handy for reports.

              1 Reply Last reply Reply Quote 0
              • jimpJ
                jimp Rebel Alliance Developer Netgate
                last edited by

                Sarg is unlikely to come back. It has been a huge source of trouble. It rarely works as expected and more often than not results in the reports filling up people's disks (either by size or by running it out of inodes with tons of tiny files). If it does come back, we'd need some assurance that the package has been improved sufficiently that it wouldn't be a source of problems.

                Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                Need help fast? Netgate Global Support!

                Do not Chat/PM for help!

                1 Reply Last reply Reply Quote 0
                • C
                  C0RR0SIVE
                  last edited by

                  SquidGuard isn't filtering, have the targets set like I normally would, have applied, have saved, have done everything, even custom blacklists are not working.

                  I have netflix on a blacklist, and traffic passes right through, nothing showing anywhere that SquidGuard isn't working, aside from it… not working...  Services shows it as running.

                  06dd81a22fb53fd22e8dfc8dc96ed63f.png
                  06dd81a22fb53fd22e8dfc8dc96ed63f.png_thumb
                  999.png
                  999.png_thumb
                  998.png
                  998.png_thumb

                  1 Reply Last reply Reply Quote 0
                  • jimpJ
                    jimp Rebel Alliance Developer Netgate
                    last edited by

                    Hmm, interesting. Granted I didn't try it extensively, it did filter for me. I got the error redirect page and all.

                    You might start a fresh thread for that. I was only focusing on the GUI issues. Someone else may have better insight on the backend part of the code.

                    Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                    Need help fast? Netgate Global Support!

                    Do not Chat/PM for help!

                    1 Reply Last reply Reply Quote 0
                    • jimpJ
                      jimp Rebel Alliance Developer Netgate
                      last edited by

                      @C0RR0SIVE:

                      SquidGuard isn't filtering, have the targets set like I normally would, have applied, have saved, have done everything, even custom blacklists are not working.

                      I have netflix on a blacklist, and traffic passes right through, nothing showing anywhere that SquidGuard isn't working, aside from it… not working...  Services shows it as running.

                      I think I found the problem here. Update the squidGuard package to version 1.12 when it comes out here in a few minutes and then try it again.

                      Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                      Need help fast? Netgate Global Support!

                      Do not Chat/PM for help!

                      1 Reply Last reply Reply Quote 0
                      • C
                        C0RR0SIVE
                        last edited by

                        I can confirm that SquidGuard v1.12 on the current version of 2.3 is working in terms of the target lists and blocking/whitelisting.

                        Only other thing I can personally see is just a slightly annoying issue while using the pfsense dark theme setting, when looking at the target rules, you get white text on an almost white bar for every other category.  Though, it seems the black one isn't the default :)

                        Thanks for all the hard work jimp!

                        1 Reply Last reply Reply Quote 0
                        • jimpJ
                          jimp Rebel Alliance Developer Netgate
                          last edited by

                          I fixed some more issues in squid today and have a few notes for those who may be upgrading from 2.2.x or earlier to 2.3 and having problems:

                          1. Make sure that the most current version of the squid package is loaded (>= 0.4.12)

                          2. Clean up leftover PBI messes:

                          find / -type l -print0 | xargs -0 ls -l | egrep '(squid|perl|pbi)'
                          

                          Remove any symlinks still pointing to PBI dirs, especially things like perl, lightsquid, perl5, etc.

                          For example:

                          lrwxr-xr-x  1 root   wheel  39 May  7  2015 /usr/bin/perl -> /usr/pbi/lightsquid-i386/local/bin/perl
                          lrwxr-xr-x  1 root   wheel  45 May  7  2015 /usr/local/etc/lightsquid -> /usr/pbi/lightsquid-i386/local/etc/lightsquid
                          lrwxr-xr-x  1 root   wheel  40 May  7  2015 /usr/local/lib/perl5 -> /usr/pbi/lightsquid-i386/local/lib/perl5
                          lrwxr-xr-x  1 root   wheel  45 Nov  5 10:32 /usr/local/www/lightsquid -> /usr/pbi/lightsquid-i386/local/www/lightsquid
                          

                          3. Blow away the cache:

                          mv /var/squid/cache /var/squid/cache.old
                          squid -z
                          rm -rf /var/squid/cache.old
                          

                          Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                          Need help fast? Netgate Global Support!

                          Do not Chat/PM for help!

                          1 Reply Last reply Reply Quote 0
                          • B
                            brianc69
                            last edited by

                            Coming from a Windows background I don't understand the pbi comment and symlinks. Any chance this fix can be automated?

                            1 Reply Last reply Reply Quote 0
                            • jimpJ
                              jimp Rebel Alliance Developer Netgate
                              last edited by

                              Not in the package. It fails before it gets to a point where the package can run any code.

                              Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                              Need help fast? Netgate Global Support!

                              Do not Chat/PM for help!

                              1 Reply Last reply Reply Quote 0
                              • rbgargaR
                                rbgarga Developer Netgate Administrator
                                last edited by

                                I've pushed a fix to make sure all symlinks pointing to /usr/pbi are removed when upgrade from 2.2 to 2.3. It'll be available on next snapshots

                                Renato Botelho

                                1 Reply Last reply Reply Quote 0
                                • jimpJ
                                  jimp Rebel Alliance Developer Netgate
                                  last edited by

                                  And if you're already on 2.3, you can use the command from that commit to clean up manually:

                                  find / -type l -lname '/usr/pbi/*' -delete
                                  

                                  Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                                  Need help fast? Netgate Global Support!

                                  Do not Chat/PM for help!

                                  1 Reply Last reply Reply Quote 0
                                  • M
                                    maverick_slo
                                    last edited by

                                    And I was just going to ask this :)

                                    1 Reply Last reply Reply Quote 0
                                    • W
                                      whitexp
                                      last edited by

                                      @jimp:

                                      I fixed some more issues in squid today and have a few notes for those who may be upgrading from 2.2.x or earlier to 2.3 and having problems:

                                      1. Make sure that the most current version of the squid package is loaded (>= 0.4.12)

                                      2. Clean up leftover PBI messes:

                                      find / -type l -print0 | xargs -0 ls -l | egrep '(squid|perl|pbi)'
                                      

                                      Remove any symlinks still pointing to PBI dirs, especially things like perl, lightsquid, perl5, etc.

                                      For example:

                                      lrwxr-xr-x  1 root   wheel  39 May  7  2015 /usr/bin/perl -> /usr/pbi/lightsquid-i386/local/bin/perl
                                      lrwxr-xr-x  1 root   wheel  45 May  7  2015 /usr/local/etc/lightsquid -> /usr/pbi/lightsquid-i386/local/etc/lightsquid
                                      lrwxr-xr-x  1 root   wheel  40 May  7  2015 /usr/local/lib/perl5 -> /usr/pbi/lightsquid-i386/local/lib/perl5
                                      lrwxr-xr-x  1 root   wheel  45 Nov  5 10:32 /usr/local/www/lightsquid -> /usr/pbi/lightsquid-i386/local/www/lightsquid
                                      

                                      3. Blow away the cache:

                                      mv /var/squid/cache /var/squid/cache.old
                                      squid -z
                                      rm -rf /var/squid/cache.old
                                      
                                      
                                      /pkg_edit.php: The command '/usr/local/sbin/squid -z -f /usr/local/etc/squid/squid.conf' returned exit code '1', the output was 'FATAL: getpwnam failed to find userid for effective user 'squid' Squid Cache (Version 3.5.12): Terminated abnormally. CPU Usage: 0.018 seconds = 0.018 user + 0.000 sys Maximum Resident Size: 50000 KB Page faults with physical i/o: 0'
                                      
                                      1 Reply Last reply Reply Quote 0
                                      • jimpJ
                                        jimp Rebel Alliance Developer Netgate
                                        last edited by

                                        That's a new one. Uninstall the package and install it again. The pkg code adds that user on install, or it's supposed to anyhow

                                        Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                                        Need help fast? Netgate Global Support!

                                        Do not Chat/PM for help!

                                        1 Reply Last reply Reply Quote 0
                                        • B
                                          brianc69
                                          last edited by

                                          It mostly worked for me. I was able to install freeradius but squid returned an error. Did you catch it in my other post?

                                          1 Reply Last reply Reply Quote 0
                                          • W
                                            whitexp
                                            last edited by

                                            @jimp:

                                            That's a new one. Uninstall the package and install it again. The pkg code adds that user on install, or it's supposed to anyhow

                                            work

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.