Lightsquid on pfSense 2.3 - Error with report folder?
-
Hello,
I just updated pfSense to version 2.3 and everything went fine. I had to wipe the local cache of Squid to get squid working properly again.
On version 2.2.6 I used SARG to create Squid reports. With version 2.3 the package is removed and as far as I understand Lightsquid has now taken over this job. That is why I installed lightsquid. I made the configuration on Status->Squid Proxy Reports according to the "necessary steps after install".
Afterwards I made a "refresh" and a "refresh full" but every time I click on "Open Lightsquid" it connects to the Lightsquid page but it displays following error:
LigthSquid diagnostic.
Error : report folder '/var/lightsquid/report' not contain any valid data! Please run lightparser.pl (and check 'report' folder content)
Please check config file !Variable value
$tplpatph /usr/local/www/lightsquid/tpl
$templatename base
$langpatph /usr/local/share/lightsquid/lang
$langname eng
$reportpath /var/lightsquid/report
Access to '/var/lightsquid/report' folder yes
$graphreport 1folder content:
How do I run lightparser.pl? The folder /var/lightsquid/report is indeed empty.
Access logging with squid is done in the folder: /var/squid/logs
So how do I fix Lightsquid?
-
From the lightsquid settings page did you click "Refresh full" or "Refresh now"? Either of those will run lightparser.pl (with different settings)
-
Hello jimp,
thanks for your quick answer. I did this several times and it refreshes the page without errors but when I check the content of the folder /var/lightsquid/report again it is still empty?
-
Is there any log data in squid's access log for it to read?
-
Yes, here is the list: (ls -l)
/var/squid/logs
total 162668
-rw-r–--- 1 squid proxy 164483767 Apr 13 21:38 access.log
-rw-r----- 1 squid proxy 1536291 Nov 16 22:09 access.log.0
-rw-r----- 1 squid proxy 54580 Nov 15 21:51 access.log.1
-rw-r----- 1 squid proxy 103515 Nov 14 22:05 access.log.2
-rw-r----- 1 squid proxy 110359 Apr 13 21:38 cache.log
-rw-r----- 1 squid proxy 58 Nov 16 00:00 cache.log.0
-rw-r----- 1 squid proxy 2223 Nov 15 21:25 cache.log.1
-rw-r----- 1 squid proxy 20944 Nov 14 21:50 cache.log.2
-rw-r----- 1 squid proxy 94805 Apr 13 19:47 netdb.stateI disabled rotation in squid because there were problems with SARG when using rotation that is why access.log.0 is that old.
I remember that I created some symlinks for SARG to work with version 2.2.6 but as far as I remember I set only some for some "squid-reports" folder. Could this be the problem? Or are there problems with the rights for the /var/lightsquid/report folder?
This is the result when I run "find / -type l -print0 | xargs -0 ls -l | egrep '(squid|perl|pbi)'" according to your reply #10 on this thread:
https://forum.pfsense.org/index.php?topic=105399.msg588219#msg588219
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-ae -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-bh -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-dz -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-eg -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-iq -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-jo -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-kw -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-lb -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-ly -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-ma -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-om -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-qa -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-sa -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-sy -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-tn -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ar-ye -> ar
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/az-az -> az
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/bg-bg -> bg
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/cs-cz -> cs
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/da-dk -> da
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/de-at -> de
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/de-ch -> de
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/de-de -> de
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/de-li -> de
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/de-lu -> de
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/el-gr -> el
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-au -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-bz -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-ca -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-gb -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-ie -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-in -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-jm -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-nz -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-ph -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-sg -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-tt -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-uk -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-us -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-za -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/en-zw -> en
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-ar -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-bo -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-cl -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-co -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-cr -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-do -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-ec -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-es -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-gt -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-hn -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-mx -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-ni -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-pa -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-pe -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-pr -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-py -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-sv -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-us -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-uy -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/es-ve -> es
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/et-ee -> et
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fa-fa -> fa
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fa-ir -> fa
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fi-fi -> fi
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fr-be -> fr
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fr-ca -> fr
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fr-ch -> fr
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fr-fr -> fr
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fr-lu -> fr
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/fr-mc -> fr
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/he-il -> he
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/hu-hu -> hu
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/hy-am -> hy
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/hy-armn -> hy
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/id-id -> id
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/it-ch -> it
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/it-it -> it
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ja-jp -> ja
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ka-ge -> ka
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ko-kp -> ko
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ko-kr -> ko
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/lt-lt -> lt
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/lv-lv -> lv
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ms-my -> ms
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/nl-nl -> nl
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/pl-pl -> pl
lrwxr-xr-x 1 root wheel 5 Apr 7 01:30 /usr/local/etc/squid/errors/pt-bz -> pt-br
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/pt-pt -> pt
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ro-md -> ro
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ro-ro -> ro
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/ru-ru -> ru
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/sk-sk -> sk
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/sl-si -> sl
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr -> sr-latn
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr-cyrl-cs -> sr-cyrl
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr-cyrl-me -> sr-cyrl
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr-cyrl-rs -> sr-cyrl
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr-latn-cs -> sr-latn
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr-latn-me -> sr-latn
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr-latn-rs -> sr-latn
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr-rs -> sr-cyrl
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/sr-sp -> sr-latn
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/sv-fi -> sv
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/sv-se -> sv
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/th-th -> th
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/tr-tr -> tr
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/uk-ua -> uk
lrwxr-xr-x 1 root wheel 2 Apr 7 01:30 /usr/local/etc/squid/errors/vi-vn -> vi
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-cn -> zh-hans
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-hans-cn -> zh-hans
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-hans-sg -> zh-hans
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-hant-hk -> zh-hant
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-hant-mo -> zh-hant
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-hant-tw -> zh-hant
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-hk -> zh-hant
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-mo -> zh-hant
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-sg -> zh-hans
lrwxr-xr-x 1 root wheel 7 Apr 7 01:30 /usr/local/etc/squid/errors/zh-tw -> zh-hant
lrwxr-xr-x 1 root wheel 17 Apr 7 01:00 /usr/local/lib/perl5/5.20/mach/CORE/libperl.so -> libperl.so.5.20.3
lrwxr-xr-x 1 root wheel 17 Apr 7 01:00 /usr/local/lib/perl5/5.20/mach/CORE/libperl.so.5.20 -> libperl.so.5.20.3
lrwxr-xr-x 1 root www 38 Apr 13 20:58 /usr/local/www/lightsquid/tpl/novopf -> /usr/local/share/lightsquid/tpl/novopf
lrwxr-xr-x 1 root www 39 Apr 13 20:58 /usr/local/www/lightsquid/tpl/novosea -> /usr/local/share/lightsquid/tpl/novosea
lrwxr-xr-x 1 root wheel 31 Apr 13 18:40 /var/cache/pkg/lightsquid-1.8_4.txz -> lightsquid-1.8_4-82e00c7a25.txz
lrwxr-xr-x 1 root wheel 45 Apr 13 18:40 /var/cache/pkg/pfSense-pkg-Lightsquid-3.0.3_1.txz -> pfSense-pkg-Lightsquid-3.0.3_1-b2ccca31fb.txz
lrwxr-xr-x 1 root wheel 41 Apr 13 18:16 /var/cache/pkg/pfSense-pkg-squid-0.4.16_1.txz -> pfSense-pkg-squid-0.4.16_1-e5a40f9152.txz
lrwxr-xr-x 1 root wheel 44 Apr 13 18:15 /var/cache/pkg/pfSense-pkg-squidGuard-1.14_1.txz -> pfSense-pkg-squidGuard-1.14_1-559258e230.txz
lrwxr-xr-x 1 root wheel 27 Apr 13 18:15 /var/cache/pkg/squid-3.5.16.txz -> squid-3.5.16-14f0b1b36e.txz
lrwxr-xr-x 1 root wheel 32 Apr 13 18:15 /var/cache/pkg/squidGuard-1.4_15.txz -> squidGuard-1.4_15-6afa53ebcd.txz
lrwxr-xr-x 1 root wheel 37 Apr 13 18:16 /var/cache/pkg/squid_radius_auth-1.10.txz -> squid_radius_auth-1.10-e0f21a7f63.txz
lrwxr-xr-x 1 root wheel 31 Apr 13 18:16 /var/cache/pkg/squidclamav-6.13.txz -> squidclamav-6.13-8308d91ced.txz -
That seems normal… Try running lightparser.pl from the shell manually, see if it yields an error.
-
I ran /usr/local/www/lightsquid/lightparser.pl without errors. Now there is data in the report folder of lightsquid and it displays the content on the lightsquid page.
Is there an error with the "refresh" buttons?
-
There wasn't last time I used it a couple days ago. Anything showing in the system log? No crash reports showing on the dashboard?
-
Where do I see crash reports on the dashboard? It does not show anything.
On Status->System Logs->System->General it does not show any errors.
When I visit a new website (www.test.com) via squid proxy and afterwards do a manually "refresh" with the button in the lightsquid page the report does not contain the new website so the refresh is not working!
-
Also make sure you use ctrl-F5 in the browser when reloading the lighttpd pages, they cache like crazy.
If you had a crash report waiting on the dashboard, you'd know it, it would be showing in a bar at the top of the page.
-
Ok, so there is no error on the top page.
I tried with Chrome instead of Safari but this does not change anything so I this should not be a browser problem.
When I refresh the lighttpd pages with ctrl+f5 it does not change anything, too.
-
Little update in my case:
As I found out the "Refresh Scheduler" that I have set is working without problems. The data of Lighttdp updated according to the time period I have set.
So only the "manual" refresh with the buttons provided is not working for me.
-
thanks for pinning down the problem.
I am on a fresh install, and had exactly the same problem. I reported it in the wrong forum (general discussion).
update:
the shell command works for me as well. but not the WUI buttons.
-
thanks for pinning down the problem.
I am on a fresh install, and had exactly the same problem. I reported it in the wrong forum (general discussion).
update:
the shell command works for me as well. but not the WUI buttons.
Same for me.
-
[SOLVED] pkg install -f perl5
In my case, I have blank page on Lightsquid report page aftter pfsense 2.3 update. I´ve tried uninstall lightsquid troubleshooting procedures https://doc.pfsense.org/index.php/Lightsquid_Troubleshooting but nothing, lightparser.pl show lib error.
/usr/local/bin/perl5 /usr/local/www/lightsquid/lightparser.pl
Shared object "libperl.so.5.20" not found, required by "perl5" -
I fix it the same problem with command prompt
/usr/local/bin/perl /usr/local/www/lightsquid/lightparser.pl
-
I found a problem with the refresh buttons, a new version with the fix should be out sometime today.
-
OK. I install update version.
But what are the correction?Squid RealTime stat always don't working
-
It was exactly as I stated: The lightsquid update fixed a problem with the Refresh and Refresh Full buttons not working. Squid real time is not a lightsquid issue. That belongs in another thread.
-
I fix it the same problem with command prompt
/usr/local/bin/perl /usr/local/www/lightsquid/lightparser.pl
When I try this command I receive an error command not found. There is no perl in /usr/local/bin only perl5 and if I execute
/usr/local/bin/perl /usr/local/www/lightsquid/lightparser.pl
Shared object "libperl.so.5.20" not found, required by "perl5"
