Lightsquid package Test



  • Lightsquid (squid report generator and analyser) - already in package list
    Please test him work:

    • install/deinstall
    • auto-update shedule
    • squid log rotate shedile

    ps:
    Now avialable only base and text cheme report.
    If test process success, i will add 2 new themes ;)



  • hi

    installed it last night, and a little confused how to use it, i keep getting this:

    LigthSquid diagnostic.
    Error : report folder '/var/lightsquid/report' not contain any valid data! Please run lightparser.pl (and check 'report' folder content)
    Please check config file !

    hadi57



  • @hadi57:

    hi

    installed it last night, and a little confused how to use it, i keep getting this:

    LigthSquid diagnostic.
    Error : report folder '/var/lightsquid/report' not contain any valid data! Please run lightparser.pl (and check 'report' folder content)
    Please check config file !

    hadi57

    This normal situation for firts installation. Click Refresh Key(full or now) on webGUI Package form
    ps i will add this notification



  • hi

    i did refresh still nothing there, i am still not sure what is package about, but i think it should give squid access report, any ways this is what i am still getting.

    LigthSquid diagnostic.
    Error : report folder '/var/lightsquid/report' not contain any valid data! Please run lightparser.pl (and check 'report' folder content)
    Please check config file !
    Variable value
    $tplpatph /usr/local/www/lightsquid/tpl
    $templatename base
    $langpatph /usr/local/share/lightsquid/lang
    $langname eng
    $reportpath /var/lightsquid/report
    Access to '/var/lightsquid/report' folder yes
    folder content:

    and following is my configuration:

    language: english
    bar color: orange
    report scheme: base
    ip resolve method (future): dns
    refresh scheduler: 10min
    squid rotate: every 1 day
    skip url: nothing is there

    i am using 1.2 beta-1 built on mon apr 30

    thanks

    hadi57



  • Have you ticked the "Enabled logging" option in the squid config page?

    On a side note, it would be nice to see the LightSquid page titled something different from the squid pages to make it easier to work out which is which (actually, I'd like to see it under "Status"->"Proxy Logs" or similar).

    Finally, one bug - with the "IP Resolve Method" at DNS the domain name gets appended to the resolved name, resulting in "hostname.local.local".



  • hi

    no i didn't, didnt know :)

    ill do it now

    hadi57



  • There is a bug in Webinterface integration.

    The menu Point has the same name as the proxy server.

    This is my machine:




  • Log store directory field must be /var/squid/log
    After - need begining work with squid (for create log)
    After - press Refresh button on lightsquid gui form

    • all problems must be solved

    All issues will analysed and corrected
    Also added new IP2Name variant's and change 1-2 settings for more quickly parser job in crontab and 'Refresh Now' button. After self-testing will sent to coreTeam  :)

    –------------
    must be name 'Proxy server report' - last word lost in this mode GIU
    Thanks - i'll change to short name



  • Its working well for me,

    Good job, well Done!

    Ben



  • hello.. it is really good job… It works fine for me...
    instalation without any problems...  ;D
    I have one question about squid log rotate scheduler. How it work? If I check rotate logs every 30 days that means the older logs will be overwritten? or archiving? I would like to keep my squid logs as long as it possible.
    I know there is the option to disable log rotate, but if I understand well, lightsquid will be parsing all long log file.

    :)



  • squid contains access.log file
    if rotate executed - squid create new access.log and old rename to access.log.0
    access.log->access.log0->access.log1 … ->access.log.9

    if you rotate monthly - you may have 10 mont's archive
    LightSquid parse by crontab task only access.log - it's NOW
    next step - i set parsing only today date for more speed

    By Refresh FULL - parsing ALL access.log.xx files



  • Ok..
    That's I expected….
    ;D
    many thanks



  • Great work.  I am ready to offer a commit to dvserg so that he can start taking care of these packages and get them added.



  • It would be interesting to see the Oversize Config flag
    at the Webinterface on Configuration Page.

    Curently ist just reporting all Users with mor than 10MB as
    Oversized:

    "Users who exceed 10.0 M bytes, per user quota"

    Can you tell us in which config file I can change this?



  • inconfig '/usr/local/etc/lightsquid/lightsquid.cfg' see variable

    #user maximum size per day limit (oversize)
    $perusertrafficlimit = 1010241024;

    but this change to firts webgui change.
    For forever change see and modify '/usr/local/etc/lightsquid/lightsquid.cfg.dist' (webgui take this as source)

    This option used only for reporting, but nothing to limit user quota
    Do you suggest include this option to the gui?



  • Even with no quota functionality it would be nice
    to be handled over the gui.

    Just for seeing who got traffic over a specific
    value in the report.

    Maybe you add it to the gui with the next
    release. Would be nice.

    Thanks so far and thit is an ecelent pakage.
    Maybe I spend some time for an german lang file
    in the next weeks to submit it to you.



  • Now i proccessing test of quote gui. Planing update on begining next week.
    About german lang

    • if this for gui, then need wite 1.3 release pfSense with multilang support
    • if for Lightsquid package - then sorry, i'm not author this, i only writer GUI and creator 2 templates. Author Sergey Erokhin http://lightsquid.sf.net, (but pls send me you file)


  • How add new themes
    Download http://diskatel.narod.ru/pfSense/packages/lightsquid_theme.zip
    Unpack and move 2 catalog's to '/usr/local/www/lightsquid/tpl'
    In gui this 2 themes now present



  • Updated installation new themes with transition to 'main report page' and pfSense GUI



  • hello, after last upgrade pf package stop working for me, I tried to reinstall package but reistall command stops after a while and nothing happned…

    Removing package…
    Loading package configuration lightsquid.xml...
    Loading package instructions...

    I do not know how to repair it…
    ???



  • @mbedyn:

    hello, after last upgrade pf package stop working for me, I tried to reinstall package but reistall command stops after a while and nothing happned…

    Removing package…
    Loading package configuration lightsquid.xml...
    Loading package instructions...

    I do not know how to repair it…
    ???

    Looking bottom page - any messages exists?



  • hi dvserg, thanks for great job, one question only, about logs, you have some plan to clear logs or what? like after some months clear olders, something that, and a big thank for this great addon for pfsense!

    Rafael



  • @rafael.cardoso:

    hi dvserg, thanks for great job, one question only, about logs, you have some plan to clear logs or what? like after some months clear olders, something that, and a big thank for this great addon for pfsense!
    Rafael

    GUI logs have fix size - 500 strings(if i have remeber) This isn't big size, but if this need - i can add option 'enable log', what 'if disabled' will empty log file (or delete - on you selection).

    And also you can setup 'rotate Squid log'. It depending on the number of users You must define rotation period. Squid have 10 rotating files 0>1>2>3>…>9 Current file, where rotating, maked 0, 0 maked 1 .. and all others shift to up. If you setup monthly rotation, then will have logs with last 10 month. If weekly - have statistic with last 10 week.

    Lightsquid not clearing his DB statistic, but this not need (I have not seen such issues )  
    You comment's?



  • @dvserg:

    Looking bottom page - any messages exists?

    You are right… there is a message at bottom

    Warning: delete_package(lightsquid.inc): failed to open stream: No such file or directory in /etc/inc/pkg-utils.inc on line 728 Fatal error: delete_package(): Failed opening required 'lightsquid.inc' (include_path='.:/etc/inc:/usr/local/www:/usr/local/captiveportal:/usr/local/pkg') in /etc/inc/pkg-utils.inc on line 728



  • Deleted pkg gui files 'lightsquid.xml' and 'lightsquid.inc'
    May be because of  unchancy installation
    Need manually put this to 'usr/local/pkg' directory and try once more.
    May be need try different deinstall and them install procedure (not reinstall)

    ps I don't test this on captive portal, but nothing 'magic' in package not presented.



  • With deinstall i got the same message… I do not use captive...??
    with reinstall GUI components i got

    Fatal error: Call to undefined function: lightsquid_deinstall() in /etc/inc/pkg-utils.inc(498) : eval()'d code on line 1



  • I can't say how package work with captive portal - need test. But you messages mean what broken or deleted .xml and .inc files of package. Did you plasing this files to '/usr/local/pkg/' catalog before try deleting? (need manually download from pfSense site
    http://www.pfsense.com/packages/config/lightsquid/lightsquid.inc
    http://www.pfsense.com/packages/config/lightsquid/lightsquid.xml)



  • hello
    I have put these files into the /usr/local/pkg
    Package works again but it seems to do not call crontab jobs for refresh. I have setting sheduler to refresh every 24 hour

    crontab file has proper entries, but nothing happend…
    Problems with theese starts just after I upgraded from 5-29 snapshot to 6-28.

    crontab

    0      */24    *      *      *      root    /usr/bin/perl /usr/local/www/lightsquid/lightparser.pl today
    0      0      */30    *      *      root    /usr/local/etc/squid /usr/local/sbin/squid -k rotate > /dev/null



  • @mbedyn:

    hello
    I have put these files into the /usr/local/pkg
    Package works again but it seems to do not call crontab jobs for refresh. I have setting sheduler to refresh every 24 hour

    crontab file has proper entries, but nothing happend…
    Problems with theese starts just after I upgraded from 5-29 snapshot to 6-28.

    crontab

    0       */24    *       *       *       root    /usr/bin/perl /usr/local/www/lightsquid/lightparser.pl today
    0       0       */30    *       *       root    /usr/local/etc/squid /usr/local/sbin/squid -k rotate > /dev/null

    Pls test short time period (hourly for example)



  • hello
    I have done some tests.. and shortest periods refresh correctly…
    :-\



  • @mbedyn:

    hello
    I have done some tests.. and shortest periods refresh correctly…
    :-\

    Fixed updateR 24h and 30 min options error.
    Please test.



  • I would like to, but I do not know how to reinstall the package… As I mentioned before, I have got errors when trying to reinstall the package..  ???

    I repaired package putting manually inc and xml files into /usr/local/pkg.



  • @mbedyn:

    I would like to, but I do not know how to reinstall the package… As I mentioned before, I have got errors when trying to reinstall the package..   ???

    I repaired package putting manually inc and xml files into /usr/local/pkg.

    This also good. Now i can't create captive for test install/deinstall. May be in current of month i do it.



  • BUG REPORT : After each reboot of pfsense

    
    Syncing packages: phpSysInfo nmap snort stunnel squid Lightsquid
    
    Beginning package installation for Lightsquid...
     9% 19% 30% 41% 51% 62% 73% 83% 94% 100%
    
    Installing Lightsquid and its dependencies.
     6% 13% 20% 27% 34% 42% 49% 56% 63% 70% 77% 85% 92% 99% 100% 6% 13% 21% 28% 36%
    43% 51% 58% 65% 73% 80% 88% 95% 100%
    
    Removing package...
    Removing Lightsquid components...
    
    Beginning package installation for Lightsquid...
     9% 19% 30% 41% 51% 62% 73% 83% 94% 100%
    
    Installing Lightsquid and its dependencies.
     2% 5% 8% 10% 13% 16% 18% 21% 23% 26% 29% 31% 34% 37% 39% 42% 45% 47% 50% 53% 55
    % 58% 61% 63% 66% 69% 71% 74% 77% 79% 82% 85% 87% 90% 93% 95% 98% 100% 6% 13% 20
    % 27% 34% 42% 49% 56% 63% 70% 77% 85% 92% 99% 100% 6% 13% 21% 28% 36% 43% 51% 58
    % 65% 73% 80% 88% 95% 100%
    
    

    I have this problem with fresh install with pfsense versions :
    1.2 beta 1
    1.2 beta 2
    1.2 RC1



  • Show the log entry from system logs.  It will say missing file blah blah.



  • I made a new install from ISO 1.2 RC1 built  Jul 21, but when I try to install Lightsquid I get this message:
    Downloading package configuration file… done.
    Saving updated package information... done.
    Downloading Lightsquid and its dependencies... done.
    Checking for successful package installation... failed!

    Installation aborted.

    Any idea,

    Thanks Alfredo



  • Hi to all,

    I've same problem with 1.2-TESTING-SNAPSHOT-07-21-2007

    Installing Lightsquid and its dependencies.

    Downloading package configuration file… done.
    Saving updated package information... done.
    Downloading Lightsquid and its dependencies... done.
    Checking for successful package installation... failed!

    Installation aborted.

    You have find a solution?  ???

    Thanks



  • Not,

    I still have the problem, could be a problem with the snapshot version?

    regards
    Alfredo



  • I have a problem with squidlogs not rotating, and I think it's because of a bad crontab entry.  Here is what it says:

    /usr/local/etc/squid /usr/local/sbin/squid -k rotate > /dev/null

    I believe it should say:
    /usr/local/sbin/squid -k rotate > /dev/null

    anyone have any thoughts?



  • I have the same problem ..

    Downloading package configuration file… done.
    Saving updated package information... done.
    Downloading Lightsquid and its dependencies... done.
    Checking for successful package installation... failed!

    Installation aborted.

    Version: 1.2-BETA-2
    built on Mon Jul 2 20:14:07 EDT 2007

    any ideas ? i will try to re-install the Squid and then i will try again with the Lightsquid i will let you know guys..


Log in to reply