Lighttpd нужна помощь

dr.gopher

добился запуска скриптов (пришлось перл переустановить)
теперь при запуске "cd /usr/local/www/lightsquid/ && ./check-setup.pl"

1. какие пакеты устанавливали?
2. как устанавливали пакеты?
3. в связке с чем будет работать lightsquid?

whitekasper

у меня установлен сквид сквидгуард все настроено и работает.все пакеты как лайтсквид ставил из Package Manager

Version 2.0.1-RELEASE (i386)
built on Mon Dec 12 17:53:52 EST 2011
FreeBSD 8.1-RELEASE-p6

dr.gopher

@whitekasper:

у меня установлен сквид сквидгуард все настроено и работает.все пакеты как лайтсквид ставил из Package Manager

У меня, кроме ошибок перла с lightsquid ничего не случалось.
Попробуйте удалить пакет lightsquid, ребут, установить по новой.

Нажимали?
Refresh now
Refresh full

whitekasper

удалять пробывал и нажимал рефреш и все равно при заходе пишет ошибку "500 - Internal Server Error"
мой файл lightsquid.cfg

#!/usr/bin/perl

LightSquid Project 2004-2008 Sergey Erokhin aka ESL

This program is free software; you can redistribute it and/or

modify it under the terms of the GNU General Public License

as published by the Free Software Foundation; either version 2

of the License, or (at your option) any later version.

detail see in gnugpl.txt

-------------------- GLOBAL VARIABLES ---------------------------

#path to additional cfg files
$cfgpath = "/usr/local/etc/lightsquid";
#path to tpl folder
$tplpath = "/usr/local/www/lightsquid/tpl";
#path to lang folder
$langpath = "/usr/local/share/lightsquid/lang";
#path to report folder
$reportpath = "/var/lightsquid/report";
#path to access.log
$logpath = "/var/squid/log";
#path to ip2name folder
$ip2namepath = "/usr/local/libexec/lightsquid";

#path to lockfile ;-)
$lockpath =$reportpath;

#if lockfile older $maxlocktime second, remove old lock file.
$maxlocktime = 30*60;

#if 1 - lightparser generate some statistic
$debug = 0;
#if 1 - lightparser generate skip details, 2 ..., 3 ..., ....
$debug2 = 0;

-------------------- LightParser VARIABLES ---------------------------

#squid log type
#if native squid format (default squid, see in doc) - must be 0
#if EmulateHttpdLog ON - set 1
#digit - for speed optimization
#try it set to 1 if parser generate warning

#see also month2dec below !!!!

$squidlogtype = 0;

#if you want skip some sites from stat, example our local www server
#WARNING !!!, don't leave this variable empty !!!
#example, if you want skip LOCAL site, put it here
#WARNING2
#use '' instead of "" !!!!!!!!!!!

#$skipurl = 'zdd.com|192.168.1.|cnn.com';
$skipurl = "zzz.zzz";

#define sobroutine file for convertion from IP into name
#if you want skip some ip from log - return "SKIP THIS IP" ;-)
#detail see in ip2name folder,

$ip2name = "ip";;

#use for convert from Text to Dec convertion if EmualteHttpdLog format !!!!
#fix it if need
%month2dec = ( Jan => 1, Feb => 2, Mar => 3, Apr => 4, May => 5,Jun => 6,
Jul => 7, Aug => 8, Sep => 9, Oct => 10, Nov => 11,Dec => 12);

-------------------- Common (Parser & Web) VARIABLES ----------------------

#create & use time report statistic (logsize = logsize*2) ;-))
$timereport = 1;

-------------------- WEB VARIABLES ----------------------------------------

#language
#see lang folder (avaible: bg,eng,fr,hu,it,pt_br,ru,sp)
$lang = "ru";;

#html template name
#see template folder tpl/$templatename/
$templatename = "base";;
#$templatename ="ric";
#$templatename ="base.css";

#define type of decimal output
#fine 123456789 -> 123,456,789
#class 123456789 -> 117.7 G
$DecOutType="class";

define delimiter for thousands (in fine mode)

= " " -> 12 345 678

= "," -> 12,345,678

= "" -> 12345678

$decdelimiter = " ";

#if you dont need Group mode, do =0
$showgrouplink = 1;

#if not zero, groups look like "01. Group1", if zero - "Group1"
$showgroupid = 1;

#if you dont need oversize report , do =0
$showoversizelink = 1;

#show how many data user send to internet
$showputpost = 0;
#if putpost higer this variable (in percent), highlight it
$putpostwarninglevel =15;

#use or not .realname files
#.realname contain pair userid -> Full User Name
$userealname = 1;

#if url size exceed $bigfilelimit - add this file into report
$bigfilelimit = 210241024;

#user maximum size per day limit (oversize)
$perusertrafficlimit = 1010241024;

weekend display mode

both - select sunday & monday

monday - only monday

$weekendmode="both";

#how many site show in TopSites report
$topsiteslimit = 500;

#how many site show in user time report
$usertimelimit = 200;

#if you want user traffic GRAPHIC report, set it in 1
#WARNING !!!, need libgd, GD.PM & other external modules !!!
#please run check-setup.pl for check library !!!!
$graphreport = 0;

#higest value on graph report

for user month report (0.05*(...) = 50mb)

$graphmaxuser=0.05*(102410241024);

for all user month report (1.05*(...) = 1 Gb)

$graphmaxall =0.80*(102410241024);

#color scheme for GRAPHICs, avaible "orange","blue","green","yellow","brown","red"
$barcolor = "orange";;

#-------------------------------------------------------------------------- Group support

sub CreateGroupFile($) {
my $path=shift;

open Fi,"<$cfgpath/group.cfg";
open Fo,">$path/.group";
while (<fi>) {
print Fo $_;
}
close Fo;
close Fi;
}

#-------------------------------------------------------------------------- RealName support

sub CreateRealnameFile($) {
my $path=shift;

open Fi,"<$cfgpath/realname.cfg";
open Fo,">$path/.realname";
while (<fi>) {
print Fo $_;
}
close Fo;
close Fi;
}</fi></fi>

файл lighty-webConfigurator.conf

lighttpd configuration file

use a it as base for lighttpd 1.0.0 and above

############ Options you really have to take care of ####################

FreeBSD!

server.event-handler = "freebsd-kqueue"
server.network-backend = "writev"

modules to load

server.modules = (

"mod_access", "mod_accesslog", "mod_expire", "mod_compress", "mod_redirect",
"mod_fastcgi", "mod_cgi"
)

Unused modules

# "mod_setenv",
# "mod_rewrite",
# "mod_ssi",
# "mod_usertrack",
# "mod_expire",
# "mod_secdownload",
# "mod_rrdtool",
# "mod_auth",
# "mod_status",
# "mod_alias",
# "mod_proxy",
# "mod_simple_vhost",
# "mod_evhost",
# "mod_userdir",
# "mod_cgi",

server.max-keep-alive-requests = 15
server.max-keep-alive-idle = 30

a static document-root, for virtual-hosting take look at the

server.virtual-* options

server.document-root = "/usr/local/www/"

Maximum idle time with nothing being written (php downloading)

server.max-write-idle = 999

where to send error-messages to

server.errorlog = "/var/log/lighttpd.error.log"

files to check for if …/ is requested

server.indexfiles = ( "index.php", "index.html",
"index.htm", "default.htm" )

mimetype mapping

mimetype.assign = (
".pdf" => "application/pdf",
".sig" => "application/pgp-signature",
".spl" => "application/futuresplash",
".class" => "application/octet-stream",
".ps" => "application/postscript",
".torrent" => "application/x-bittorrent",
".dvi" => "application/x-dvi",
".gz" => "application/x-gzip",
".pac" => "application/x-ns-proxy-autoconfig",
".swf" => "application/x-shockwave-flash",
".tar.gz" => "application/x-tgz",
".tgz" => "application/x-tgz",
".tar" => "application/x-tar",
".zip" => "application/zip",
".mp3" => "audio/mpeg",
".m3u" => "audio/x-mpegurl",
".wma" => "audio/x-ms-wma",
".wax" => "audio/x-ms-wax",
".ogg" => "audio/x-wav",
".wav" => "audio/x-wav",
".gif" => "image/gif",
".jpg" => "image/jpeg",
".jpeg" => "image/jpeg",
".png" => "image/png",
".xbm" => "image/x-xbitmap",
".xpm" => "image/x-xpixmap",
".xwd" => "image/x-xwindowdump",
".css" => "text/css",
".html" => "text/html",
".htm" => "text/html",
".js" => "text/javascript",
".asc" => "text/plain",
".c" => "text/plain",
".conf" => "text/plain",
".text" => "text/plain",
".txt" => "text/plain",
".dtd" => "text/xml",
".xml" => "text/xml",
".mpeg" => "video/mpeg",
".mpg" => "video/mpeg",
".mov" => "video/quicktime",
".qt" => "video/quicktime",
".avi" => "video/x-msvideo",
".asf" => "video/x-ms-asf",
".asx" => "video/x-ms-asf",
".wmv" => "video/x-ms-wmv",
".bz2" => "application/x-bzip",
".tbz" => "application/x-bzip-compressed-tar",
".tar.bz2" => "application/x-bzip-compressed-tar"
)

Use the "Content-Type" extended attribute to obtain mime type if possible

#mimetypes.use-xattr = "enable"

accesslog module

#accesslog.filename = "/dev/null"

deny access the file-extensions

~ is for backupfiles from vi, emacs, joe, ...

.inc is often used for code includes which should in general not be part

# of the document-root
url.access-deny = ( "~", ".inc" )

######### Options that are good to be but not neccesary to be changed #######

bind to port (default: 80)

server.port = 8080

error-handler for status 404

#server.error-handler-404 = "/error-handler.html"
#server.error-handler-404 = "/error-handler.php"

to help the rc.scripts

server.pid-file = "/var/run/lighty-webConfigurator.pid"

virtual directory listings

server.dir-listing = "disable"

enable debugging

debug.log-request-header = "disable"
debug.log-response-header = "disable"
debug.log-request-handling = "disable"
debug.log-file-not-found = "disable"

gzip compression

compress.cache-dir = "/tmp/lighttpdcompress/"
compress.filetype = ("text/plain","text/css", "text/xml", "text/javascript" )

server.upload-dirs = ( "/root/", "/tmp/", "/var/" )

server.max-request-size = 2097152

fastcgi module

read fastcgi.txt for more info

fastcgi.server = ( ".php" =>
( "localhost" =>
(
"socket" => "/tmp/php-fastcgi.socket",
"min-procs" => 0,
"max-procs" => 2,
"bin-environment" => (
"PHP_FCGI_CHILDREN" => "2",
"PHP_FCGI_MAX_REQUESTS" => "500"
),
"bin-path" => "/usr/local/bin/php"
)
)
)

CGI module

alias.url+=("/lightsquid/" => "/usr/local/www/lightsquid/")
index-file.names = ( "index.php", "index.html",
"index.htm", "default.htm", "index.cgi" )

static-file.exclude-extensions = ( ".php", ".pl", ".fcgi", ".cgi" )

cgi.assign = (
".pl" => "/usr/bin/perl",
".cgi" => "/usr/bin/perl"
)

файл php.ini

; File generated from /etc/rc.php_ini_setup
output_buffering = "0"
expose_php = Off
implicit_flush = true
magic_quotes_gpc = Off
max_execution_time = 99999999
max_input_time = 99999999
set_time_limit = 0
register_argc_argv = On
file_uploads = On
upload_tmp_dir = /tmp
upload_max_filesize = 100M
post_max_size = 100M
html_errors = Off
zlib.output_compression = Off
zlib.output_compression_level = 1
include_path = ".:/etc/inc:/usr/local/www:/usr/local/captiveportal:/usr/local/pkg"
;display_startup_errors=off
;display_errors=off
log_errors=on
error_log=/tmp/PHP_errors.log
extension_dir=/usr/local/lib/php/20060613/

; Extensions

extension=apc.so
extension=curl.so
extension=gettext.so
extension=ldap.so
extension=openssl.so
extension=pcntl.so
extension=mhash.so
extension=posix.so
extension=readline.so
extension=session.so
extension=suhosin.so
extension=ctype.so
extension=xml.so
extension=xmlreader.so
extension=xmlwriter.so
extension=simplexml.so
extension=mbstring.so
extension=shmop.so
extension=zlib.so
extension=spl.so
extension=pdo.so
extension=sqlite.so
extension=zmq.so
extension=ssh2.so
extension=pfSense.so

; APC Settings
apc.enabled="1"
apc.enable_cli="0"
apc.shm_size="35M"

[suhosin]
suhosin.get.max_array_depth = 5000
suhosin.get.max_array_index_length = 256
suhosin.get.max_vars = 5000
suhosin.get.max_value_length = 500000
suhosin.post.max_array_depth = 5000
suhosin.post.max_array_index_length = 256
suhosin.post.max_vars = 5000
suhosin.post.max_value_length = 500000
suhosin.request.max_array_depth = 5000
suhosin.request.max_array_index_length = 256
suhosin.request.max_vars = 5000
suhosin.request.max_value_length = 500000
suhosin.memory_limit = 512435456
cgi.fix_pathinfo = 1 #я добавил

уточню что ребутаю lighttpd через команды:
killall lighttpd
/usr/local/sbin/lighttpd -f /var/etc/lighty-webConfigurator.conf

вот скрин запуска …pl

whitekasper

сейчас пробую :
"/usr/local/www/lightsquid/lightparser.pl"
ответ:
Warning, /var/lightsquid/report/lockfile exist, maybe anoter process running !
LockPID : 880
tsdelta : 557 second(s) (maxlocktime: 1800)

dr.gopher

@whitekasper:

сейчас пробую :
"/usr/local/www/lightsquid/lightparser.pl"

Возможно у вас большой лог сквида и lightsquid-у нужно время для обработки. А времени вы не даете.
До тех пор пока lightsquid не обработает весь лог сквида, отчеты работать не будут.

whitekasper

спасибо.попробую.
у меня лог и вправду очень большой так как я не ставил его чистить.а сквид уже почти месяц работает)

dvserg

Можно "/usr/local/www/lightsquid/lightparser.pl today" - отлупит только за сегодня.

whitekasper

а как мне безболезнено начать с чистого файла логов а действующий переименовать?

dvserg

@whitekasper:

а как мне безболезнено начать с чистого файла логов а действующий переименовать?

Выполнить squid -k rotate потом переименовать все файлы логов с 0 1 2 3 в расширении. Сам access.log не трогать.

whitekasper

выполнилась у меня команда /usr/local/www/lightsquid/lightparser.pl today
но все равно при заходе на lightsquid Reports пишет ошибку 500 - Internal Server Error

dvserg

@whitekasper:

выполнилась у меня команда /usr/local/www/lightsquid/lightparser.pl today
но все равно при заходе на lightsquid Reports пишет ошибку 500 - Internal Server Error

Доступ к ГУИ сделайте HTTP/80 порт.

whitekasper

все!спасибо огромное.у меня все получилось после очистки файлов логов.и ошибка пропала и открывает статистику.
еще раз большое спасибо за помощь. я новичок в этом деле.

whitekasper

Теперь займусь присваиванием имен к IP адресам и уберу себя в статистике)

whitekasper

подскажите.
а возможно удалить все логи определенного ip (не спрятать, а очистить файл логов)

странность наблюдается.добавлял в скип ip вчера и из отчетов убирался данный пользователь.потом удалил, сегодня снова добавил несколько ip и все равно в отчета они отображаются

dvserg

@whitekasper:

подскажите.
а возможно удалить все логи определенного ip (не спрятать, а очистить файл логов)

Вручную можно :)

whitekasper

@dvserg:

@whitekasper:

подскажите.
а возможно удалить все логи определенного ip (не спрятать, а очистить файл логов)

Вручную можно :)

ок=)
а что по поводу игнора скипюзров?
файл скипюзер.cfg:

#sample comment
sampleuser
SKIP THIS IP
192.168.0.159
192.168.0.100
192.168.0.204

whitekasper

я что то не могу найти в каких конфигах или еще где прописано обращения к файлу skipuser.cfg

dvserg

@whitekasper:

я что то не могу найти в каких конфигах или еще где прописано обращения к файлу skipuser.cfg

Это должно быть в конфиге Лайтсквида, но в GUI этого не предусмотрено. Нужно править PHP скрипт чтобы добавлял туда нужную строку.

whitekasper

так ведь все роаботало, ни чего не менял, кроме того что создал группы присвоил IP адресам имена.и произвел сначало добавления исключения(все заработало)потом удалил и уже при следущем добавление оно не сработало. выкладываю конфик lightsquid.cfg:

#!/usr/bin/perl

LightSquid Project 2004-2008 Sergey Erokhin aka ESL

This program is free software; you can redistribute it and/or

modify it under the terms of the GNU General Public License

as published by the Free Software Foundation; either version 2

of the License, or (at your option) any later version.

detail see in gnugpl.txt

-------------------- GLOBAL VARIABLES ---------------------------

#path to additional cfg files
$cfgpath = "/usr/local/etc/lightsquid";
#path to tpl folder
$tplpath = "/usr/local/www/lightsquid/tpl";
#path to lang folder
$langpath = "/usr/local/share/lightsquid/lang";
#path to report folder
$reportpath = "/var/lightsquid/report";
#path to access.log
$logpath = "/var/squid/log";
#path to ip2name folder
$ip2namepath = "/usr/local/libexec/lightsquid";

#path to lockfile ;-)
$lockpath =$reportpath;

#if lockfile older $maxlocktime second, remove old lock file.
$maxlocktime = 30*60;

#if 1 - lightparser generate some statistic
$debug = 0;
#if 1 - lightparser generate skip details, 2 ..., 3 ..., ....
$debug2 = 0;

-------------------- LightParser VARIABLES ---------------------------

#squid log type
#if native squid format (default squid, see in doc) - must be 0
#if EmulateHttpdLog ON - set 1
#digit - for speed optimization
#try it set to 1 if parser generate warning

#see also month2dec below !!!!

$squidlogtype = 0;

#if you want skip some sites from stat, example our local www server
#WARNING !!!, don't leave this variable empty !!!
#example, if you want skip LOCAL site, put it here
#WARNING2
#use '' instead of "" !!!!!!!!!!!

#$skipurl = 'zdd.com|192.168.1.|cnn.com';
$skipurl = "192.168.0.200";;

#define sobroutine file for convertion from IP into name
#if you want skip some ip from log - return "SKIP THIS IP" ;-)
#detail see in ip2name folder,

$ip2name = "ip";;

#use for convert from Text to Dec convertion if EmualteHttpdLog format !!!!
#fix it if need
%month2dec = ( Jan => 1, Feb => 2, Mar => 3, Apr => 4, May => 5,Jun => 6,
Jul => 7, Aug => 8, Sep => 9, Oct => 10, Nov => 11,Dec => 12);

-------------------- Common (Parser & Web) VARIABLES ----------------------

#create & use time report statistic (logsize = logsize*2) ;-))
$timereport = 1;

-------------------- WEB VARIABLES ----------------------------------------

#language
#see lang folder (avaible: bg,eng,fr,hu,it,pt_br,ru,sp)
$lang = "ru";;

#html template name
#see template folder tpl/$templatename/
$templatename = "base";;
#$templatename ="ric";
#$templatename ="base.css";

#define type of decimal output
#fine 123456789 -> 123,456,789
#class 123456789 -> 117.7 G
$DecOutType="class";

define delimiter for thousands (in fine mode)

= " " -> 12 345 678

= "," -> 12,345,678

= "" -> 12345678

$decdelimiter = " ";

#if you dont need Group mode, do =0
$showgrouplink = 1;

#if not zero, groups look like "01. Group1", if zero - "Group1"
$showgroupid = 1;

#if you dont need oversize report , do =0
$showoversizelink = 1;

#show how many data user send to internet
$showputpost = 0;
#if putpost higer this variable (in percent), highlight it
$putpostwarninglevel =15;

#use or not .realname files
#.realname contain pair userid -> Full User Name
$userealname = 1;

#if url size exceed $bigfilelimit - add this file into report
$bigfilelimit = 210241024;

#user maximum size per day limit (oversize)
$perusertrafficlimit = 1010241024;

weekend display mode

both - select sunday & monday

monday - only monday

$weekendmode="both";

#how many site show in TopSites report
$topsiteslimit = 500;

#how many site show in user time report
$usertimelimit = 200;

#if you want user traffic GRAPHIC report, set it in 1
#WARNING !!!, need libgd, GD.PM & other external modules !!!
#please run check-setup.pl for check library !!!!
$graphreport = 0;

#higest value on graph report

for user month report (0.05*(...) = 50mb)

$graphmaxuser=0.05*(102410241024);

for all user month report (1.05*(...) = 1 Gb)

$graphmaxall =0.80*(102410241024);

#color scheme for GRAPHICs, avaible "orange","blue","green","yellow","brown","red"
$barcolor = "blue";;

#-------------------------------------------------------------------------- Group support

sub CreateGroupFile($) {
my $path=shift;

open Fi,"<$cfgpath/group.cfg";
open Fo,">$path/.group";
while (<fi>) {
print Fo $_;
}
close Fo;
close Fi;
}

#-------------------------------------------------------------------------- RealName support

sub CreateRealnameFile($) {
my $path=shift;

open Fi,"<$cfgpath/realname.cfg";
open Fo,">$path/.realname";
while (<fi>) {
print Fo $_;
}
close Fo;
close Fi;
}</fi></fi>

и еще был добавлен в "Skip url" адрес 192.168.0.200

Lighttpd нужна помощь

LightSquid Project 2004-2008 Sergey Erokhin aka ESL

This program is free software; you can redistribute it and/or

modify it under the terms of the GNU General Public License

as published by the Free Software Foundation; either version 2

of the License, or (at your option) any later version.

detail see in gnugpl.txt

-------------------- GLOBAL VARIABLES ---------------------------

-------------------- LightParser VARIABLES ---------------------------

-------------------- Common (Parser & Web) VARIABLES ----------------------

-------------------- WEB VARIABLES ----------------------------------------

define delimiter for thousands (in fine mode)

= " " -> 12 345 678

= "," -> 12,345,678

= "" -> 12345678

weekend display mode

both - select sunday & monday

monday - only monday

for user month report (0.05*(...) = 50mb)

for all user month report (1.05*(...) = 1 Gb)

lighttpd configuration file

use a it as base for lighttpd 1.0.0 and above

FreeBSD!

modules to load

Unused modules

a static document-root, for virtual-hosting take look at the

server.virtual-* options

Maximum idle time with nothing being written (php downloading)

where to send error-messages to

files to check for if …/ is requested

mimetype mapping

Use the "Content-Type" extended attribute to obtain mime type if possible

accesslog module

deny access the file-extensions

~ is for backupfiles from vi, emacs, joe, ...

.inc is often used for code includes which should in general not be part

bind to port (default: 80)

error-handler for status 404

to help the rc.scripts

virtual directory listings

enable debugging

gzip compression

fastcgi module

read fastcgi.txt for more info

CGI module

LightSquid Project 2004-2008 Sergey Erokhin aka ESL

This program is free software; you can redistribute it and/or

modify it under the terms of the GNU General Public License

as published by the Free Software Foundation; either version 2

of the License, or (at your option) any later version.

detail see in gnugpl.txt

-------------------- GLOBAL VARIABLES ---------------------------

-------------------- LightParser VARIABLES ---------------------------

-------------------- Common (Parser & Web) VARIABLES ----------------------

-------------------- WEB VARIABLES ----------------------------------------

define delimiter for thousands (in fine mode)

= " " -> 12 345 678

= "," -> 12,345,678

= "" -> 12345678

weekend display mode

both - select sunday & monday

monday - only monday

for user month report (0.05*(...) = 50mb)

for all user month report (1.05*(...) = 1 Gb)

define delimiter for thousands (in `fine` mode)

define delimiter for thousands (in `fine` mode)