Lighttpd нужна помощь

dr.gopher

Проверяем конфиг Lightsquid'a
-Исполняем cd /usr/local/www/lightsquid/ && ./check-setup.pl
Если ошибок нет, увдим "all check passed, now try access to cgi part in browser"

Запускаем парсер squid логов

Исполняем /usr/local/www/lightsquid/lightparser.pl и ждем завершения
Открываем браузер и вводим http://ip pfSense/lightsquid/index.cgi

http://forum.pfsense.org/index.php/topic,21394.0.html
http://thin.kiev.ua/router-os/50-pfsense/495–http-squid-lightsquid-pfsense-20.html

whitekasper

у меня при вводе "cd /usr/local/www/lightsquid/ && ./check-setup.pl" пишет "Command not found."
и например при установки:
pkg_add -r compat6x-i386
Error: Unable to get ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-8.1-release/Latest/compat6x-i386.tbz: File unavailable (e.g., file not found, no access)
pkg_add: unable to fetch 'ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-8.1-release/Latest/compat6x-i386.tbz' by URL

whitekasper

добился запуска скриптов (пришлось перл переустановить)
теперь при запуске "cd /usr/local/www/lightsquid/ && ./check-setup.pl"
пишет:
LightSquid Config Checker, 2005-9 Sergey Erokhin GNU GPL

и замирает

и кстати а строчку "cgi.fix_pathinfo = 1" мы просто в двух файлах php.ini добавляем вконце?

dr.gopher

@whitekasper:

добился запуска скриптов (пришлось перл переустановить)
теперь при запуске "cd /usr/local/www/lightsquid/ && ./check-setup.pl"

1. какие пакеты устанавливали?
2. как устанавливали пакеты?
3. в связке с чем будет работать lightsquid?

whitekasper

у меня установлен сквид сквидгуард все настроено и работает.все пакеты как лайтсквид ставил из Package Manager

Version 2.0.1-RELEASE (i386)
built on Mon Dec 12 17:53:52 EST 2011
FreeBSD 8.1-RELEASE-p6

dr.gopher

@whitekasper:

у меня установлен сквид сквидгуард все настроено и работает.все пакеты как лайтсквид ставил из Package Manager

У меня, кроме ошибок перла с lightsquid ничего не случалось.
Попробуйте удалить пакет lightsquid, ребут, установить по новой.

Нажимали?
Refresh now
Refresh full

whitekasper

удалять пробывал и нажимал рефреш и все равно при заходе пишет ошибку "500 - Internal Server Error"
мой файл lightsquid.cfg

#!/usr/bin/perl

LightSquid Project 2004-2008 Sergey Erokhin aka ESL

This program is free software; you can redistribute it and/or

modify it under the terms of the GNU General Public License

as published by the Free Software Foundation; either version 2

of the License, or (at your option) any later version.

detail see in gnugpl.txt

-------------------- GLOBAL VARIABLES ---------------------------

#path to additional cfg files
$cfgpath = "/usr/local/etc/lightsquid";
#path to tpl folder
$tplpath = "/usr/local/www/lightsquid/tpl";
#path to lang folder
$langpath = "/usr/local/share/lightsquid/lang";
#path to report folder
$reportpath = "/var/lightsquid/report";
#path to access.log
$logpath = "/var/squid/log";
#path to ip2name folder
$ip2namepath = "/usr/local/libexec/lightsquid";

#path to lockfile ;-)
$lockpath =$reportpath;

#if lockfile older $maxlocktime second, remove old lock file.
$maxlocktime = 30*60;

#if 1 - lightparser generate some statistic
$debug = 0;
#if 1 - lightparser generate skip details, 2 ..., 3 ..., ....
$debug2 = 0;

-------------------- LightParser VARIABLES ---------------------------

#squid log type
#if native squid format (default squid, see in doc) - must be 0
#if EmulateHttpdLog ON - set 1
#digit - for speed optimization
#try it set to 1 if parser generate warning

#see also month2dec below !!!!

$squidlogtype = 0;

#if you want skip some sites from stat, example our local www server
#WARNING !!!, don't leave this variable empty !!!
#example, if you want skip LOCAL site, put it here
#WARNING2
#use '' instead of "" !!!!!!!!!!!

#$skipurl = 'zdd.com|192.168.1.|cnn.com';
$skipurl = "zzz.zzz";

#define sobroutine file for convertion from IP into name
#if you want skip some ip from log - return "SKIP THIS IP" ;-)
#detail see in ip2name folder,

$ip2name = "ip";;

#use for convert from Text to Dec convertion if EmualteHttpdLog format !!!!
#fix it if need
%month2dec = ( Jan => 1, Feb => 2, Mar => 3, Apr => 4, May => 5,Jun => 6,
Jul => 7, Aug => 8, Sep => 9, Oct => 10, Nov => 11,Dec => 12);

-------------------- Common (Parser & Web) VARIABLES ----------------------

#create & use time report statistic (logsize = logsize*2) ;-))
$timereport = 1;

-------------------- WEB VARIABLES ----------------------------------------

#language
#see lang folder (avaible: bg,eng,fr,hu,it,pt_br,ru,sp)
$lang = "ru";;

#html template name
#see template folder tpl/$templatename/
$templatename = "base";;
#$templatename ="ric";
#$templatename ="base.css";

#define type of decimal output
#fine 123456789 -> 123,456,789
#class 123456789 -> 117.7 G
$DecOutType="class";

define delimiter for thousands (in fine mode)

= " " -> 12 345 678

= "," -> 12,345,678

= "" -> 12345678

$decdelimiter = " ";

#if you dont need Group mode, do =0
$showgrouplink = 1;

#if not zero, groups look like "01. Group1", if zero - "Group1"
$showgroupid = 1;

#if you dont need oversize report , do =0
$showoversizelink = 1;

#show how many data user send to internet
$showputpost = 0;
#if putpost higer this variable (in percent), highlight it
$putpostwarninglevel =15;

#use or not .realname files
#.realname contain pair userid -> Full User Name
$userealname = 1;

#if url size exceed $bigfilelimit - add this file into report
$bigfilelimit = 210241024;

#user maximum size per day limit (oversize)
$perusertrafficlimit = 1010241024;

weekend display mode

both - select sunday & monday

monday - only monday

$weekendmode="both";

#how many site show in TopSites report
$topsiteslimit = 500;

#how many site show in user time report
$usertimelimit = 200;

#if you want user traffic GRAPHIC report, set it in 1
#WARNING !!!, need libgd, GD.PM & other external modules !!!
#please run check-setup.pl for check library !!!!
$graphreport = 0;

#higest value on graph report

for user month report (0.05*(...) = 50mb)

$graphmaxuser=0.05*(102410241024);

for all user month report (1.05*(...) = 1 Gb)

$graphmaxall =0.80*(102410241024);

#color scheme for GRAPHICs, avaible "orange","blue","green","yellow","brown","red"
$barcolor = "orange";;

#-------------------------------------------------------------------------- Group support

sub CreateGroupFile($) {
my $path=shift;

open Fi,"<$cfgpath/group.cfg";
open Fo,">$path/.group";
while (<fi>) {
print Fo $_;
}
close Fo;
close Fi;
}

#-------------------------------------------------------------------------- RealName support

sub CreateRealnameFile($) {
my $path=shift;

open Fi,"<$cfgpath/realname.cfg";
open Fo,">$path/.realname";
while (<fi>) {
print Fo $_;
}
close Fo;
close Fi;
}</fi></fi>

файл lighty-webConfigurator.conf

lighttpd configuration file

use a it as base for lighttpd 1.0.0 and above

############ Options you really have to take care of ####################

FreeBSD!

server.event-handler = "freebsd-kqueue"
server.network-backend = "writev"

modules to load

server.modules = (

"mod_access", "mod_accesslog", "mod_expire", "mod_compress", "mod_redirect",
"mod_fastcgi", "mod_cgi"
)

Unused modules

# "mod_setenv",
# "mod_rewrite",
# "mod_ssi",
# "mod_usertrack",
# "mod_expire",
# "mod_secdownload",
# "mod_rrdtool",
# "mod_auth",
# "mod_status",
# "mod_alias",
# "mod_proxy",
# "mod_simple_vhost",
# "mod_evhost",
# "mod_userdir",
# "mod_cgi",

server.max-keep-alive-requests = 15
server.max-keep-alive-idle = 30

a static document-root, for virtual-hosting take look at the

server.virtual-* options

server.document-root = "/usr/local/www/"

Maximum idle time with nothing being written (php downloading)

server.max-write-idle = 999

where to send error-messages to

server.errorlog = "/var/log/lighttpd.error.log"

files to check for if …/ is requested

server.indexfiles = ( "index.php", "index.html",
"index.htm", "default.htm" )

mimetype mapping

mimetype.assign = (
".pdf" => "application/pdf",
".sig" => "application/pgp-signature",
".spl" => "application/futuresplash",
".class" => "application/octet-stream",
".ps" => "application/postscript",
".torrent" => "application/x-bittorrent",
".dvi" => "application/x-dvi",
".gz" => "application/x-gzip",
".pac" => "application/x-ns-proxy-autoconfig",
".swf" => "application/x-shockwave-flash",
".tar.gz" => "application/x-tgz",
".tgz" => "application/x-tgz",
".tar" => "application/x-tar",
".zip" => "application/zip",
".mp3" => "audio/mpeg",
".m3u" => "audio/x-mpegurl",
".wma" => "audio/x-ms-wma",
".wax" => "audio/x-ms-wax",
".ogg" => "audio/x-wav",
".wav" => "audio/x-wav",
".gif" => "image/gif",
".jpg" => "image/jpeg",
".jpeg" => "image/jpeg",
".png" => "image/png",
".xbm" => "image/x-xbitmap",
".xpm" => "image/x-xpixmap",
".xwd" => "image/x-xwindowdump",
".css" => "text/css",
".html" => "text/html",
".htm" => "text/html",
".js" => "text/javascript",
".asc" => "text/plain",
".c" => "text/plain",
".conf" => "text/plain",
".text" => "text/plain",
".txt" => "text/plain",
".dtd" => "text/xml",
".xml" => "text/xml",
".mpeg" => "video/mpeg",
".mpg" => "video/mpeg",
".mov" => "video/quicktime",
".qt" => "video/quicktime",
".avi" => "video/x-msvideo",
".asf" => "video/x-ms-asf",
".asx" => "video/x-ms-asf",
".wmv" => "video/x-ms-wmv",
".bz2" => "application/x-bzip",
".tbz" => "application/x-bzip-compressed-tar",
".tar.bz2" => "application/x-bzip-compressed-tar"
)

Use the "Content-Type" extended attribute to obtain mime type if possible

#mimetypes.use-xattr = "enable"

accesslog module

#accesslog.filename = "/dev/null"

deny access the file-extensions

~ is for backupfiles from vi, emacs, joe, ...

.inc is often used for code includes which should in general not be part

# of the document-root
url.access-deny = ( "~", ".inc" )

######### Options that are good to be but not neccesary to be changed #######

bind to port (default: 80)

server.port = 8080

error-handler for status 404

#server.error-handler-404 = "/error-handler.html"
#server.error-handler-404 = "/error-handler.php"

to help the rc.scripts

server.pid-file = "/var/run/lighty-webConfigurator.pid"

virtual directory listings

server.dir-listing = "disable"

enable debugging

debug.log-request-header = "disable"
debug.log-response-header = "disable"
debug.log-request-handling = "disable"
debug.log-file-not-found = "disable"

gzip compression

compress.cache-dir = "/tmp/lighttpdcompress/"
compress.filetype = ("text/plain","text/css", "text/xml", "text/javascript" )

server.upload-dirs = ( "/root/", "/tmp/", "/var/" )

server.max-request-size = 2097152

fastcgi module

read fastcgi.txt for more info

fastcgi.server = ( ".php" =>
( "localhost" =>
(
"socket" => "/tmp/php-fastcgi.socket",
"min-procs" => 0,
"max-procs" => 2,
"bin-environment" => (
"PHP_FCGI_CHILDREN" => "2",
"PHP_FCGI_MAX_REQUESTS" => "500"
),
"bin-path" => "/usr/local/bin/php"
)
)
)

CGI module

alias.url+=("/lightsquid/" => "/usr/local/www/lightsquid/")
index-file.names = ( "index.php", "index.html",
"index.htm", "default.htm", "index.cgi" )

static-file.exclude-extensions = ( ".php", ".pl", ".fcgi", ".cgi" )

cgi.assign = (
".pl" => "/usr/bin/perl",
".cgi" => "/usr/bin/perl"
)

файл php.ini

; File generated from /etc/rc.php_ini_setup
output_buffering = "0"
expose_php = Off
implicit_flush = true
magic_quotes_gpc = Off
max_execution_time = 99999999
max_input_time = 99999999
set_time_limit = 0
register_argc_argv = On
file_uploads = On
upload_tmp_dir = /tmp
upload_max_filesize = 100M
post_max_size = 100M
html_errors = Off
zlib.output_compression = Off
zlib.output_compression_level = 1
include_path = ".:/etc/inc:/usr/local/www:/usr/local/captiveportal:/usr/local/pkg"
;display_startup_errors=off
;display_errors=off
log_errors=on
error_log=/tmp/PHP_errors.log
extension_dir=/usr/local/lib/php/20060613/

; Extensions

extension=apc.so
extension=curl.so
extension=gettext.so
extension=ldap.so
extension=openssl.so
extension=pcntl.so
extension=mhash.so
extension=posix.so
extension=readline.so
extension=session.so
extension=suhosin.so
extension=ctype.so
extension=xml.so
extension=xmlreader.so
extension=xmlwriter.so
extension=simplexml.so
extension=mbstring.so
extension=shmop.so
extension=zlib.so
extension=spl.so
extension=pdo.so
extension=sqlite.so
extension=zmq.so
extension=ssh2.so
extension=pfSense.so

; APC Settings
apc.enabled="1"
apc.enable_cli="0"
apc.shm_size="35M"

[suhosin]
suhosin.get.max_array_depth = 5000
suhosin.get.max_array_index_length = 256
suhosin.get.max_vars = 5000
suhosin.get.max_value_length = 500000
suhosin.post.max_array_depth = 5000
suhosin.post.max_array_index_length = 256
suhosin.post.max_vars = 5000
suhosin.post.max_value_length = 500000
suhosin.request.max_array_depth = 5000
suhosin.request.max_array_index_length = 256
suhosin.request.max_vars = 5000
suhosin.request.max_value_length = 500000
suhosin.memory_limit = 512435456
cgi.fix_pathinfo = 1 #я добавил

уточню что ребутаю lighttpd через команды:
killall lighttpd
/usr/local/sbin/lighttpd -f /var/etc/lighty-webConfigurator.conf

вот скрин запуска …pl

whitekasper

сейчас пробую :
"/usr/local/www/lightsquid/lightparser.pl"
ответ:
Warning, /var/lightsquid/report/lockfile exist, maybe anoter process running !
LockPID : 880
tsdelta : 557 second(s) (maxlocktime: 1800)

dr.gopher

@whitekasper:

сейчас пробую :
"/usr/local/www/lightsquid/lightparser.pl"

Возможно у вас большой лог сквида и lightsquid-у нужно время для обработки. А времени вы не даете.
До тех пор пока lightsquid не обработает весь лог сквида, отчеты работать не будут.

whitekasper

спасибо.попробую.
у меня лог и вправду очень большой так как я не ставил его чистить.а сквид уже почти месяц работает)

dvserg

Можно "/usr/local/www/lightsquid/lightparser.pl today" - отлупит только за сегодня.

whitekasper

а как мне безболезнено начать с чистого файла логов а действующий переименовать?

dvserg

@whitekasper:

а как мне безболезнено начать с чистого файла логов а действующий переименовать?

Выполнить squid -k rotate потом переименовать все файлы логов с 0 1 2 3 в расширении. Сам access.log не трогать.

whitekasper

выполнилась у меня команда /usr/local/www/lightsquid/lightparser.pl today
но все равно при заходе на lightsquid Reports пишет ошибку 500 - Internal Server Error

dvserg

@whitekasper:

выполнилась у меня команда /usr/local/www/lightsquid/lightparser.pl today
но все равно при заходе на lightsquid Reports пишет ошибку 500 - Internal Server Error

Доступ к ГУИ сделайте HTTP/80 порт.

whitekasper

все!спасибо огромное.у меня все получилось после очистки файлов логов.и ошибка пропала и открывает статистику.
еще раз большое спасибо за помощь. я новичок в этом деле.

whitekasper

Теперь займусь присваиванием имен к IP адресам и уберу себя в статистике)

whitekasper

подскажите.
а возможно удалить все логи определенного ip (не спрятать, а очистить файл логов)

странность наблюдается.добавлял в скип ip вчера и из отчетов убирался данный пользователь.потом удалил, сегодня снова добавил несколько ip и все равно в отчета они отображаются

dvserg

@whitekasper:

подскажите.
а возможно удалить все логи определенного ip (не спрятать, а очистить файл логов)

Вручную можно :)

whitekasper

@dvserg:

@whitekasper:

подскажите.
а возможно удалить все логи определенного ip (не спрятать, а очистить файл логов)

Вручную можно :)

ок=)
а что по поводу игнора скипюзров?
файл скипюзер.cfg:

#sample comment
sampleuser
SKIP THIS IP
192.168.0.159
192.168.0.100
192.168.0.204

Lighttpd нужна помощь

LightSquid Project 2004-2008 Sergey Erokhin aka ESL

This program is free software; you can redistribute it and/or

modify it under the terms of the GNU General Public License

as published by the Free Software Foundation; either version 2

of the License, or (at your option) any later version.

detail see in gnugpl.txt

-------------------- GLOBAL VARIABLES ---------------------------

-------------------- LightParser VARIABLES ---------------------------

-------------------- Common (Parser & Web) VARIABLES ----------------------

-------------------- WEB VARIABLES ----------------------------------------

define delimiter for thousands (in fine mode)

= " " -> 12 345 678

= "," -> 12,345,678

= "" -> 12345678

weekend display mode

both - select sunday & monday

monday - only monday

for user month report (0.05*(...) = 50mb)

for all user month report (1.05*(...) = 1 Gb)

lighttpd configuration file

use a it as base for lighttpd 1.0.0 and above

FreeBSD!

modules to load

Unused modules

a static document-root, for virtual-hosting take look at the

server.virtual-* options

Maximum idle time with nothing being written (php downloading)

where to send error-messages to

files to check for if …/ is requested

mimetype mapping

Use the "Content-Type" extended attribute to obtain mime type if possible

accesslog module

deny access the file-extensions

~ is for backupfiles from vi, emacs, joe, ...

.inc is often used for code includes which should in general not be part

bind to port (default: 80)

error-handler for status 404

to help the rc.scripts

virtual directory listings

enable debugging

gzip compression

fastcgi module

read fastcgi.txt for more info

CGI module

define delimiter for thousands (in `fine` mode)