KSUSUS LOG…!!!!!

tomplee

Mau tanya para master di mesinku acces log squid kok gak jalan ya, padahal di opsi squid enable logging sudah di aktifkan, kalau cache log nya sih jalan dengan normal.

kambeeng

Bisa dicantumkan Lognya di sini :D

tomplee

kemaren access lognya sizenya masih 0 terus tepi sekarang sudah bisa kayaknya.
kalau seperti ini jalan dengan bener gak om kambing ?
1253471683.795 436 192.168.119.4 TCP_MISS/200 666 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/shadow.gif - DIRECT/69.64.6.21 image/gif
1253471683.826 467 192.168.119.4 TCP_MISS/200 1355 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/move.gif - DIRECT/69.64.6.21 image/gif
1253471684.086 702 192.168.119.4 TCP_MISS/200 641 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/pre.gif - DIRECT/69.64.6.21 image/gif
1253471684.086 495 192.168.119.4 TCP_MISS/200 641 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/left.gif - DIRECT/69.64.6.21 image/gif
1253471684.324 720 192.168.119.4 TCP_MISS/200 640 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/center.gif - DIRECT/69.64.6.21 image/gif
1253471684.343 548 192.168.119.4 TCP_MISS/200 650 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/hr.gif - DIRECT/69.64.6.21 image/gif
1253471684.505 679 192.168.119.4 TCP_MISS/200 662 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/size.gif - DIRECT/69.64.6.21 image/gif
1253471684.505 416 192.168.119.4 TCP_MISS/200 721 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/face.gif - DIRECT/69.64.6.21 image/gif
1253471684.777 595 192.168.119.4 TCP_MISS/200 881 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/flash.gif - DIRECT/69.64.6.21 image/gif
1253471684.777 1161 192.168.119.4 TCP_MISS/200 641 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/right.gif - DIRECT/69.64.6.21 image/gif
1253471684.870 544 192.168.119.4 TCP_MISS/200 940 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/img.gif - DIRECT/69.64.6.21 image/gif
1253471684.885 540 192.168.119.4 TCP_MISS/200 858 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/url.gif - DIRECT/69.64.6.21 image/gif
1253471685.110 603 192.168.119.4 TCP_MISS/200 829 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/email.gif - DIRECT/69.64.6.21 image/gif
1253471685.134 617 192.168.119.4 TCP_MISS/200 760 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/ftp.gif - DIRECT/69.64.6.21 image/gif
1253471685.285 400 192.168.119.4 TCP_MISS/200 687 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/table.gif - DIRECT/69.64.6.21 image/gif
1253471685.303 406 192.168.119.4 TCP_MISS/200 690 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/tr.gif - DIRECT/69.64.6.21 image/gif
1253471686.025 1128 192.168.119.4 TCP_MISS/200 685 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/td.gif - DIRECT/69.64.6.21 image/gif
1253471686.034 1137 192.168.119.4 TCP_MISS/200 651 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/sup.gif - DIRECT/69.64.6.21 image/gif
1253471686.141 1005 192.168.119.4 TCP_MISS/200 649 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/sub.gif - DIRECT/69.64.6.21 image/gif
1253471686.151 946 192.168.119.4 TCP_MISS/200 773 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/tele.gif - DIRECT/69.64.6.21 image/gif
1253471686.182 898 192.168.119.4 TCP_MISS/200 649 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/code.gif - DIRECT/69.64.6.21 image/gif
1253471686.182 879 192.168.119.4 TCP_MISS/200 794 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/quote.gif - DIRECT/69.64.6.21 image/gif
1253471686.394 330 192.168.119.4 TCP_MISS/200 653 GET http://forum.pfsense.org/Themes/slickprographite/images/bbc/list.gif - DIRECT/69.64.6.21 image/gif
1253471686.394 267 192.168.119.4 TCP_MISS/200 964 GET http://forum.pfsense.org/Smileys/default/angry.gif - DIRECT/69.64.6.21 image/gif
1253471686.486 333 192.168.119.4 TCP_MISS/200 2052 GET http://forum.pfsense.org/Smileys/default/shocked.gif - DIRECT/69.64.6.21 image/gif
1253471686.516 355 192.168.119.4 TCP_MISS/200 949 GET http://forum.pfsense.org/Smileys/default/cool.gif - DIRECT/69.64.6.21 image/gif
1253471686.761 575 192.168.119.4 TCP_MISS/200 1022 GET http://forum.pfsense.org/Smileys/default/huh.gif - DIRECT/69.64.6.21 image/gif
1253471686.769 576 192.168.119.4 TCP_MISS/200 1611 GET http://forum.pfsense.org/Smileys/default/rolleyes.gif - DIRECT/69.64.6.21 image/gif

terus ada persoalan laen lagi nih om masih berhubungan dengan ini, light squidnnya yang web base gak mau jalan.. kalau cuma mau lihat statistik cache-nya lewat command line aja gimana caranya ?
tak coba

squidclient mgr:info

client: ERROR: Cannot connect to localhost:3128: Operation timed out

tomplee

nih tak coba hapus access.log-nya, pfsense saya reboot, terus tak coba browsing lagi kok access.log-nya masih 0 ya?
-rw-r–--- 1 proxy proxy 0 Sep 21 02:01 access.log
-rw-r----- 1 proxy proxy 113173 Sep 21 02:26 cache.log ??? ???

kambeeng

wah sepertinya ada msalah tuh

tomplee

kira masalahnya dimana om kambing?

kambeeng

coba di bikin swap manual jalan nggak squid -z

terus check lognya tail -v /var/squid/log/access.log.

atau buatkan directorinya secar permanen edit di Squid.conf

Good luck…

kambeeng

Bisa kirimkan kasih tau setingan squidnya kalo bisa saya mau check :D

tomplee

.
dah saya coba install ulang squid paket squidnya.. kalau habis di install mau jalan access.log-nya; tapi kalau habis di reboot access.lognya macet lagi..;
untuk light squidnya
masih keluar error ini:
LigthSquid diagnostic.
Error : report folder '/var/lightsquid/report' not contain any valid data! Please run lightparser.pl (and check 'report' folder content)
Please check config file !
padahal dah tak refresh full..

Ini settingan squidnya .

Do not edit manually !

http_port 192.168.119.1:3128
http_port 127.0.0.1:80 transparent
icp_port 0

pid_filename /var/run/squid.pid
cache_effective_user proxy
cache_effective_group proxy
error_directory /usr/local/etc/squid/errors/English
icon_directory /usr/local/etc/squid/icons
visible_hostname bikini-bottom
cache_mgr patrick@bikini-bottom
access_log /var/squid/log/access.log
cache_log /var/squid/log/cache.log
cache_store_log none
shutdown_lifetime 3 seconds

Allow local network(s) on interface(s)

acl localnet src 192.168.119.0/255.255.255.0
uri_whitespace strip

cache_dir diskd /var/squid/cache 10000 16 256
cache_mem 6 MB
maximum_object_size 128 KB
minimum_object_size 0 KB
cache_replacement_policy heap LFUDA
memory_replacement_policy heap GDSF
offline_mode off
dns_children 32
cache_swap_low 98
cache_swap_high 99
acl donotcache dstdomain "/var/squid/acl/donotcache.acl"
cache deny donotcache

No redirector configured

Setup some default acls

acl all src 0.0.0.0/0.0.0.0
acl localhost src 127.0.0.1/255.255.255.255
acl safeports port 21 70 80 210 280 443 488 563 591 631 777 901 80 3128 1025-65535
acl sslports port 443 563 80
acl manager proto cache_object
acl purge method PURGE
acl connect method CONNECT
acl dynamic urlpath_regex cgi-bin ?
acl allowed_subnets src 192.168.118.0/24 192.168.119.0/24
cache deny dynamic
http_access allow manager localhost

http_access deny manager
http_access allow purge localhost
http_access deny purge
http_access deny !safeports
http_access deny CONNECT !sslports

Always allow localhost connections

http_access allow localhost

quick_abort_min 0 KB
quick_abort_max 0 KB
request_body_max_size 0 KB
reply_body_max_size 0 allow all
delay_pools 1
delay_class 1 2
delay_parameters 1 -1/-1 -1/-1
delay_initial_bucket_level 100
delay_access 1 allow all

Allow local network(s) on interface(s)

http_access allow localnet
http_access allow allowed_subnets

Custom options

#tambahan

ipcache_size 2048

Toleransi aborting dihilangkan saja

quick_abort_min 0

quick_abort_max 0

quick_abort_pct 98

Mematikan dan merekonfigurasi Squid jangan terlalu cepat krn bisa mengakibatkan integritas file kacau

shutdown_lifetime 10 seconds

Penting utk relasi dg sibling dg mengukur respons-nya via ICP dan ICMP (tapi ada isp yg tidak mengijinkan lho)

icp_hit_stale on

query_icmp on

tidak perlu reservasi memori

memory_pools off

##Refresh Pattern
hierarchy_stoplist cgi-bin ? .js .jsp .g .do .php .asp .cgi .friendster.com facebook.com yahoo.com google.co.id google.com en.wikipedia.org id.wikipedia.org mail.yahoo.com mail.yahoo.co.id mail.google.com login.yahoo.com bikini-bottom

acl QUERY urlpath_regex cgi-bin ? .js .jsp .g .do .php .asp .cgi .friendster.com facebook.com yahoo.com google.co.id google.com en.wikipedia.org id.wikipedia.org mail.yahoo.com mail.yahoo.co.id mail.google.com en.wikipedia.org id.wikipedia.org mail.yahoo.com mail.yahoo.co.id mail.google.com login.yahoo.com bikini-bottom

refresh_pattern -i .rar$ 10080 100% 40320

refresh_pattern -i .ram$ 10080 100% 40320

refresh_pattern -i .gif$ 10080 100% 40320 reload-into-ims

refresh_pattern -i .txt$ 1440 100% 20160 reload-into-ims

refresh_pattern -i .zip$ 10080 100% 40320

refresh_pattern -i .arj$ 10080 100% 40320

refresh_pattern -i .exe$ 10080 100% 40320

refresh_pattern -i .tgz$ 10080 100% 40320

refresh_pattern -i .gz$ 10080 100% 40320

refresh_pattern -i .tgz$ 10080 100% 40320

refresh_pattern -i .tar$ 10080 100% 40320

refresh_pattern -i .Z$ 10080 100% 40320

refresh_pattern -i .js$ 10080 100% 40320

refresh_pattern -i .3gp$ 10080 100% 40320

refresh_pattern -i .swf$ 10080 100% 40320

refresh_pattern -i .flv$ 10080 100% 40320

refresh_pattern -i .jpg$ 10080 100% 40320

refresh_pattern -i .jpeg$ 10080 100% 40320

refresh_pattern ^ftp:// 1440 150% 10080

refresh_pattern ^gopher:// 1440 10% 1440

refresh_pattern . 1440 60% 43200

Default block all to be sure

http_access deny all

grage95

@tomplee:

–deleted --

terus ada persoalan laen lagi nih om masih berhubungan dengan ini, light squidnnya yang web base gak mau jalan.. kalau cuma mau lihat statistik cache-nya lewat command line aja gimana caranya ?
tak coba

squidclient mgr:info

client: ERROR: Cannot connect to localhost:3128: Operation timed out

squidclient mgr:info bisa jalan tanpas passswod & embel2 host kalau config anda ada
http_port 127.0.0.1:3128 dan cachemgr_passwd none all

utk produksi seperti utk RT/RW net mending gunakan release stable dan utk proxynya gunakan cacheboy/lusca, lebih responsif dari squid-2.6.xx, sedangkan squid 3 bagus utk filtering, kurang sip utk cache. silahkan update ke cacheboy/lusca.

http://forum.pfsense.org/index.php/topic,19251.0.html

-automatic fixing transparent proxy with shaper,
-fix bug unknown lru if u using policy heap (default webgui only running policy lru, NOT policy heap !!)
-fix delay_pool with type url domain .com
-fix look statistic cache with squidclient mgr:info / squidclient mgr:storedir / squidclient mgr:delay ,etc (loook squidclient:menu)
-fix insert tunning for more reaktif cache files
-fix configuration with webgui (you can edit squid.conf with webgui )

saran ane, jangan coba2 versi current yang belum stable utk produksi kecuali ente sudah siap dengan resikonya,
kalau utk di pakai test sendiri dan mempelajari fitur2 yang baru boleh2 saja.

tomplee

@grage95:

@tomplee:

–deleted --

terus ada persoalan laen lagi nih om masih berhubungan dengan ini, light squidnnya yang web base gak mau jalan.. kalau cuma mau lihat statistik cache-nya lewat command line aja gimana caranya ?
tak coba

squidclient mgr:info

client: ERROR: Cannot connect to localhost:3128: Operation timed out

squidclient mgr:info bisa jalan tanpas passswod & embel2 host kalau config anda ada
http_port 127.0.0.1:3128 dan cachemgr_passwd none all

utk produksi seperti utk RT/RW net mending gunakan release stable dan utk proxynya gunakan cacheboy/lusca, lebih responsif dari squid-2.6.xx, sedangkan squid 3 bagus utk filtering, kurang sip utk cache. silahkan update ke cacheboy/lusca.

http://forum.pfsense.org/index.php/topic,19251.0.html

-automatic fixing transparent proxy with shaper,
-fix bug unknown lru if u using policy heap (default webgui only running policy lru, NOT policy heap !!)
-fix delay_pool with type url domain .com
-fix look statistic cache with squidclient mgr:info / squidclient mgr:storedir / squidclient mgr:delay ,etc (loook squidclient:menu)
-fix insert tunning for more reaktif cache files
-fix configuration with webgui (you can edit squid.conf with webgui )

saran ane, jangan coba2 versi current yang belum stable utk produksi kecuali ente sudah siap dengan resikonya,
kalau utk di pakai test sendiri dan mempelajari fitur2 yang baru boleh2 saja.

oke bro.. tak ganti ke yang versi stable lagi aja.. kemaren dah coba yang stable terus ganti ipcop terus sekarang lagi coba yang 2.0 alpha..
dulu sepertinya pake yang versi stable gak sering error gini..
yang squid client itu ternyata begini bisa squidclient -p 80 cache_object://localhost/info

grage95

bro,
ram ente 256 MB utk RT/RW Net ??
servis yang jalan apa aja ?
coba ketik top

swap memory kepake enggak?
kalo kepake kasian banget client2 ente, bakal lelet gara2 squid

tomplee

@grage95:

bro,
ram ente 256 MB utk RT/RW Net ??
servis yang jalan apa aja ?
coba ketik top

swap memory kepake enggak?
kalo kepake kasian banget client2 ente, bakal lelet gara2 squid

persoalan yang kemaren atas saran bro grage tak install ulang pake yang versi 1.2.2 ; dah teratasi
servicenya yang jalan cuman squid,dnsmasq,ntpd
idelanya pake ram berapa bro untuk 5-10 client, sekarang clientnya cuma 5; kemaren ramnya 512 tapi berhubung mati cuma tak ganti ram cadangan yang gak usah beli .. :)
tak coba top swap memory free..

grage95

dengan ram 256 M,sama persis kayak yang sy pasang di warnet sy, cache squid mentok di 4Gb, lewat 4 GB sedikt saja, swap hardisk langsung kepake, padahal menggunakan freebsd7.2 minimalis, servis yg jalan, squid, bind/dns cache dengan max-cache-size 8Mb & pf +ALTQ,

yang penting pantau terus sampe cache penuhnya di berapa pas swap memory hardisk terpakai. naikin dikit2 cache_dirnya, coba 3 Gb dulu, kalau penuh baru naikin pelan2, stop kalo swap memory disk terpakai. cache_dir sebaiknya menggunakan partisi sendiri. setahu saya servis di pfsesne ada yang hidden, coba aja di ps -ax, ada lighttpd & php nya, dan ini lumayan makan memory

tomplee

@grage95:

dengan ram 256 M,sama persis kayak yang sy pasang di warnet sy, cache squid mentok di 4Gb, lewat 4 GB sedikt saja, swap hardisk langsung kepake, padahal menggunakan freebsd7.2 minimalis, servis yg jalan, squid, bind/dns cache dengan max-cache-size 8Mb & pf +ALTQ,

yang penting pantau terus sampe cache penuhnya di berapa pas swap memory hardisk terpakai. naikin dikit2 cache_dirnya, coba 3 Gb dulu, kalau penuh baru naikin pelan2, stop kalo swap memory disk terpakai. cache_dir sebaiknya menggunakan partisi sendiri. setahu saya servis di pfsesne ada yang hidden, coba aja di ps -ax, ada lighttpd & php nya, dan ini lumayan makan memory

yup, klau diliaht proses semuanya banyak, tapi sementara ini pemakaian memori berkisar antara 30-40%;
kalau untuk ukuran spec segitu kira bagusnya Maximum object size nya di buat berapa bro?

grage95

yang ada di box ram 256 Mb

cache_mem 8 MB
maximum_object_size_in_memory 32 KB

cache_dir aufs /cache 4096 16 256
maximum_object_size 64 MB

tomplee

kalau Hard disk cache system bagusan yang aufs atau diskd? denger2 kalau di bsd based bagusan yang diskd?
maap bro .. banyakan nanya.. :)

grage95

kalau ente make squid dibawah versi 2.7 ya bagusan diskd,
kalau diatas itu ya bagusan aufs,
ane udah cerai sama sama diskd, bahkan kabaranya di versi lusca selanjutnya diskd & ufs akan di hilangkan, jadi adanya coss,aufs & null

taken from http://www.xenion.com.au/squid/docs/6.html

Squid-2 defaults to use async disk operations for disk read() / open() ; Lusca uses the async disk operations for -all- operations. This improves performance on FreeBSD/Solaris, where write() / close() may block more often than not.

FreeBSD-7 supports full kernel supported threading (as does FreeBSD-6.x) and as such the "aufs" store model should be used by default. LUSCA_HEAD has some tuning to make AUFS perform better under FreeBSD than the Squid defaults.

ane coba benchmark squid-2.6.21, squid-2.7.6, squid-3.1.x, cacheboy dan lusca dengan menggunakan diskd dan aufs dengan user > 2000 dan bandwith cuma 6 Mbps, dengan monitoring mrtg-squid, nyontek mrtg-nya disini http://www.xenion.com.au/squid/docs/5.html
spek server dell blade dual xeon, mem 8Gb dan scasi disk 6 biji (1 OS, 1 log, dan 4 utk cache) dengan pemisahan file2 kecil di cache1 &
cache2, file2 besar di cache3 dan cache4)

hasilnya :

diskd bagus di squid-2.6.21
aufs bagus di lusca,
cache hits tertinggi menggunakan lusca,
jadi ya ane pilih lusca hehehe

dokumentasi sederhananya sih sudah di buat, cuman utk kalangan sendiri, project freelance :D

romal

Om2 ane numpang tanya dunk,,ane baru pakai pfsense nih.. jd newbie bgt..
di system lognya kog kayak gini ya,,apakah proses instalnya yg salah?! :-[

php: : SQUID is installed but not started. Not installing redirect rules.

zchellpy

hampir sama kasus ku tp setelah aku kasih:
cache_swap_low 90
cache_swap_high 95

udah nga main2 swap mem lagi Lusca na…... ;D

static-x

mohon bantuannya bro kambeeng….^_^

MB : Matsonic G31
PROC : PENTIUM IV 2.8 GHZ
RAM : 1 GB DDR2
HD : 250 GB
NETWORK : REALTEK 10/100 + 3Com +
PFESENSE : 1.2.3 RC1
DIGUNAKAN UNTUK : WARNET 20komp..Load Balance Speedy 1mb+ 2mb

pfsense sudah jalan selama 3minggu dengan squid Lusca....tiba2 terjadi error

NG: R/W mount of / denied. Filesystem is not clean - run fsck
mount: /dev/ufs/pfSense: Operation not permitted
GEOM_LABEL: Label ufs/pfSenseCfg removed.
** /dev/ufs/pfSense
** Last Mounted on /
** Root file system
** Phase 1 - Check Blocks and Sizes
** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
** Phase 5 - Check Cyl groups
1962 files, 48949 used, 7508 freGe (2124 frags, 6E73 blocks, 3.8% Ofragmentation)
M
***** FILE SYS_TEM MARKED CLEANL *****
ABEL: Label for provider ad0d is ufs/pfSenseCfg.
** /dev/ufs/pfSenseCfg (NO WRITE)
** Last Mounted on /tmp/freesbie.9fVNqBzC/cf
** Phase 1 - Check Blocks and Sizes
** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
** Phase 5 - Check Cyl group