Update / cron job [Error]
-
Update Process (manual or cron job) won't finish since 2 days. Nothing changed in my configuration. I tried to remove db.files & re-/uninstall the package but won't work anymore…
Any suggestions?thx
Last sucessfull update
CRON PROCESS START [ 10/03/17 18:00:00 ] [ PiHole ] ( No remote timestamp/md5 unchanged ) Update not required [ Malware ] Remote timestamp: Fri, 29 Sep 2017 21:18:24 GMT Local timestamp: Fri, 29 Sep 2017 21:18:24 GMT Update not required [ Cameleon ] Remote timestamp: Mon, 02 Oct 2017 07:40:54 GMT Local timestamp: Mon, 02 Oct 2017 07:40:54 GMT Update not required [ Zeustracker ] Remote timestamp: Sun, 01 Oct 2017 10:00:12 GMT Local timestamp: Sun, 01 Oct 2017 10:00:12 GMT Update not required [ SimpleTracking ] Remote timestamp: Fri, 31 Jul 2015 19:01:02 GMT Local timestamp: Fri, 31 Jul 2015 19:01:02 GMT Update not required [ SimpleAds ] Remote timestamp: Wed, 09 Mar 2016 19:46:05 GMT Local timestamp: Wed, 09 Mar 2016 19:46:05 GMT Update not required [ AdServer ] Remote timestamp: Tue, 03 Oct 2017 14:26:46 GMT Local timestamp: Sat, 30 Sep 2017 13:11:38 GMT Update found [ MVPS ] Remote timestamp: Fri, 15 Sep 2017 14:51:32 GMT Local timestamp: Fri, 15 Sep 2017 14:51:32 GMT Update not required [ EasyList ] Remote timestamp: Tue, 03 Oct 2017 15:50:39 GMT Local timestamp: Tue, 03 Oct 2017 12:50:40 GMT Update found [ EasyPrivacy ] Remote timestamp: Tue, 03 Oct 2017 15:51:18 GMT Local timestamp: Tue, 03 Oct 2017 12:51:19 GMT Update found UPDATE PROCESS START [ 10/03/17 18:00:23 ] ===[ DNSBL Process ]================================================ [ EasyList ] Downloading update [ 10/03/17 18:00:24 ] .. 200 OK. Whitelist: amazon-adsystem.com|entrecard.s3.amazonaws.com|imasdk.googleapis.com|ltassrv.com.s3.amazonaws.com| Alexa Whitelist: 4dsply.com|62b70ac32d4614b.com|a-static.com|ablogica.com|ad-apac.doubleclick.net|ad-emea.doubleclick.net|ad.admitad.com|ad.doubleclick.net|ad.mo.doubleclick.net|adbooth.com|adespresso.com|adfarm.mediaplex.com|adform.net|adk2x.com|adpays.net|ads.rd.linksynergy.com|adscpm.net|adshell.net|adsjudo.com|adskpak.com|adtwbjs.com|ae1a1e258b8b016.com|affiliaxe.com|alimama.com|amp.rd.linksynergy.com|ampxchange.com|apycomm.com|atadserver.com|bizzclick.com|bobblewrite.com|boodlewrite.com|brucelead.com|clicksgear.com|clixsense.com|cm.g.doubleclick.net|codeonclick.com|cointraffic.io|consivenu.com|cpm20.com|cpm30.com|doublepimpssl.com|eroterest.net|exdynsrv.com|exosrv.com|explorads.com|eyewond.hs.llnwd.net|fapality.com|findbetterresults.com|freewebcams.com|gan.doubleclick.net|garowrite.com|googleads.g.doubleclick.net|goviral.hs.llnwd.net|h6y654wgfdhd.com|hoomefodl.com|ifilez.org|intentmedia.net|iv.doubleclick.net|jango.com|junbi-tracker.com|leadzu.com|linkmyc.com|liveadexchanger.com|lockerdome.com|media-serving.com|mellowads.com|mpnrs.com|n4403ad.doubleclick.net|neobux.com|onclickmax.com|onclicktop.com|padsdel.com|partner.googleadservices.com|partner.video.syndication.msn.com|pipsol.net|poptm.com|potpourrichordataoscilloscope.com|predictivadnetwork.com|prxio.github.io|pubads.g.doubleclick.net|pussl10.com|pussl13.com|putrr3.com|rapidyl.net|reallifecam.com|royalads.net|runetki.com|sekindo.com|simplyhired.com|smartadtags.com|society6.com|speakol.com|superadexchange.com|td583.com|trafficdelivery1.com|trafficshop.com|trafficular.com|vcommission.com|venturead.com|wsp.mgid.com|wzus1.ask.com|xxxbunker.com|yesadsrv.com| ---------------------------------------------------------------------- Orig. Unique # Dups # White # Alexa Final ---------------------------------------------------------------------- 9270 8752 125 4 103 8520 ---------------------------------------------------------------------- [ EasyPrivacy ] Downloading update [ 10/03/17 18:00:25 ] .. 200 OK. Alexa Whitelist: a8.net|bigmir.net|cint.com|cnzz.com|confirmit.com|easycounter.com|eloqua.com|engageya.com|farmer.wego.com|getdrip.com|instapage.com|lentainform.com|linksynergy.com|omgpm.com|omguk.com|optimizely.com|sas.com|smallseotools.com|sociaplus.com|srvtrck.com| ---------------------------------------------------------------------- Orig. Unique # Dups # White # Alexa Final ---------------------------------------------------------------------- 2997 2975 58 0 20 2897 ---------------------------------------------------------------------- [ PiHole ] exists. [ 10/03/17 18:00:26 ] [ Malware ] exists. [ Cameleon ] exists. [ Zeustracker ] exists. [ SimpleTracking ] exists. [ SimpleAds ] exists. [ AdServer ] Downloading update .. 200 OK. Whitelist: a6522.s3-website-us-east-1.amazonaws.com|aax-eu-rtb.amazon-adsystem.com|aax-eu.amazon-adsystem.com|aax-fe-sin.amazon-adsystem.com|aax-fe.amazon-adsystem.com|aax-us-east.amazon-adsystem.com|aax-us-pdx.amazon-adsystem.com|aax-us-west.amazon-adsystem.com|ad-creatives-public.commondatastorage.googleapis.com|admarvel.s3.amazonaws.com|ads_ad_center.s3.amazonaws.com|adstracking.s3-website-us-west-1.amazonaws.com|advice-ads.s3.amazonaws.com|advrts.s3.amazonaws.com|adzerk-www.s3.amazonaws.com|airpushmarketing.s3.amazonaws.com|analyticsengine.s3.amazonaws.com|applab-sdk.amazon.com|arabmistress.s3.amazonaws.com|blamads-assets.s3.amazonaws.com|bo-videos.s3.amazonaws.com|c.amazon-adsystem.com|cadreon.s3.amazonaws.com|campaign-tapad.s3.amazonaws.com|cd-ladsp-com.s3.amazonaws.com|ce2-dev-trk.s3.amazonaws.com|ce2-dev.s3.amazonaws.com|chartaca.com.s3.amazonaws.com|cloudfront-labs.amazonaws.com|com.djinnworks.sdm.s3.amazonaws.com|convertglobal.s3.amazonaws.com|dban4-549565586.eu-west-1.elb.amazonaws.com|demandmedia.s3.amazonaws.com|deskwww.s3.amazonaws.com|device-metrics-us-2.amazon.com|ec2-54-171-97-32.eu-west-1.compute.amazonaws.com|ec2-54-225-149-4.compute-1.amazonaws.com|ec2-54-235-183-132.compute-1.amazonaws.com|epowernetworktrackerimages.s3.amazonaws.com|evs-hosted-14facd241e1c08.s3.amazonaws.com|fls-eu.amazon-adsystem.com|fls-eu.amazon.com|fls-fe.amazon-adsystem.com|fls-na.amazon-adsystem.com|forumwarz.s3.amazonaws.com|gateways.s3.amazonaws.com|getbarometer.s3.amazonaws.com|getsidecar.s3.amazonaws.com|gfaf-banners.s3.amazonaws.com|homad-global-configs-eu-fra.schneevonmorgen.com.s3.amazonaws.com|html5adkit.plusmo.s3.amazonaws.com|iacpromotion.s3.amazonaws.com|immassets.s3.amazonaws.com|inneractive-assets.s3.amazonaws.com|inpref.s3-external-3.amazonaws.com|inpref.s3.amazonaws.com|ir-de.amazon-adsystem.com|ir-jp.amazon-adsystem.com|ir-na.amazon-adsystem.com|kkastatic.s3.amazonaws.com|kraken-measurements.s3.amazonaws.com|livechat.s3.amazonaws.com|loved-by.s3.amazonaws.com|ltassrv.com.s3.amazonaws.com|mads.amazon-adsystem.com|magnify360-cdn.s3.amazonaws.com|matchbin-assets.s3.amazonaws.com|myadserve.s3-website-us-east-1.amazonaws.com|newbuzz-collection-1925855828.us-east-1.elb.amazonaws.com|news-whistleout.s3.amazonaws.com|nxa-ls.s3.amazonaws.com|optimizely.s3.amazonaws.com|ps-eu.amazon-adsystem.com|rcm-fe.amazon-adsystem.com|rcm-images.amazon.com|rcm.amazon.com|rich-agent.s3.amazonaws.com|s.amazon-adsystem.com|s3-tracking.synthasite.net.s3.amazonaws.com|sana.newsinc.com.s3.amazonaws.com|sdsbucket.s3.amazonaws.com|spyhunter-download.s3.amazonaws.com|ssl.google-analytics.com|strikeadcdn.s3.amazonaws.com|thetradedesk-tags.s3.amazonaws.com|trafficads.s3-website-us-west-1.amazonaws.com|tree-pixel-log.s3.amazonaws.com|twitter-badges.s3.amazonaws.com|v.amazon-adsystem.com|vice-ads.s3.amazonaws.com|waiwidgets-1246822334.eu-west-1.elb.amazonaws.com|whistleout.s3.amazonaws.com|wms-eu.amazon-adsystem.com|wms-fe.amazon-adsystem.com|ws-eu.amazon-adsystem.com|ws-na.amazon-adsystem.com|ws.amazon.com|www.google-analytics.com|www.googleadservices.com|yc-ads.s3.amazonaws.com|z-na.amazon-adsystem.com| ---------------------------------------------------------------------- Orig. Unique # Dups # White # Alexa Final ---------------------------------------------------------------------- 48061 48058 4531 101 0 43426 ---------------------------------------------------------------------- [ MVPS ] exists. [ 10/03/17 18:01:23 ] ------------------------------------------ Assembling database... completed Executing TLD TLD analysis.. completed Finalizing TLD... completed ---------------------------------------- Original Matches Removed Final ---------------------------------------- 109552 48656 33635 75917 ----------------------------------------- Validating database... completed [ 10/03/17 18:01:48 ] Reloading Unbound.... completed DNSBL update [ 75917 | PASSED ]... completed [ 10/03/17 18:01:54 ] ------------------------------------------ ===[ Continent Process ]============================================ ===[ IPv6 Process ]================================================= ===[ Aliastables / Rules ]========================================== No changes to Firewall rules, skipping Filter Reload No Changes to Aliases, Skipping pfctl Update ===[ FINAL Processing ]===================================== [ Original IP count ] [ 0 ] ===[ DNSBL Domain/IP Counts ] =================================== 75917 total 26341 /var/db/pfblockerng/dnsbl/Malware.txt 21592 /var/db/pfblockerng/dnsbl/PiHole.txt 9823 /var/db/pfblockerng/dnsbl/AdServer.txt 8497 /var/db/pfblockerng/dnsbl/EasyList.txt 5918 /var/db/pfblockerng/dnsbl/Cameleon.txt 2888 /var/db/pfblockerng/dnsbl/EasyPrivacy.txt 373 /var/db/pfblockerng/dnsbl/Zeustracker.txt 362 /var/db/pfblockerng/dnsbl/SimpleAds.txt 101 /var/db/pfblockerng/dnsbl/MVPS.txt 22 /var/db/pfblockerng/dnsbl/SimpleTracking.txt IPv4 alias tables IP count ----------------------------- 0 IPv6 alias tables IP count ----------------------------- 0 Alias table IP Counts ----------------------------- pfSense Table Stats ------------------- table-entries hard limit 2000000 Table Usage Count 93387 UPDATE PROCESS ENDED [ 10/03/17 18:01:55 ]from here on the updates wont work - and every 3 hours the same:
CRON PROCESS START [ 10/03/17 21:00:00 ] [ PiHole ] ( No remote timestamp/md5 unchanged ) Update not required [ Malware ] Remote timestamp: Fri, 29 Sep 2017 21:18:24 GMT Local timestamp: Fri, 29 Sep 2017 21:18:24 GMT Update not required [ Cameleon ] Remote timestamp: Mon, 02 Oct 2017 07:40:54 GMT Local timestamp: Mon, 02 Oct 2017 07:40:54 GMT Update not required [ Zeustracker ] Remote timestamp: Sun, 01 Oct 2017 10:00:12 GMT Local timestamp: Sun, 01 Oct 2017 10:00:12 GMT Update not required [ SimpleTracking ] Remote timestamp: Fri, 31 Jul 2015 19:01:02 GMT Local timestamp: Fri, 31 Jul 2015 19:01:02 GMT Update not required [ SimpleAds ] Remote timestamp: Wed, 09 Mar 2016 19:46:05 GMT Local timestamp: Wed, 09 Mar 2016 19:46:05 GMT Update not required [ AdServer ] Remote timestamp: Tue, 03 Oct 2017 14:26:46 GMT Local timestamp: Tue, 03 Oct 2017 14:26:46 GMT Update not required [ MVPS ] Remote timestamp: Fri, 15 Sep 2017 14:51:32 GMT Local timestamp: Fri, 15 Sep 2017 14:51:32 GMT Update not required [ EasyList ] Remote timestamp: Tue, 03 Oct 2017 18:50:39 GMT Local timestamp: Tue, 03 Oct 2017 15:50:39 GMT Update found [ EasyPrivacy ] Remote timestamp: Tue, 03 Oct 2017 18:51:19 GMT Local timestamp: Tue, 03 Oct 2017 15:51:18 GMT Update found UPDATE PROCESS START [ 10/03/17 21:00:07 ] ===[ DNSBL Process ]================================================ CRON PROCESS START [ 10/04/17 00:00:00 ] . . .tried to remove db-files and rebuild but:
**Saving configuration [ 10/05/17 23:30:04 ] ... Removing DB Files/Folders **Saving configuration [ 10/05/17 23:30:15 ] ... **Saving configuration [ 10/05/17 23:35:10 ] ... Restarting Service DNSBL... UPDATE PROCESS START [ 10/05/17 23:36:05 ] ===[ DNSBL Process ]================================================ Missing DNSBL stats and/or Unbound DNSBL conf file - Rebuilding -
When you see "Update not required", then the Feed that the pkg is downloading is already up to date, so there is no reason to re-download and re-process the same feed again…. It also shows the Remote and Local timestamps in the logs...
