Update / cron job [Error]



  • Update Process (manual or cron job) won't finish since 2 days. Nothing changed in my configuration. I tried to remove db.files & re-/uninstall the package but won't work anymore…
    Any suggestions?

    thx

    Last sucessfull update

    CRON  PROCESS  START [ 10/03/17 18:00:00 ]
    [ PiHole ]
    	( No remote timestamp/md5 unchanged )		Update not required
    [ Malware ]
      Remote timestamp: Fri, 29 Sep 2017 21:18:24 GMT
      Local  timestamp: Fri, 29 Sep 2017 21:18:24 GMT	Update not required
    [ Cameleon ]
      Remote timestamp: Mon, 02 Oct 2017 07:40:54 GMT
      Local  timestamp: Mon, 02 Oct 2017 07:40:54 GMT	Update not required
    [ Zeustracker ]
      Remote timestamp: Sun, 01 Oct 2017 10:00:12 GMT
      Local  timestamp: Sun, 01 Oct 2017 10:00:12 GMT	Update not required
    [ SimpleTracking ]
      Remote timestamp: Fri, 31 Jul 2015 19:01:02 GMT
      Local  timestamp: Fri, 31 Jul 2015 19:01:02 GMT	Update not required
    [ SimpleAds ]
      Remote timestamp: Wed, 09 Mar 2016 19:46:05 GMT
      Local  timestamp: Wed, 09 Mar 2016 19:46:05 GMT	Update not required
    [ AdServer ]
      Remote timestamp: Tue, 03 Oct 2017 14:26:46 GMT
      Local  timestamp: Sat, 30 Sep 2017 13:11:38 GMT	Update found
    [ MVPS ]
      Remote timestamp: Fri, 15 Sep 2017 14:51:32 GMT
      Local  timestamp: Fri, 15 Sep 2017 14:51:32 GMT	Update not required
    [ EasyList ]
      Remote timestamp: Tue, 03 Oct 2017 15:50:39 GMT
      Local  timestamp: Tue, 03 Oct 2017 12:50:40 GMT	Update found
    [ EasyPrivacy ]
      Remote timestamp: Tue, 03 Oct 2017 15:51:18 GMT
      Local  timestamp: Tue, 03 Oct 2017 12:51:19 GMT	Update found
     UPDATE PROCESS START [ 10/03/17 18:00:23 ]
    
    ===[  DNSBL Process  ]================================================
    
    [ EasyList ]		 Downloading update [ 10/03/17 18:00:24 ] .. 200 OK.
      Whitelist: amazon-adsystem.com|entrecard.s3.amazonaws.com|imasdk.googleapis.com|ltassrv.com.s3.amazonaws.com|
      Alexa Whitelist: 4dsply.com|62b70ac32d4614b.com|a-static.com|ablogica.com|ad-apac.doubleclick.net|ad-emea.doubleclick.net|ad.admitad.com|ad.doubleclick.net|ad.mo.doubleclick.net|adbooth.com|adespresso.com|adfarm.mediaplex.com|adform.net|adk2x.com|adpays.net|ads.rd.linksynergy.com|adscpm.net|adshell.net|adsjudo.com|adskpak.com|adtwbjs.com|ae1a1e258b8b016.com|affiliaxe.com|alimama.com|amp.rd.linksynergy.com|ampxchange.com|apycomm.com|atadserver.com|bizzclick.com|bobblewrite.com|boodlewrite.com|brucelead.com|clicksgear.com|clixsense.com|cm.g.doubleclick.net|codeonclick.com|cointraffic.io|consivenu.com|cpm20.com|cpm30.com|doublepimpssl.com|eroterest.net|exdynsrv.com|exosrv.com|explorads.com|eyewond.hs.llnwd.net|fapality.com|findbetterresults.com|freewebcams.com|gan.doubleclick.net|garowrite.com|googleads.g.doubleclick.net|goviral.hs.llnwd.net|h6y654wgfdhd.com|hoomefodl.com|ifilez.org|intentmedia.net|iv.doubleclick.net|jango.com|junbi-tracker.com|leadzu.com|linkmyc.com|liveadexchanger.com|lockerdome.com|media-serving.com|mellowads.com|mpnrs.com|n4403ad.doubleclick.net|neobux.com|onclickmax.com|onclicktop.com|padsdel.com|partner.googleadservices.com|partner.video.syndication.msn.com|pipsol.net|poptm.com|potpourrichordataoscilloscope.com|predictivadnetwork.com|prxio.github.io|pubads.g.doubleclick.net|pussl10.com|pussl13.com|putrr3.com|rapidyl.net|reallifecam.com|royalads.net|runetki.com|sekindo.com|simplyhired.com|smartadtags.com|society6.com|speakol.com|superadexchange.com|td583.com|trafficdelivery1.com|trafficshop.com|trafficular.com|vcommission.com|venturead.com|wsp.mgid.com|wzus1.ask.com|xxxbunker.com|yesadsrv.com|
      ----------------------------------------------------------------------
      Orig.    Unique     # Dups     # White    # Alexa    Final                
      ----------------------------------------------------------------------
      9270     8752       125        4          103        8520                 
      ----------------------------------------------------------------------
    
    [ EasyPrivacy ]		 Downloading update [ 10/03/17 18:00:25 ] .. 200 OK.
      Alexa Whitelist: a8.net|bigmir.net|cint.com|cnzz.com|confirmit.com|easycounter.com|eloqua.com|engageya.com|farmer.wego.com|getdrip.com|instapage.com|lentainform.com|linksynergy.com|omgpm.com|omguk.com|optimizely.com|sas.com|smallseotools.com|sociaplus.com|srvtrck.com|
      ----------------------------------------------------------------------
      Orig.    Unique     # Dups     # White    # Alexa    Final                
      ----------------------------------------------------------------------
      2997     2975       58         0          20         2897                 
      ----------------------------------------------------------------------
    
    [ PiHole ]		 exists. [ 10/03/17 18:00:26 ]
    [ Malware ]		 exists.
    [ Cameleon ]		 exists.
    [ Zeustracker ]		 exists.
    [ SimpleTracking ]	 exists.
    [ SimpleAds ]		 exists.
    [ AdServer ]		 Downloading update .. 200 OK.
      Whitelist: a6522.s3-website-us-east-1.amazonaws.com|aax-eu-rtb.amazon-adsystem.com|aax-eu.amazon-adsystem.com|aax-fe-sin.amazon-adsystem.com|aax-fe.amazon-adsystem.com|aax-us-east.amazon-adsystem.com|aax-us-pdx.amazon-adsystem.com|aax-us-west.amazon-adsystem.com|ad-creatives-public.commondatastorage.googleapis.com|admarvel.s3.amazonaws.com|ads_ad_center.s3.amazonaws.com|adstracking.s3-website-us-west-1.amazonaws.com|advice-ads.s3.amazonaws.com|advrts.s3.amazonaws.com|adzerk-www.s3.amazonaws.com|airpushmarketing.s3.amazonaws.com|analyticsengine.s3.amazonaws.com|applab-sdk.amazon.com|arabmistress.s3.amazonaws.com|blamads-assets.s3.amazonaws.com|bo-videos.s3.amazonaws.com|c.amazon-adsystem.com|cadreon.s3.amazonaws.com|campaign-tapad.s3.amazonaws.com|cd-ladsp-com.s3.amazonaws.com|ce2-dev-trk.s3.amazonaws.com|ce2-dev.s3.amazonaws.com|chartaca.com.s3.amazonaws.com|cloudfront-labs.amazonaws.com|com.djinnworks.sdm.s3.amazonaws.com|convertglobal.s3.amazonaws.com|dban4-549565586.eu-west-1.elb.amazonaws.com|demandmedia.s3.amazonaws.com|deskwww.s3.amazonaws.com|device-metrics-us-2.amazon.com|ec2-54-171-97-32.eu-west-1.compute.amazonaws.com|ec2-54-225-149-4.compute-1.amazonaws.com|ec2-54-235-183-132.compute-1.amazonaws.com|epowernetworktrackerimages.s3.amazonaws.com|evs-hosted-14facd241e1c08.s3.amazonaws.com|fls-eu.amazon-adsystem.com|fls-eu.amazon.com|fls-fe.amazon-adsystem.com|fls-na.amazon-adsystem.com|forumwarz.s3.amazonaws.com|gateways.s3.amazonaws.com|getbarometer.s3.amazonaws.com|getsidecar.s3.amazonaws.com|gfaf-banners.s3.amazonaws.com|homad-global-configs-eu-fra.schneevonmorgen.com.s3.amazonaws.com|html5adkit.plusmo.s3.amazonaws.com|iacpromotion.s3.amazonaws.com|immassets.s3.amazonaws.com|inneractive-assets.s3.amazonaws.com|inpref.s3-external-3.amazonaws.com|inpref.s3.amazonaws.com|ir-de.amazon-adsystem.com|ir-jp.amazon-adsystem.com|ir-na.amazon-adsystem.com|kkastatic.s3.amazonaws.com|kraken-measurements.s3.amazonaws.com|livechat.s3.amazonaws.com|loved-by.s3.amazonaws.com|ltassrv.com.s3.amazonaws.com|mads.amazon-adsystem.com|magnify360-cdn.s3.amazonaws.com|matchbin-assets.s3.amazonaws.com|myadserve.s3-website-us-east-1.amazonaws.com|newbuzz-collection-1925855828.us-east-1.elb.amazonaws.com|news-whistleout.s3.amazonaws.com|nxa-ls.s3.amazonaws.com|optimizely.s3.amazonaws.com|ps-eu.amazon-adsystem.com|rcm-fe.amazon-adsystem.com|rcm-images.amazon.com|rcm.amazon.com|rich-agent.s3.amazonaws.com|s.amazon-adsystem.com|s3-tracking.synthasite.net.s3.amazonaws.com|sana.newsinc.com.s3.amazonaws.com|sdsbucket.s3.amazonaws.com|spyhunter-download.s3.amazonaws.com|ssl.google-analytics.com|strikeadcdn.s3.amazonaws.com|thetradedesk-tags.s3.amazonaws.com|trafficads.s3-website-us-west-1.amazonaws.com|tree-pixel-log.s3.amazonaws.com|twitter-badges.s3.amazonaws.com|v.amazon-adsystem.com|vice-ads.s3.amazonaws.com|waiwidgets-1246822334.eu-west-1.elb.amazonaws.com|whistleout.s3.amazonaws.com|wms-eu.amazon-adsystem.com|wms-fe.amazon-adsystem.com|ws-eu.amazon-adsystem.com|ws-na.amazon-adsystem.com|ws.amazon.com|www.google-analytics.com|www.googleadservices.com|yc-ads.s3.amazonaws.com|z-na.amazon-adsystem.com|
      ----------------------------------------------------------------------
      Orig.    Unique     # Dups     # White    # Alexa    Final                
      ----------------------------------------------------------------------
      48061    48058      4531       101        0          43426                
      ----------------------------------------------------------------------
    
    [ MVPS ]		 exists. [ 10/03/17 18:01:23 ]
    ------------------------------------------
    Assembling database... completed
    Executing TLD
    TLD analysis.. completed
    Finalizing TLD...  completed
     ----------------------------------------
     Original    Matches    Removed    Final     
     ----------------------------------------
     109552      48656      33635      75917     
     -----------------------------------------
    Validating database... completed [ 10/03/17 18:01:48 ]
    Reloading Unbound.... completed
    DNSBL update [ 75917 | PASSED  ]... completed [ 10/03/17 18:01:54 ]
    ------------------------------------------
    
    ===[  Continent Process  ]============================================
    
    ===[  IPv6 Process  ]=================================================
    
    ===[  Aliastables / Rules  ]==========================================
    
    No changes to Firewall rules, skipping Filter Reload
    No Changes to Aliases, Skipping pfctl Update
    
    ===[ FINAL Processing ]=====================================
    
       [ Original IP count   ]  [ 0 ]
    
    ===[ DNSBL Domain/IP Counts ] ===================================
    
       75917 total
       26341 /var/db/pfblockerng/dnsbl/Malware.txt
       21592 /var/db/pfblockerng/dnsbl/PiHole.txt
        9823 /var/db/pfblockerng/dnsbl/AdServer.txt
        8497 /var/db/pfblockerng/dnsbl/EasyList.txt
        5918 /var/db/pfblockerng/dnsbl/Cameleon.txt
        2888 /var/db/pfblockerng/dnsbl/EasyPrivacy.txt
         373 /var/db/pfblockerng/dnsbl/Zeustracker.txt
         362 /var/db/pfblockerng/dnsbl/SimpleAds.txt
         101 /var/db/pfblockerng/dnsbl/MVPS.txt
          22 /var/db/pfblockerng/dnsbl/SimpleTracking.txt
    
    IPv4 alias tables IP count
    -----------------------------
    0
    
    IPv6 alias tables IP count
    -----------------------------
    0
    
    Alias table IP Counts
    -----------------------------
    
    pfSense Table Stats
    -------------------
    table-entries hard limit  2000000
    Table Usage Count         93387
    
     UPDATE PROCESS ENDED [ 10/03/17 18:01:55 ]
    

    from here on the updates wont work - and every 3 hours the same:

    
     CRON  PROCESS  START [ 10/03/17 21:00:00 ]
    [ PiHole ]
    	( No remote timestamp/md5 unchanged )		Update not required
    [ Malware ]
      Remote timestamp: Fri, 29 Sep 2017 21:18:24 GMT
      Local  timestamp: Fri, 29 Sep 2017 21:18:24 GMT	Update not required
    [ Cameleon ]
      Remote timestamp: Mon, 02 Oct 2017 07:40:54 GMT
      Local  timestamp: Mon, 02 Oct 2017 07:40:54 GMT	Update not required
    [ Zeustracker ]
      Remote timestamp: Sun, 01 Oct 2017 10:00:12 GMT
      Local  timestamp: Sun, 01 Oct 2017 10:00:12 GMT	Update not required
    [ SimpleTracking ]
      Remote timestamp: Fri, 31 Jul 2015 19:01:02 GMT
      Local  timestamp: Fri, 31 Jul 2015 19:01:02 GMT	Update not required
    [ SimpleAds ]
      Remote timestamp: Wed, 09 Mar 2016 19:46:05 GMT
      Local  timestamp: Wed, 09 Mar 2016 19:46:05 GMT	Update not required
    [ AdServer ]
      Remote timestamp: Tue, 03 Oct 2017 14:26:46 GMT
      Local  timestamp: Tue, 03 Oct 2017 14:26:46 GMT	Update not required
    [ MVPS ]
      Remote timestamp: Fri, 15 Sep 2017 14:51:32 GMT
      Local  timestamp: Fri, 15 Sep 2017 14:51:32 GMT	Update not required
    [ EasyList ]
      Remote timestamp: Tue, 03 Oct 2017 18:50:39 GMT
      Local  timestamp: Tue, 03 Oct 2017 15:50:39 GMT	Update found
    [ EasyPrivacy ]
      Remote timestamp: Tue, 03 Oct 2017 18:51:19 GMT
      Local  timestamp: Tue, 03 Oct 2017 15:51:18 GMT	Update found
     UPDATE PROCESS START [ 10/03/17 21:00:07 ]
    
    ===[  DNSBL Process  ]================================================
     CRON  PROCESS  START [ 10/04/17 00:00:00 ]
     .
     .
     .
    
    

    tried to remove db-files and rebuild but:

    
     **Saving configuration [ 10/05/17 23:30:04 ] ...
    
      Removing DB Files/Folders 
    
    **Saving configuration [ 10/05/17 23:30:15 ] ...
    
    **Saving configuration [ 10/05/17 23:35:10 ] ...
    Restarting Service DNSBL...
     UPDATE PROCESS START [ 10/05/17 23:36:05 ]
    
    ===[  DNSBL Process  ]================================================
    Missing DNSBL stats and/or Unbound DNSBL conf file - Rebuilding
    

  • Moderator

    When you see "Update not required", then the Feed that the pkg is downloading is already up to date, so there is no reason to re-download and re-process the same feed again….  It also shows the Remote and Local timestamps in the logs...