Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Update / cron job [Error]

    pfBlockerNG
    2
    2
    489
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • V
      vicesquad
      last edited by

      Update Process (manual or cron job) won't finish since 2 days. Nothing changed in my configuration. I tried to remove db.files & re-/uninstall the package but won't work anymore…
      Any suggestions?

      thx

      Last sucessfull update

      CRON  PROCESS  START [ 10/03/17 18:00:00 ]
      [ PiHole ]
      	( No remote timestamp/md5 unchanged )		Update not required
      [ Malware ]
        Remote timestamp: Fri, 29 Sep 2017 21:18:24 GMT
        Local  timestamp: Fri, 29 Sep 2017 21:18:24 GMT	Update not required
      [ Cameleon ]
        Remote timestamp: Mon, 02 Oct 2017 07:40:54 GMT
        Local  timestamp: Mon, 02 Oct 2017 07:40:54 GMT	Update not required
      [ Zeustracker ]
        Remote timestamp: Sun, 01 Oct 2017 10:00:12 GMT
        Local  timestamp: Sun, 01 Oct 2017 10:00:12 GMT	Update not required
      [ SimpleTracking ]
        Remote timestamp: Fri, 31 Jul 2015 19:01:02 GMT
        Local  timestamp: Fri, 31 Jul 2015 19:01:02 GMT	Update not required
      [ SimpleAds ]
        Remote timestamp: Wed, 09 Mar 2016 19:46:05 GMT
        Local  timestamp: Wed, 09 Mar 2016 19:46:05 GMT	Update not required
      [ AdServer ]
        Remote timestamp: Tue, 03 Oct 2017 14:26:46 GMT
        Local  timestamp: Sat, 30 Sep 2017 13:11:38 GMT	Update found
      [ MVPS ]
        Remote timestamp: Fri, 15 Sep 2017 14:51:32 GMT
        Local  timestamp: Fri, 15 Sep 2017 14:51:32 GMT	Update not required
      [ EasyList ]
        Remote timestamp: Tue, 03 Oct 2017 15:50:39 GMT
        Local  timestamp: Tue, 03 Oct 2017 12:50:40 GMT	Update found
      [ EasyPrivacy ]
        Remote timestamp: Tue, 03 Oct 2017 15:51:18 GMT
        Local  timestamp: Tue, 03 Oct 2017 12:51:19 GMT	Update found
       UPDATE PROCESS START [ 10/03/17 18:00:23 ]
      
      ===[  DNSBL Process  ]================================================
      
      [ EasyList ]		 Downloading update [ 10/03/17 18:00:24 ] .. 200 OK.
        Whitelist: amazon-adsystem.com|entrecard.s3.amazonaws.com|imasdk.googleapis.com|ltassrv.com.s3.amazonaws.com|
        Alexa Whitelist: 4dsply.com|62b70ac32d4614b.com|a-static.com|ablogica.com|ad-apac.doubleclick.net|ad-emea.doubleclick.net|ad.admitad.com|ad.doubleclick.net|ad.mo.doubleclick.net|adbooth.com|adespresso.com|adfarm.mediaplex.com|adform.net|adk2x.com|adpays.net|ads.rd.linksynergy.com|adscpm.net|adshell.net|adsjudo.com|adskpak.com|adtwbjs.com|ae1a1e258b8b016.com|affiliaxe.com|alimama.com|amp.rd.linksynergy.com|ampxchange.com|apycomm.com|atadserver.com|bizzclick.com|bobblewrite.com|boodlewrite.com|brucelead.com|clicksgear.com|clixsense.com|cm.g.doubleclick.net|codeonclick.com|cointraffic.io|consivenu.com|cpm20.com|cpm30.com|doublepimpssl.com|eroterest.net|exdynsrv.com|exosrv.com|explorads.com|eyewond.hs.llnwd.net|fapality.com|findbetterresults.com|freewebcams.com|gan.doubleclick.net|garowrite.com|googleads.g.doubleclick.net|goviral.hs.llnwd.net|h6y654wgfdhd.com|hoomefodl.com|ifilez.org|intentmedia.net|iv.doubleclick.net|jango.com|junbi-tracker.com|leadzu.com|linkmyc.com|liveadexchanger.com|lockerdome.com|media-serving.com|mellowads.com|mpnrs.com|n4403ad.doubleclick.net|neobux.com|onclickmax.com|onclicktop.com|padsdel.com|partner.googleadservices.com|partner.video.syndication.msn.com|pipsol.net|poptm.com|potpourrichordataoscilloscope.com|predictivadnetwork.com|prxio.github.io|pubads.g.doubleclick.net|pussl10.com|pussl13.com|putrr3.com|rapidyl.net|reallifecam.com|royalads.net|runetki.com|sekindo.com|simplyhired.com|smartadtags.com|society6.com|speakol.com|superadexchange.com|td583.com|trafficdelivery1.com|trafficshop.com|trafficular.com|vcommission.com|venturead.com|wsp.mgid.com|wzus1.ask.com|xxxbunker.com|yesadsrv.com|
        ----------------------------------------------------------------------
        Orig.    Unique     # Dups     # White    # Alexa    Final                
        ----------------------------------------------------------------------
        9270     8752       125        4          103        8520                 
        ----------------------------------------------------------------------
      
      [ EasyPrivacy ]		 Downloading update [ 10/03/17 18:00:25 ] .. 200 OK.
        Alexa Whitelist: a8.net|bigmir.net|cint.com|cnzz.com|confirmit.com|easycounter.com|eloqua.com|engageya.com|farmer.wego.com|getdrip.com|instapage.com|lentainform.com|linksynergy.com|omgpm.com|omguk.com|optimizely.com|sas.com|smallseotools.com|sociaplus.com|srvtrck.com|
        ----------------------------------------------------------------------
        Orig.    Unique     # Dups     # White    # Alexa    Final                
        ----------------------------------------------------------------------
        2997     2975       58         0          20         2897                 
        ----------------------------------------------------------------------
      
      [ PiHole ]		 exists. [ 10/03/17 18:00:26 ]
      [ Malware ]		 exists.
      [ Cameleon ]		 exists.
      [ Zeustracker ]		 exists.
      [ SimpleTracking ]	 exists.
      [ SimpleAds ]		 exists.
      [ AdServer ]		 Downloading update .. 200 OK.
        Whitelist: a6522.s3-website-us-east-1.amazonaws.com|aax-eu-rtb.amazon-adsystem.com|aax-eu.amazon-adsystem.com|aax-fe-sin.amazon-adsystem.com|aax-fe.amazon-adsystem.com|aax-us-east.amazon-adsystem.com|aax-us-pdx.amazon-adsystem.com|aax-us-west.amazon-adsystem.com|ad-creatives-public.commondatastorage.googleapis.com|admarvel.s3.amazonaws.com|ads_ad_center.s3.amazonaws.com|adstracking.s3-website-us-west-1.amazonaws.com|advice-ads.s3.amazonaws.com|advrts.s3.amazonaws.com|adzerk-www.s3.amazonaws.com|airpushmarketing.s3.amazonaws.com|analyticsengine.s3.amazonaws.com|applab-sdk.amazon.com|arabmistress.s3.amazonaws.com|blamads-assets.s3.amazonaws.com|bo-videos.s3.amazonaws.com|c.amazon-adsystem.com|cadreon.s3.amazonaws.com|campaign-tapad.s3.amazonaws.com|cd-ladsp-com.s3.amazonaws.com|ce2-dev-trk.s3.amazonaws.com|ce2-dev.s3.amazonaws.com|chartaca.com.s3.amazonaws.com|cloudfront-labs.amazonaws.com|com.djinnworks.sdm.s3.amazonaws.com|convertglobal.s3.amazonaws.com|dban4-549565586.eu-west-1.elb.amazonaws.com|demandmedia.s3.amazonaws.com|deskwww.s3.amazonaws.com|device-metrics-us-2.amazon.com|ec2-54-171-97-32.eu-west-1.compute.amazonaws.com|ec2-54-225-149-4.compute-1.amazonaws.com|ec2-54-235-183-132.compute-1.amazonaws.com|epowernetworktrackerimages.s3.amazonaws.com|evs-hosted-14facd241e1c08.s3.amazonaws.com|fls-eu.amazon-adsystem.com|fls-eu.amazon.com|fls-fe.amazon-adsystem.com|fls-na.amazon-adsystem.com|forumwarz.s3.amazonaws.com|gateways.s3.amazonaws.com|getbarometer.s3.amazonaws.com|getsidecar.s3.amazonaws.com|gfaf-banners.s3.amazonaws.com|homad-global-configs-eu-fra.schneevonmorgen.com.s3.amazonaws.com|html5adkit.plusmo.s3.amazonaws.com|iacpromotion.s3.amazonaws.com|immassets.s3.amazonaws.com|inneractive-assets.s3.amazonaws.com|inpref.s3-external-3.amazonaws.com|inpref.s3.amazonaws.com|ir-de.amazon-adsystem.com|ir-jp.amazon-adsystem.com|ir-na.amazon-adsystem.com|kkastatic.s3.amazonaws.com|kraken-measurements.s3.amazonaws.com|livechat.s3.amazonaws.com|loved-by.s3.amazonaws.com|ltassrv.com.s3.amazonaws.com|mads.amazon-adsystem.com|magnify360-cdn.s3.amazonaws.com|matchbin-assets.s3.amazonaws.com|myadserve.s3-website-us-east-1.amazonaws.com|newbuzz-collection-1925855828.us-east-1.elb.amazonaws.com|news-whistleout.s3.amazonaws.com|nxa-ls.s3.amazonaws.com|optimizely.s3.amazonaws.com|ps-eu.amazon-adsystem.com|rcm-fe.amazon-adsystem.com|rcm-images.amazon.com|rcm.amazon.com|rich-agent.s3.amazonaws.com|s.amazon-adsystem.com|s3-tracking.synthasite.net.s3.amazonaws.com|sana.newsinc.com.s3.amazonaws.com|sdsbucket.s3.amazonaws.com|spyhunter-download.s3.amazonaws.com|ssl.google-analytics.com|strikeadcdn.s3.amazonaws.com|thetradedesk-tags.s3.amazonaws.com|trafficads.s3-website-us-west-1.amazonaws.com|tree-pixel-log.s3.amazonaws.com|twitter-badges.s3.amazonaws.com|v.amazon-adsystem.com|vice-ads.s3.amazonaws.com|waiwidgets-1246822334.eu-west-1.elb.amazonaws.com|whistleout.s3.amazonaws.com|wms-eu.amazon-adsystem.com|wms-fe.amazon-adsystem.com|ws-eu.amazon-adsystem.com|ws-na.amazon-adsystem.com|ws.amazon.com|www.google-analytics.com|www.googleadservices.com|yc-ads.s3.amazonaws.com|z-na.amazon-adsystem.com|
        ----------------------------------------------------------------------
        Orig.    Unique     # Dups     # White    # Alexa    Final                
        ----------------------------------------------------------------------
        48061    48058      4531       101        0          43426                
        ----------------------------------------------------------------------
      
      [ MVPS ]		 exists. [ 10/03/17 18:01:23 ]
      ------------------------------------------
      Assembling database... completed
      Executing TLD
      TLD analysis.. completed
      Finalizing TLD...  completed
       ----------------------------------------
       Original    Matches    Removed    Final     
       ----------------------------------------
       109552      48656      33635      75917     
       -----------------------------------------
      Validating database... completed [ 10/03/17 18:01:48 ]
      Reloading Unbound.... completed
      DNSBL update [ 75917 | PASSED  ]... completed [ 10/03/17 18:01:54 ]
      ------------------------------------------
      
      ===[  Continent Process  ]============================================
      
      ===[  IPv6 Process  ]=================================================
      
      ===[  Aliastables / Rules  ]==========================================
      
      No changes to Firewall rules, skipping Filter Reload
      No Changes to Aliases, Skipping pfctl Update
      
      ===[ FINAL Processing ]=====================================
      
         [ Original IP count   ]  [ 0 ]
      
      ===[ DNSBL Domain/IP Counts ] ===================================
      
         75917 total
         26341 /var/db/pfblockerng/dnsbl/Malware.txt
         21592 /var/db/pfblockerng/dnsbl/PiHole.txt
          9823 /var/db/pfblockerng/dnsbl/AdServer.txt
          8497 /var/db/pfblockerng/dnsbl/EasyList.txt
          5918 /var/db/pfblockerng/dnsbl/Cameleon.txt
          2888 /var/db/pfblockerng/dnsbl/EasyPrivacy.txt
           373 /var/db/pfblockerng/dnsbl/Zeustracker.txt
           362 /var/db/pfblockerng/dnsbl/SimpleAds.txt
           101 /var/db/pfblockerng/dnsbl/MVPS.txt
            22 /var/db/pfblockerng/dnsbl/SimpleTracking.txt
      
      IPv4 alias tables IP count
      -----------------------------
      0
      
      IPv6 alias tables IP count
      -----------------------------
      0
      
      Alias table IP Counts
      -----------------------------
      
      pfSense Table Stats
      -------------------
      table-entries hard limit  2000000
      Table Usage Count         93387
      
       UPDATE PROCESS ENDED [ 10/03/17 18:01:55 ]
      

      from here on the updates wont work - and every 3 hours the same:

      
       CRON  PROCESS  START [ 10/03/17 21:00:00 ]
      [ PiHole ]
      	( No remote timestamp/md5 unchanged )		Update not required
      [ Malware ]
        Remote timestamp: Fri, 29 Sep 2017 21:18:24 GMT
        Local  timestamp: Fri, 29 Sep 2017 21:18:24 GMT	Update not required
      [ Cameleon ]
        Remote timestamp: Mon, 02 Oct 2017 07:40:54 GMT
        Local  timestamp: Mon, 02 Oct 2017 07:40:54 GMT	Update not required
      [ Zeustracker ]
        Remote timestamp: Sun, 01 Oct 2017 10:00:12 GMT
        Local  timestamp: Sun, 01 Oct 2017 10:00:12 GMT	Update not required
      [ SimpleTracking ]
        Remote timestamp: Fri, 31 Jul 2015 19:01:02 GMT
        Local  timestamp: Fri, 31 Jul 2015 19:01:02 GMT	Update not required
      [ SimpleAds ]
        Remote timestamp: Wed, 09 Mar 2016 19:46:05 GMT
        Local  timestamp: Wed, 09 Mar 2016 19:46:05 GMT	Update not required
      [ AdServer ]
        Remote timestamp: Tue, 03 Oct 2017 14:26:46 GMT
        Local  timestamp: Tue, 03 Oct 2017 14:26:46 GMT	Update not required
      [ MVPS ]
        Remote timestamp: Fri, 15 Sep 2017 14:51:32 GMT
        Local  timestamp: Fri, 15 Sep 2017 14:51:32 GMT	Update not required
      [ EasyList ]
        Remote timestamp: Tue, 03 Oct 2017 18:50:39 GMT
        Local  timestamp: Tue, 03 Oct 2017 15:50:39 GMT	Update found
      [ EasyPrivacy ]
        Remote timestamp: Tue, 03 Oct 2017 18:51:19 GMT
        Local  timestamp: Tue, 03 Oct 2017 15:51:18 GMT	Update found
       UPDATE PROCESS START [ 10/03/17 21:00:07 ]
      
      ===[  DNSBL Process  ]================================================
       CRON  PROCESS  START [ 10/04/17 00:00:00 ]
       .
       .
       .
      
      

      tried to remove db-files and rebuild but:

      
       **Saving configuration [ 10/05/17 23:30:04 ] ...
      
        Removing DB Files/Folders 
      
      **Saving configuration [ 10/05/17 23:30:15 ] ...
      
      **Saving configuration [ 10/05/17 23:35:10 ] ...
      Restarting Service DNSBL...
       UPDATE PROCESS START [ 10/05/17 23:36:05 ]
      
      ===[  DNSBL Process  ]================================================
      Missing DNSBL stats and/or Unbound DNSBL conf file - Rebuilding
      
      1 Reply Last reply Reply Quote 0
      • BBcan177B
        BBcan177 Moderator
        last edited by

        When you see "Update not required", then the Feed that the pkg is downloading is already up to date, so there is no reason to re-download and re-process the same feed again….  It also shows the Remote and Local timestamps in the logs...

        "Experience is something you don't get until just after you need it."

        Website: http://pfBlockerNG.com
        Twitter: @BBcan177  #pfBlockerNG
        Reddit: https://www.reddit.com/r/pfBlockerNG/new/

        1 Reply Last reply Reply Quote 0
        • First post
          Last post