Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Feed not updating with cron but does by force

    Scheduled Pinned Locked Moved pfBlockerNG
    7 Posts 4 Posters 728 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • J
      Jobee
      last edited by

      I need some help before I go crazy. I am trying to use the BadIP feed (7 day).

      https://www.badips.com/get/list/any/2?age=7d

      First it was blocked because of GeoIP. I tried to create a whitelist but that did not work. So I removed the country from the GeoIP (whole other issue I may start a new thread on).

      It now updates, but only on a force. When it tries as part of a cron job, I get the following 2 errors in the cron log:

      [ BadIPs_7d_v4 ]
      ( md5 feed ) . 502 Bad Gateway
      Failed to download Feed for md5 comparison! Update skipped

      ....

      [ BadIPs_7d_v4 ] Downloading update .. 502 Bad Gateway

      [ pfB_PRI4_v4 - BadIPs_7d_v4 ] Download FAIL [ 03/22/20 20:00:25 ]
      Firewall and/or IDS (Legacy mode only) are not blocking download.

      Restoring previously downloaded file contents... completed ..

      If I force a run, it does fine.

      [ BadIPs_7d_v4 ] Downloading update .. 200 OK. completed ..

      Aggregation Stats:

      Original Final

      26475 25972

      Anyone have an idea of what is going on.... It is only this feed. All other feeds are working without issue as of now.

      Running 2.2.5_29 dev on 2.4.4.R-p3

      J 1 Reply Last reply Reply Quote 0
      • J
        jdeloach @Jobee
        last edited by

        @Jobee said in Feed not updating with cron but does by force:

        I need some help before I go crazy. I am trying to use the BadIP feed (7 day).

        https://www.badips.com/get/list/any/2?age=7d

        That feed appears to be down. I would just remove it from your pfBlocker list and then do a force reload. That should clear it.

        It's not uncommon for some of the sites to go offline for several days.

        J 1 Reply Last reply Reply Quote 0
        • provelsP
          provels
          last edited by provels

          Not sure what the "?age=7d" means (maybe IPs added in last week?), but I do get a list if I use https://www.badips.com/get/list/any/2 alone.

          EDIT - Odd, https://www.badips.com/get/list/any/2?age=7d just now started working. Was getting "Bad Gateway"... Go figure.

          Peder

          MAIN - pfSense+ 24.11-RELEASE - Adlink MXE-5401, i7, 16 GB RAM, 64 GB SSD. 500 GB HDD for SyslogNG
          BACKUP - pfSense+ 23.01-RELEASE - Hyper-V Virtual Machine, Gen 1, 2 v-CPUs, 3 GB RAM, 8GB VHDX (Dynamic)

          J 1 Reply Last reply Reply Quote 0
          • J
            jdeloach @provels
            last edited by jdeloach

            @provels said in Feed not updating with cron but does by force:

            Not sure what the "?age=7d" means (maybe IPs added in last week?), but I do get a list if I use https://www.badips.com/get/list/any/2 alone.

            EDIT - Odd, https://www.badips.com/get/list/any/2?age=7d just now started working. Was getting "Bad Gateway"... Go figure.

            Yep, it works for me now too, didn't work earlier.

            provelsP 1 Reply Last reply Reply Quote 0
            • provelsP
              provels @jdeloach
              last edited by

              @jdeloach Networking/Notworking...

              Peder

              MAIN - pfSense+ 24.11-RELEASE - Adlink MXE-5401, i7, 16 GB RAM, 64 GB SSD. 500 GB HDD for SyslogNG
              BACKUP - pfSense+ 23.01-RELEASE - Hyper-V Virtual Machine, Gen 1, 2 v-CPUs, 3 GB RAM, 8GB VHDX (Dynamic)

              1 Reply Last reply Reply Quote 0
              • J
                Jobee @jdeloach
                last edited by

                @jdeloach

                Thanks for the suggestion but you missed the problem. The list works when you do it manually. It gets the bad gateway when the cron job does it.

                1 Reply Last reply Reply Quote 0
                • S
                  serbus
                  last edited by

                  Hello!

                  Are you using ram disks in System/Advanced/Miscellaneous?

                  This sounds oddly similar to these :

                  https://forum.netgate.com/topic/151591/sort-4-not-downloading-vrt-rules/
                  https://forum.netgate.com/topic/151634/php-errors/

                  John

                  Lex parsimoniae

                  1 Reply Last reply Reply Quote 0
                  • First post
                    Last post
                  Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.