• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login
Netgate Discussion Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login

Feed not updating with cron but does by force

Scheduled Pinned Locked Moved pfBlockerNG
7 Posts 4 Posters 768 Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • J
    Jobee
    last edited by Mar 23, 2020, 1:53 AM

    I need some help before I go crazy. I am trying to use the BadIP feed (7 day).

    https://www.badips.com/get/list/any/2?age=7d

    First it was blocked because of GeoIP. I tried to create a whitelist but that did not work. So I removed the country from the GeoIP (whole other issue I may start a new thread on).

    It now updates, but only on a force. When it tries as part of a cron job, I get the following 2 errors in the cron log:

    [ BadIPs_7d_v4 ]
    ( md5 feed ) . 502 Bad Gateway
    Failed to download Feed for md5 comparison! Update skipped

    ....

    [ BadIPs_7d_v4 ] Downloading update .. 502 Bad Gateway

    [ pfB_PRI4_v4 - BadIPs_7d_v4 ] Download FAIL [ 03/22/20 20:00:25 ]
    Firewall and/or IDS (Legacy mode only) are not blocking download.

    Restoring previously downloaded file contents... completed ..

    If I force a run, it does fine.

    [ BadIPs_7d_v4 ] Downloading update .. 200 OK. completed ..

    Aggregation Stats:

    Original Final

    26475 25972

    Anyone have an idea of what is going on.... It is only this feed. All other feeds are working without issue as of now.

    Running 2.2.5_29 dev on 2.4.4.R-p3

    J 1 Reply Last reply Mar 23, 2020, 8:53 AM Reply Quote 0
    • J
      jdeloach @Jobee
      last edited by Mar 23, 2020, 8:53 AM

      @Jobee said in Feed not updating with cron but does by force:

      I need some help before I go crazy. I am trying to use the BadIP feed (7 day).

      https://www.badips.com/get/list/any/2?age=7d

      That feed appears to be down. I would just remove it from your pfBlocker list and then do a force reload. That should clear it.

      It's not uncommon for some of the sites to go offline for several days.

      J 1 Reply Last reply Mar 25, 2020, 2:32 PM Reply Quote 0
      • P
        provels
        last edited by provels Mar 23, 2020, 9:19 AM Mar 23, 2020, 9:11 AM

        Not sure what the "?age=7d" means (maybe IPs added in last week?), but I do get a list if I use https://www.badips.com/get/list/any/2 alone.

        EDIT - Odd, https://www.badips.com/get/list/any/2?age=7d just now started working. Was getting "Bad Gateway"... Go figure.

        Peder

        MAIN - pfSense+ 24.11-RELEASE - Adlink MXE-5401, i7, 16 GB RAM, 64 GB SSD. 500 GB HDD for SyslogNG
        BACKUP - pfSense+ 23.01-RELEASE - Hyper-V Virtual Machine, Gen 1, 2 v-CPUs, 3 GB RAM, 8GB VHDX (Dynamic)

        J 1 Reply Last reply Mar 23, 2020, 10:53 AM Reply Quote 0
        • J
          jdeloach @provels
          last edited by jdeloach Mar 23, 2020, 11:04 AM Mar 23, 2020, 10:53 AM

          @provels said in Feed not updating with cron but does by force:

          Not sure what the "?age=7d" means (maybe IPs added in last week?), but I do get a list if I use https://www.badips.com/get/list/any/2 alone.

          EDIT - Odd, https://www.badips.com/get/list/any/2?age=7d just now started working. Was getting "Bad Gateway"... Go figure.

          Yep, it works for me now too, didn't work earlier.

          P 1 Reply Last reply Mar 23, 2020, 11:07 AM Reply Quote 0
          • P
            provels @jdeloach
            last edited by Mar 23, 2020, 11:07 AM

            @jdeloach Networking/Notworking...

            Peder

            MAIN - pfSense+ 24.11-RELEASE - Adlink MXE-5401, i7, 16 GB RAM, 64 GB SSD. 500 GB HDD for SyslogNG
            BACKUP - pfSense+ 23.01-RELEASE - Hyper-V Virtual Machine, Gen 1, 2 v-CPUs, 3 GB RAM, 8GB VHDX (Dynamic)

            1 Reply Last reply Reply Quote 0
            • J
              Jobee @jdeloach
              last edited by Mar 25, 2020, 2:32 PM

              @jdeloach

              Thanks for the suggestion but you missed the problem. The list works when you do it manually. It gets the bad gateway when the cron job does it.

              1 Reply Last reply Reply Quote 0
              • S
                serbus
                last edited by Mar 25, 2020, 3:59 PM

                Hello!

                Are you using ram disks in System/Advanced/Miscellaneous?

                This sounds oddly similar to these :

                https://forum.netgate.com/topic/151591/sort-4-not-downloading-vrt-rules/
                https://forum.netgate.com/topic/151634/php-errors/

                John

                Lex parsimoniae

                1 Reply Last reply Reply Quote 0
                7 out of 7
                • First post
                  7/7
                  Last post
                Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.
                  This community forum collects and processes your personal information.
                  consent.not_received