BUG: auto backup jobs not available in restore menu



  • According to the logs and the back now status, the backups have been successful.
    Aug 22 20:11:35 php-fpm 61181 /services_acb_backup.php: End of configuration backup to https://acb.netgate.com/save (success).
    Aug 22 20:11:34 php-fpm 61181 /services_acb_backup.php: Beginning configuration backup to .https://acb.netgate.com/save

    However, i don't see the Backup Now jobs under the restore menu. I only see the jobs that have been auto-backed up after a configuration change.

    thought it might have been because the backup jobs had reached 99, but i deleted a bunch of the older ones to bring it down to 80 and it didn't help



  • Confirmed. I also have 99 backups, the last being from Aug 16. I created a manual backup called Test. It didn't appear in the Restore list. I manually deleted the oldest backup and then refreshed, and it showed 98 backups. Then I did another manual Test2 and then refreshed and I still only have 98 backups and neither Test nor Test2 are in my list.



  • i have two systems, prod and test. but restore lists stopped after the same change

    Test system - last restore option
    Thu, 22 Aug 2019 17:45:12 +0200 admin@192.168.0.09 (Local Database): Firewall: Rules - deleted a firewall rule.

    Production system - last restore option
    Thu, 22 Aug 2019 17:43:25 +0200 admin@192.168.0.09 (Local Database): Firewall: Rules - deleted a firewall rule.

    The other common factor is, both units had reached 99.

    I can resolve and traceroute from localhost and client via WAN directly
    acb.netgate.com
    portal.pfsense.org

    i can also access both sites via HTTPS
    I note that it is possible to do a restore of an early backup too.

    I am wondering if there is a bug on the netgate server side.
    Although you delete the backup from restore (i deleted all), it is not being deleted from the server, or the 100 backup count on the server is not subtracking the deleted backups

    Pretty shoddy backup system, particularly as the diagnostics backup doesn't actually backup the whole system. I found restoring from the diagnostics backup/restore does not result is a full restore, where as the autoconf backup does.......at least for the restores that are listed.


  • Netgate Administrator

    Hmm, also seeing this. Digging....


  • Netgate Administrator

    Please re-test it should be good now.

    Steve



  • OK, now I see my two Test runs from yesterday. New Test3 backup works and appears in the list.

    What was the resolution?


  • Netgate Administrator

    I don't have the details but it was a backend change.

    If anyone sees an issue like that in future opening a ticket is the fastest way to alert us: https://go.netgate.com

    Steve



  • @stephenw10
    on my test machine, where i deleted all 99 backups, it is working.
    on my production machine, where i still have 48 backups, it is not working

    p.s. on the test machine, i do not see any of the backups i created yesterday.

    ++ deleted all backups on the production machine, and it still doesn't work


  • Netgate Administrator

    You won't see any backups created whilst this issue was in effect. Whilst to connection to the server was good and it was able to write out entries there was an error meaning they are not found for that device. Deleting entries will make no difference here.

    Was the production box successfully creating backups until yesterday?

    If you PM me the device key we can check if new backups are being received.

    Steve



  • @stephenw10 last working entries

    Test system - last restore option
    Thu, 22 Aug 2019 17:45:12 +0200 admin@192.168.0.09 (Local Database): Firewall: Rules - deleted a firewall rule.

    Production system - last restore option
    Thu, 22 Aug 2019 17:43:25 +0200 admin@192.168.0.09 (Local Database): Firewall: Rules - deleted a firewall rule.

    Now test works, but production doesn't.
    Have just run some manual backups with "test"
    both report success

    of course....stupid me, disabled on the production while i was investigating.....it's working.

    p.s. there seems to be some limitation/s on the size / characters of the "Revision Reason"
    e.g. 20180822BaseBuildSnortBlockerNGNoSquidEnabled
    this reports has being successful, but doesn't show in the restore list. I have already removed the +/- characters, so must be a size limitation


  • Netgate Administrator

    So I think you're all good now yes? ☺

    Steve



  • @stephenw10 would be good to know exactly what the limitations are on the "Revision Reason" - thanks



  • @stephenw10 said in BUG: auto backup jobs not available in restore menu:

    You won't see any backups created whilst this issue was in effect.

    Strange. The two test backups I did yesterday to confirm the problem showed up today. I haven't tried to restore them but they were in the list.



  • it's down again


  • Netgate Administrator

    Seems good here. No problem on any system I tested.

    It looks like the key words that are rejected if used in the Revision Reason field are: snort pfblocker minicron and merged in config.

    Steve



  • @stephenw10 said in BUG: auto backup jobs not available in restore menu:

    Seems good here. No problem on any system I tested.

    It looks like the key words that are rejected if used in the Revision Reason field are: snort pfblocker minicron and merged in config.

    Steve

    That would explain why saving PfblockerNG settings doesn't end up in Services / Auto Configuration Backup / Restore :

    Sat, 24 Aug 2019 11:39:23 -0400 	(system): Suricata pkg v4.1.4_8: post-install configuration saved. 	
    Sat, 24 Aug 2019 11:39:31 -0400 	(system): Overwrote previous installation of suricata. 	
    Thu, 29 Aug 2019 17:49:43 -0400 	admin@172.24.48.84 (Local Database): Test 	
    

    Diagnostics / Backup & Restore / Config History :

     		8/29/19 17:49:37 	19.1 	262 KiB 	admin@172.24.48.84 (Local Database): Test 	Current configuration
    		8/29/19 17:40:36 	19.1 	263 KiB 	(system): Installed cron job for /usr/local/bin/php /usr/local/www/pfblockerng/pfblockerng.php cron >> /var/log/pfblockerng/pfblockerng.log 2>&1 	
    		8/29/19 17:40:34 	19.1 	262 KiB 	(system): pfBlockerNG: save settings 	
    		8/29/19 17:36:12 	19.1 	262 KiB 	admin@172.24.48.84 (Local Database): Removed cron job for pfblockerng.php cron 	
    		8/29/19 17:36:11 	19.1 	263 KiB 	admin@172.24.48.84 (Local Database): pfBlockerNG: Running Force Reload 	
    		8/29/19 17:36:00 	19.1 	263 KiB 	admin@172.24.48.84 (Local Database): [pfBlockerNG] save DNSBL settings 	
    		8/29/19 17:32:22 	19.1 	263 KiB 	admin@172.24.48.84 (Local Database): pfBlockerNG: Added [ gstatic.com ] to DNSBL Whitelist 	
    		8/24/19 11:39:24 	19.1 	262 KiB 	(system): Overwrote previous installation of suricata. 	
    		8/24/19 11:39:14 	19.1 	262 KiB 	(system): Suricata pkg v4.1.4_8: post-install configuration saved. 	
    

  • Netgate Administrator

    Yes, probably. The new system will be much better in that respect. https://redmine.pfsense.org/issues/9693

    Steve


Log in to reply