I haven't seen that happen here and I've restored several dozen times during 22.05 development with all sorts of different configuration styles. I haven't seen either of the behaviors you describe thus far.
One thing you might want to check is the update branch in the saved configuration. Look for (and remove) the <pkg_repo_conf_path> tag(s) and contents before restoring and see if that makes a difference.
Also if you have extra data in the backup such as RRD, DHCP leases, etc, then it can greatly increase the size of the backup file and can cause it to take longer to upload and restore.