The root user needs ssh access in order for scp to work.
Direct access to root or admin or any account is equally dangerous on the firewall.
You should protect access to ssh entirely, not just a specific user. If you switch to key-only auth, and limit access by IP, and for good measure change the port ssh runs on, it's safe even to login as root.