Ok I created a bug for it but that may get changed to a feature request because that is the expected behaviour in the code. It's not what I would expect as a user though.

https://redmine.pfsense.org/issues/15228