You are probably seeing an asymmetric routing issue with a multi-homed host like that.
https://docs.netgate.com/pfsense/en/latest/troubleshooting/asymmetric-routing.html
Check the firewall logs for blocked entries.
But, yeah, connecting to https://10.108.1.99:5001 from hosts in that same subnet doesn't go through the firewall.
Steve