There's a similar issue when one creates an interface with static IPv6, then later changes it to Track Interface… DHCPv6 will continue to run, even though DHCPv6 settings cannot be modified when the interface is configured as "Track Interface". RA settings are also likely affected too.
Basically, changes to one area (interface) that affect another area (DHCPv6 and RA in this case) are not actually being changed in the affected area, allowing it to continue functioning even though its settings can no longer be modified. Of course, the issue I mention could also be resolved if feature 3029 would be implemented, but that still doesn't solve the OP's issue.