Figured out my own issue. For any particular Dynamic DNS entry, it only updates one IP address. One has to clone the existing IPv4 entry, then use the "Service Type" pull down, to select the IPv6 version of that service. Other than that, the remaining settings (i.e. hostname, API key, etc) all stay the same.
Would have been nice if someone could have just said that... instead of responding with snark...