> I would to query the available version (ideally just the latest) for a specific package and fedora release via a REST API call (not dnf).

Have you tried using https://mdapi.fedoraproject.org/? For latest you would specify the rawhide branch.