If it goes by $RELEASEVER, then that is “9” or “10”. You can manually edit the EPEL repo files to replace that with 9.6 or 10.0 if you want…
EDIT:
Yes, EPEL 9 doesn’t use the $releasever, so not an option. For EPEL10 however it can be. The problem then is just remembering to revert if changing. Personally, I’d just live with the dnf output until Rocky 10.1 is released.