Can confirm nvidia mlnx_ofed ibutils and ibdiagnet is compatible with the stock Rocky 8.6 IB stack for the following functions (edge cases unknown but this main stuff, yes):
- reads SM cached HBA, port, transceiver, SW models
- reads above via device query, cross-compares correctly
- picks up extended port attrs and correctly matches VS/AR info
- guid de-dup good (note untested edge cases for unmanaged CAs)
- MAD, firmware, pkey, rm/sm/chan queries good
There’s the usual NVidia issues with package signing keys, and the duplication of package names (repo priority should still work fine for that). Probably not kosher to mix legacy and nvidia ofeds, that’ll come back to bite me, but mixing in nvidia ibdiagnet/ibnetdiscover tools with Rocky IB [u]mad, cm, sm, and *verbs works “good enough(?)” for the major use cases.
repo: nvidia: Index of /public/repo/mlnx_ofed/latest/rhel8.6/x86_64
tools: nvidia: ibutils2-2.1.1-0.151.MLNX20220720.gcd746c3.57102.x86_64
drivers: rocky: kernel-{core,modules}-4.18.0-372.19.1.el8_6.x86_64
*cm: rocky: [lib]ibacm-[utils-]37.2-1.el8.x86_64, ditto verbs
sm: rocky: opensm-3.3.24-1.el8.x86_64