OK… finally I have found what caused the issue…
I have suricata installed on my firewall and found ET INFO Server Responded with Vulnerable OpenSSH Version (CVE-2024-6409) that blocked packages.
Changing action temporarily from drop to alert solved the issue…