RL 9.5 Ansible/SSH SIGSEGV SegFault Segmentation Violation in libpython3.9.so.1.0[7f194085a000+20a000]

Just updated RL 9.5 tonight and, on a VM I have running ansible playbooks on, I have had 4 Segmentation Violations leading to coredumps in the first hour. These are origiating in libpython3.9 . I have also had one happen in ssh, which may be related.

[root@table coredump]# cat /etc/redhat-release 
Rocky Linux release 9.5 (Blue Onyx)
[root@table coredump]# coredumpctl list
TIME                         PID  UID  GID SIG     COREFILE EXE                  SIZE
Sun 2025-03-23 23:05:48 CDT 8010 1000 1000 SIGSEGV present  /usr/bin/ssh       117.6K
Sun 2025-03-23 23:05:50 CDT 7858 1000 1000 SIGSEGV present  /usr/bin/python3.9   6.7M
Sun 2025-03-23 23:05:57 CDT 8074 1000 1000 SIGSEGV present  /usr/bin/python3.9   7.0M
Sun 2025-03-23 23:11:49 CDT 8529 1000 1000 SIGSEGV present  /usr/bin/python3.9   6.7M
Sun 2025-03-23 23:11:50 CDT 8438 1000 1000 SIGSEGV present  /usr/bin/python3.9   6.7M
[root@table coredump]#
[root@table coredump]# dmesg|grep -i segfault
[ 5768.845009] ssh[8010]: segfault at 7f20a79cb360 ip 00007f20b79f6904 sp 00007ffcd507a7b0 error 4 in ld-linux-x86-64.so.2[7f20b79ef000+27000] likely on CPU 0 (core 0, socket 0)
[ 5770.368967] ansible-playboo[7858]: segfault at 7ff7ec7535e8 ip 00007ff7fff25380 sp 00007ffdf184c860 error 4 in libpython3.9.so.1.0[7ff7ffe5a000+20a000] likely on CPU 0 (core 0, socket 0)
[ 5777.547772] ansible-playboo[8074]: segfault at 7ff7ec7535e8 ip 00007ff7fff25380 sp 00007ffdf18494a0 error 4 in libpython3.9.so.1.0[7ff7ffe5a000+20a000] likely on CPU 0 (core 0, socket 0)
[ 6129.551501] ansible-playboo[8529]: segfault at 55e51823ab00 ip 00007f1940953773 sp 00007fffe9ee5450 error 4 in libpython3.9.so.1.0[7f194085a000+20a000] likely on CPU 0 (core 0, socket 0)
[ 6130.011111] ansible-playboo[8438]: segfault at 7f1900b91dc9 ip 00007f1940943824 sp 00007fffe9ee9450 error 4 in libpython3.9.so.1.0[7f194085a000+20a000] likely on CPU 0 (core 0, socket 0)
[root@table coredump]# ls -al
total 28060
drwxr-xr-x. 2 root root    4096 Mar 23 23:11 .
drwxr-xr-x. 7 root root      98 Mar 18 07:30 ..
-rw-r-----+ 1 root root 7113911 Mar 23 23:05 core.ansible-playboo.1000.e421fe782b56464fb646db384422ffc9.7858.1742789150000000.zst
-rw-r-----+ 1 root root 7378301 Mar 23 23:05 core.ansible-playboo.1000.e421fe782b56464fb646db384422ffc9.8074.1742789157000000.zst
-rw-r-----+ 1 root root 7030032 Mar 23 23:11 core.ansible-playboo.1000.e421fe782b56464fb646db384422ffc9.8438.1742789509000000.zst
-rw-r-----+ 1 root root 7057326 Mar 23 23:11 core.ansible-playboo.1000.e421fe782b56464fb646db384422ffc9.8529.1742789509000000.zst
-rw-r-----+ 1 root root  120516 Mar 23 23:05 core.ssh.1000.e421fe782b56464fb646db384422ffc9.8010.1742789148000000.zst

This system is heavily depended on for my network security (homebrew distributed IDS/IPS).

I am relying on the stock python install, here.

[root@table coredump]# ls -al /usr/bin/python3*
lrwxrwxrwx. 1 root root     9 Dec 12 11:18 /usr/bin/python3 -> python3.9
-rwxr-xr-x. 1 root root 15632 Dec 12 11:18 /usr/bin/python3.9
[root@table coredump]# 
[root@table coredump]# rpm -qa|grep -i python3-libs-
python3-libs-3.9.21-1.el9_5.x86_64
[root@table coredump]# rpm -qa|grep -i ansible
ansible-core-2.14.17-1.el9.x86_64
ansible-7.7.0-1.el9.noarch
[root@table coredump]# 

This issue appears to have settled down in the last 30 minutes (even with continuous usage).

Anyone else having any related issues? I am nowhere near setup for debugging these coredumps, here.

I have now had these coredumps happening on several VMs with no ansible installed.


[root@chat ~]# coredumpctl 
TIME                           PID UID GID SIG     COREFILE EXE                  SIZE
Sat 2025-03-29 22:35:53 CDT 572133   0   0 SIGSEGV present  /usr/bin/python3.9   3.1M
Sat 2025-03-29 22:36:09 CDT 572644   0   0 SIGSEGV present  /usr/bin/python3.9   2.5M
Sat 2025-03-29 22:48:04 CDT 573414   0   0 SIGSEGV present  /usr/bin/python3.9   2.0M
Sat 2025-03-29 22:50:30 CDT 574141   0   0 SIGSEGV present  /usr/bin/python3.9   2.1M
Sat 2025-03-29 22:51:03 CDT 574434   0   0 SIGSEGV present  /usr/bin/python3.9 916.5K
Sat 2025-03-29 22:58:21 CDT 574538   0   0 SIGSEGV present  /usr/bin/python3.9 599.3K
Sat 2025-03-29 23:03:48 CDT 575400   0   0 SIGSEGV present  /usr/sbin/lvm      362.8K
Sat 2025-03-29 23:20:11 CDT 576818   0   0 SIGSEGV present  /usr/bin/python3.9  87.1K
[root@chat ~]# dmesg|grep -i segfault
[528197.719330] python3[572133]: segfault at 7f7f52ef3398 ip 00007f7f44525380 sp 00007ffcc83f7fe0 error 4 in libpython3.9.so.1.0[7f7f4445a000+20a000] likely on CPU 0 (core 0, socket 0)
[528213.912475] python3[572644]: segfault at 7f58a658d6c9 ip 00007f58e63254d9 sp 00007ffef035e4a0 error 4 in libpython3.9.so.1.0[7f58e625a000+20a000] likely on CPU 0 (core 0, socket 0)
[528929.061153] python3[573414]: segfault at 7fc028d76c71 ip 00007fc068b25c39 sp 00007ffef094ea90 error 4 in libpython3.9.so.1.0[7fc068a5a000+20a000] likely on CPU 0 (core 0, socket 0)
[529075.095938] python3[574141]: segfault at 7fe7915b0b58 ip 00007fe7d1d996b0 sp 00007ffdfa7509e0 error 4 in libpython3.9.so.1.0[7fe7d1c5a000+20a000] likely on CPU 0 (core 0, socket 0)
[529108.491787] python3[574434]: segfault at 7f3690b8b5d8 ip 00007f36d1125380 sp 00007fff2c5274d0 error 4 in libpython3.9.so.1.0[7f36d105a000+20a000] likely on CPU 0 (core 0, socket 0)
[529546.521852] python3.9[574538]: segfault at 7f0bb843d558 ip 00007f0bf8743e09 sp 00007ffd5a161370 error 4 in libpython3.9.so.1.0[7f0bf865a000+20a000] likely on CPU 0 (core 0, socket 0)
[529873.192921] vgs[575400]: segfault at 5654f219b288 ip 00007fa715c96216 sp 00007ffe25ad9c80 error 4 in libc.so.6[7fa715c28000+174000] likely on CPU 0 (core 0, socket 0)
[530856.014342] python3.9[576818]: segfault at 7f1885884386 ip 00007f18c52ac5ea sp 00007fffc9dc0418 error 4 in libc.so.6[7f18c5228000+174000] likely on CPU 0 (core 0, socket 0)
[531062.025841] yum[577199]: segfault at 7f90b0ddb158 ip 00007f90f3725380 sp 00007fff80d6f2a0 error 4 in libpython3.9.so.1.0[7f90f365a000+20a000] likely on CPU 0 (core 0, socket 0)
[531100.161132] python3[577478]: segfault at 7f5eb6995008 ip 00007f5ef672577f sp 00007ffc9d9685a8 error 4 in libpython3.9.so.1.0[7f5ef665a000+20a000] likely on CPU 0 (core 0, socket 0)
[531138.926064] python3.9[577575]: segfault at 7ff334a3d558 ip 00007ff374d43e09 sp 00007ffee63fe340 error 4 in libpython3.9.so.1.0[7ff374c5a000+20a000] likely on CPU 0 (core 0, socket 0)

What the heck is going on w/ RHEL’s Python?

These faults hint at memory issues, not at an issue with python. I would highly suggest getting a memtest done on the host.