`test_asyncio.test_create_server_ssl_1` is broken with OpenSSL 3.2.5 + Python 3.12.11 on Yocto 5.0

[petermarko]

Bug report

Bug description:

I have also created issue in OpenSSL: openssl/openssl#28065

I'm trying to update OpenSSL from 3.2.4 to 3.2.5 in the Yocto project LTS branch 5.0.x (scarthgap).
The OpenSSL build and tests work, however Python3 tests fail with this change.
https://lists.openembedded.org/g/openembedded-core/message/220474

I have bisected the problem to openssl/openssl@1432e85 .
All works when I use OpenSSL with previous commit or when I use 3.2.5 release tarball and revert this commit on top.

That is interesting that this commit was ported to all OpenSSL active branches and those don't break Python3 tests:

Yocto 4.0.x LTS (kirkstone): openssl 3.0.17 + python 3.10.18 = SUCCESS
Yocto 5.0.x LTS (scarthgap): openssl 3.2.5 + python 3.12.11 = **FAILURE**
Yocto 5.2.x stable (walnascar): openssl 3.4.2 + python 3.13.4 = SUCCESS
Yocto 5.3.x master/development: openssl 3.5.1 + python 3.13.5 = SUCCESS

What is also a lead is that the tests usually succeeds, but approx 25-33% cases fail.
This suggests that the new caching may return some data already errorneously freed by python.
Are there any openssl integration adaptations on the other python branches?

CPython versions tested on:

3.12

Operating systems tested on:

Linux

[StanFromIreland]

How are you sure this is not a problem in your Yocto 5.0.x library?

[petermarko]

What is broken are ssl python test (run in qemu with Yocto Linux distribution),

Failed ptests:
{'python3': ['test_create_server_ssl_1', 'python3']}

[picnixz]

What is the exact test failure? can you show us the traceback please? Also the test seems to be asyncio-related:

cpython/Lib/test/test_asyncio/test_ssl.py

Line 199 in 8f59fbb

def test_create_server_ssl_1(self, size):

.

[petermarko]

The asyncio makes me think that the new openssl caching may not be thread safe anymore? 🤔

Anyway, is there a command to run single testcase and get its traceback? I'm not really familiar with python test suite...
Yocto does SETUPTOOLS_USE_DISTUTILS=nonlocal python3 -m test $SKIPPED_TESTS -v -j 4 which takes lot of time and spits out ton of logs to go trough.