fix break strict-aliasing rules warnings

[howjmay]

When we run CI with optimization options, compiler would warn that the codebase break strict-aliasing rules.

see the CI https://github.com/DLTcollab/sse2neon/actions/runs/9658424846/job/26639574270?pr=638

There are some tests failed in the same CI. They may cause by the same reason