Arraymancer icon indicating copy to clipboard operation
Arraymancer copied to clipboard

[32-bit Linux] Investigate Linear Algebra failure

Open mratsim opened this issue 2 years ago • 0 comments

https://github.com/mratsim/Arraymancer/pull/510/checks?check_run_id=2980291716#step:21:823

image

The first failure may be due to rounding issue with float32 and switching to float64 will solve the issue. 1e-11 is way over float32 precision.

https://github.com/mratsim/Arraymancer/blob/8514e78993ea5852eb8c4d45f00cfbf13b3e193f/tests/linear_algebra/test_linear_algebra.nim#L130-L147

The second issue is very strange though https://github.com/mratsim/Arraymancer/blob/8514e78993ea5852eb8c4d45f00cfbf13b3e193f/tests/linear_algebra/test_linear_algebra.nim#L300-L326

mratsim avatar Jul 03 '21 20:07 mratsim