becquerel icon indicating copy to clipboard operation
becquerel copied to clipboard

Precision issues of isotope_qty

Open cosama opened this issue 2 years ago • 4 comments

The isotope quantity module does two things that are not great for numerical precision: It subtracts two very large numbers or multiplies very large numbers with very small once.

It is hard to get this right and the best (only?) way would be to move the internals to https://github.com/fredrik-johansson/mpmath.

Shouldn't be to much of a lift.

cosama avatar Oct 05 '22 23:10 cosama