grain icon indicating copy to clipboard operation
grain copied to clipboard

Verify Accuracy of inexact->exact Conversions

Open peblair opened this issue 2 years ago • 0 comments

Currently, we perform inexact->exact conversions of floating point numbers using int32/int64s. We should verify that the accuracy of this conversion cannot be improved by using BigInts instead (if it can be, we should switch to those).

peblair avatar Apr 16 '22 21:04 peblair