enso icon indicating copy to clipboard operation
enso copied to clipboard

`ceil`, `floor`, and `truncate` are incorrect on `Integer`s and `Float`s outside the java `Long` range (in-memory)

Open GregoryTravis opened this issue 1 year ago • 0 comments

The Integer failure comes from the fact that large integers are treated as value type Decimal in all backends; the Decimal implementation does not handle BigIntegerStorage. The Float failure comes from the assumption that the result will be a long, and not BigInteger, in UnaryRoundOperation.

GregoryTravis avatar Aug 27 '24 16:08 GregoryTravis