ieee754-visualization

ieee754-visualization copied to clipboard

bug?

3


Qyokizzzz

Rounding of large numbers leading to incorrect results

1

Enter `18446744073709549568` and you get the correct bit representation: `0 10000111110 1111111111111111111111111111111111111111111111111111`. But then it shows `n = 18446744073709550000` and the input field also get updated to that value.

kvap

fp expansion that you give for 0.97 actually corresponds to ```0.96999999999999997335464740899624302983...``` Pari calculator computes the given series to the above number: ```2^-1 + 2^-2 + 2^-3 + 2^-4 + 2^-5...

yurivict

For example, single precision floating point number? Maybe, keep the same rules, just allow the user to set different significand/exponent sizes? Very nice work, by the way! Thank you!

yurivict

Invalid exponent in sum?

2

The sum on the page is displayed as:  However, when you set the 52'nd bit to 1 you should add 2^(-1) not 2^(-0), so there is probably...

apaszke