piplin icon indicating copy to clipboard operation
piplin copied to clipboard

fixed point cast not using most accurate representation

Open aysylu opened this issue 12 years ago • 0 comments

Fixed point constructors should not take the floor of the fixed-point representation of the value, but round it to the nearest representable value.

(cast (sfxpts 7 3) 5.23) should round to #b0000101_010 (5.25), not #b0000101_001 (5.125).

aysylu avatar May 19 '13 03:05 aysylu