openjpeg icon indicating copy to clipboard operation
openjpeg copied to clipboard

UB in color.c color_esycc_to_rgb - left shift and integer underflow

Open pauldreik opened this issue 3 years ago • 0 comments

Using ubsan and afl, I found the following errors:

runtime error: left shift of 1 by 31 places cannot be represented in type 'int' runtime error: signed integer overflow: -2147483648 - 1 cannot be represented in type 'int'

See #1442 for code to reproduce it.

pauldreik avatar Aug 25 '22 11:08 pauldreik