TileDB icon indicating copy to clipboard operation
TileDB copied to clipboard
verified publisher icon TileDB-Inc

Fix narrowing integer error in number of cells per tile computation

Open jp-dark opened this issue 1 year ago • 0 comments

This PR fixes a bug in the templated Domain::compute_cell_num_per_tile function.

Previously, the cell_num_per_tile_ (type uint64_t) would be converted to a smaller value when being passed into Dimension::tile_extent_mult if the maximum values of the datatype of the dimension was smaller than the current cell_num_per_tile_ value.

TYPE: BUG DESC: Fix narrowing integer error in number of cells per tile computation

jp-dark avatar Jan 31 '24 19:01 jp-dark