BitInformation.jl
BitInformation.jl copied to clipboard
milankl
Information between bits and bytes.
As just discussed with @observingClouds and @ayoubft, we should have a check that elements in an array have only finite values and raise a warning if. While the algorithm does...
We have a large dataset from WRF, where the providers already reduced precision on some variables before passing to us. For example: ``` ALBEDO:number_of_significant_digits = 5 ; LAI:number_of_significant_digits = 3 ...
As requested by @aaronspring in #25, we need to extend the `bitinformation` function with a method for masked arrays. This is an issue to discuss a potential implementation of this...
@rsignell-usgs asked: How small could I make the chunks if I wanted to recalculate for every chunk of a dataset? Answer based on the statistics of random information: **TL;DR: Use...
Hi, I'm trying to work out if/how to compress simulation data stored in zarr using the xbitinfo python wrapper. For now on a test case of ~900 MB, stored as...
Hi, great package! I just realised that the `set_zero_insignificant` argument is always `true` when `masked_value` is supplied. I expect ```Julia using BitInformation bitinformation(Array{Float32}([1,2,3,4]), set_zero_insignificant=false) 32-element Vector{Float64}: 0.0 0.0 0.0 0.0...
What do you think about improving the error message when the dimension is too short to run `bitinformation` over it? i.e. when dim only have one or two elements, lets...
I try and fail to understand the error introduced by bitrounding comparing poles and tropics. I take surface temperature `tos` data from CMIP6 `historical` `MPI-ESM1.2-HR`, the analysis says I should...
I want to use `BitInformation` and `BitRound` on NetCDF output. Anyone with experience with `xarray`? What I do: see also https://github.com/milankl/BitInformation.jl/issues/25#issuecomment-1060889412 My routine: 1. run `plot_bitinformation.jl` and save keepbits between...
@milankl , where is the best place to discuss usage/interpretation/best practices with usage of these tools? For example, I've got two questions applying these techniques to a new CONUS WRF...