xbitinfo

xbitinfo copied to clipboard

- used python implementation if Julia isn’t installed but throw warning - use xr_bitround instead of jl_bitround - helps #95 and Julia installation issues - Continues #126 - In the...

aaronspring

Deprecate `for_cdo` option

3

The upcoming release of CDO (2.1.1) will better support temporal chunks >1 with a significant speed-up. After testing this claim, we might want to remove the `for_cdo` option, document that...

observingClouds

run notebooks sphinx

2

closes #95

aaronspring

sphinx readthedocs notebook wont execute

1

### Description - for now set in #94: `nbsphinx_execute = "never" # "auto" "always"; jupyter_execute_notebooks = "never"` and therefore not execute but should be fixed in the future - https://nbsphinx.readthedocs.io/en/pydata-theme/pre-executed.html...

aaronspring

FEATURE: shift the data range

1

@milankl metioned very important points in https://github.com/milankl/BitInformation.jl/issues/38#issuecomment-1118365021 which could/should be implemented in our `xbitinfo` pipeline: > premisses have to be checked / questions have to be answered before doing the...

aaronspring

LGTM! I think it addresses only the first part of @rsignell-usgs comment of > I'd like to specify the "y" dimensions in a list, e.g. dim = ['eta_rho', 'eta_u', 'eta_v']...

aaronspring

Could the dimensions in the list be the inner loop rather than the outer loop?

4

@aaronspring I tried it and it worked for me: ``` %%time info_per_bit_x = xb.get_bitinformation(ds_sample, dim=['xi_rho', 'xi_u', 'xi_v']) Processing Uwave_rms: 100% 82/82 [00:22

aaronspring

Duplicate memory allocations

4

Currently, the input data to `xbitinfo.get_bitinformation` is duplicated when calling https://github.com/observingClouds/xbitinfo/blob/c91a21f1e5e2164f3c1e6e543fad9e2a2547ae8f/xbitinfo/xbitinfo.py#L185-L186. `Main.X = X` is a deep copy operation. This poses in general an issue for large datasets, because a...

observingClouds

probably it would be better when allowing another keyword: `keepbits=[]` which could be used instead of `inflevels=[]`, Fig 3 Kloewer use keepbits I guess. with inflevels, you may end up...

aaronspring

Documentation of zarr compression

2

Explain the different approaches how BitRounding and Zarr can be used and explain why we have chosen not the alternative approach below: ```python import numcodecs encoding = { "var1": {...

observingClouds