Wei Ji

Results 343 comments of Wei Ji

> @pka and @weiji14 what are your feelings about combining your efforts into `georaster` vs `georust/geotiff`? Or would `georaster` depend on `georust/geotiff` in the future? > > > EDIT: I...

Assuming that this is done with #35, so closing.

Putting down some notes on a potential `HDF5` -> `pandas.DataFrame` direct conversion (that skips the intermediate `xarray` format) using the code at https://github.com/MAAP-Project/gedi-subsetter (thanks @chuckwondo for the pointer!). - `H5DataFrame`...

`H5DataFrame` works for ICESat-2 ATL03 - https://github.com/ICESAT-2HackWeek/h5cloud/pull/5 :tada: There are some small quirks (e.g. the need to access groups/variable via `df["group/variable"]` to get at the data), but it should work...

Segmentation fault on CI is caused by `import cudf`, bug reported upstream at https://github.com/rapidsai/cudf/issues/11941.

Next problem may or may not have something to do with `dask`. Crashing on https://github.com/weiji14/deepicedrain/actions/runs/3276952377/jobs/5393616432#step:9:48, `deepicedrain/tests/test_subglacial_lake_crossover.py::test_subglacial_lake_anomalies` somewhere along this chunk: https://github.com/weiji14/deepicedrain/blob/0f405ba3dc4c20607b1abf0da3e7077f6d910a84/deepicedrain/vizplots.py#L413-L441

Hi @Bbbigcountry, thanks for your question! > From my understanding, there should only be one data point per cycle for this anomaly. However, I have noticed that the crossover points...

Oh hi Tom, I was just chatting to @norlandrhagen at the Pangeo weekly meeting :laughing:. I will say that yes, it should be possible to work out the byte ranges...

Thanks @severo for opening this! As I understand, is an update needed on the server to pull in https://github.com/huggingface/datasets/pull/6508, so that GeoParquet datasets like https://huggingface.co/datasets/joshuasundance/govgis_nov2023-slim-spatial will show up on the...

Awesome, this is a big step forward! > size of the row groups in the geoparquet files: To be honest, 950423110 does seem like a bit much for a single...