Nikos Alexandris
Nikos Alexandris
Step-by-step, I have some Very DRAFT without tests at https://github.com/NikosAlexandris/rekx/tree/main/rekx in a 'works-for-me' state. @martindurant any interest in seeing this growing ?
I am working on it : https://github.com/NikosAlexandris/rekx#examples -- these are just a small part of what `rekx` can already crunch. In time I will add examples for Kerchunking massive datasets.
> @NikosAlexandris , I see you've already put a decent amount of effort into it! I'd be happy to link to it from the kerchunk documentation or include it right...
@martindurant And of course, if I wasn't clear, I don't mind for whatever scenario if this goes well: integrate directly here-in or link to it. Whatever works better.
> I have a slight preference to integrate it into kerchunk, using command `kerchunk` if possible, since it's so tightly coupled to this repo's functionality. For tutorials, they should probably...
I am working on `rekx` further as it serves for my work. The idea is to bring it to a _cleaner_ shape before integrating to Kerchunk. I feel some important...
> I am planning a kerchunk (virtual) get-together to discuss all manner of topics, and this would be a good one. I hope I can make it to join. >...
> > Is it possible to implement this as an entrypoints plugin, or does it need to be a PR to xarray? > > As a plugin, I believe. >...
> Perhaps you can draft out what you've learned so far and outstanding questions, and we can start an FAQ doc page? I am scratching a document at https://github.com/NikosAlexandris/rekx, something...
> [Demo gist](https://gist.github.com/ivirshup/9ba2b570d541ff1393990f632bc7a6ea) > > I've got virtual concatenation of sparse arrays working. Dataframes should be easier. Unfortunately I can't use this with existing stores (data has to be rewritten)...