Stuart
Stuart
Just chiming in here @awestlake87 - being able to stream results from an async fn in rust to a generator in python would be extremely helpful. For a bit of...
Any movement here folks?
Hi @weiznich, yeah I am asking if there is any movement on a four year old issue that has been accepted, I'm not commenting for my personal satisfaction. A much...
I'm fairly certain this isn't limited to shared examples. If you have a top-level subject and create an object inside a context with a `let!`, you will get the same...
> Sorry if I'm being a bit slow here, but what's the difference between .collect(streaming=True) and .collect(streaming=False) if all the data gets pulled into memory in both cases? Yeah :/...
Not sure if relevant - but this does execute for _ages_ before giving me any feedback. I had anticipated that taking a `head` would be super fast.
OK, so I can't load the entire dataset cause my process gets OOM killed, but loading out just a few columns is okay. ``` pl.from_arrow(my_dataset.to_table(columns=['foo', 'bar']) > shape: (...) ```...
A bit more debugging info: - I'm able to load the entire dataset into an in-memory table with _just_ pyarrow (i.e. `my_dataset.to_table()` works). - Copying the dataset down (like 3.6GB,...
@kornelski 🤔 do you mean `into_iter`, not `into_inner`?
(I'm happy to have a bash, but I'm a real newbie to Rust, so not sure I'll manage haha)