Antoine Pitrou
Antoine Pitrou
> 1- API and Handling of the Last Buffer In [this pull request](https://github.com/apache/arrow/pull/46655), I demonstrated that it’s possible to [share buffers](https://github.com/apache/arrow/blob/a5dfadba3626c082235d9ea22db6f2cb22398d9a/cpp/src/arrow/array/builder_binary.cc#L90) without copying or finalizing the last buffer. This avoids...
Hmm. I'd rather keep the name "Other" as "Unknown" has proven ambiguous for Parquet (where there is a logical type named "Unknown"). @jorisvandenbossche What do you think?
> It's ambiguous in Parquet because it uses, confusingly, "Unknown" to mean "Null" (which means you can only have unknown data if there is no data, only nulls), while there...
I would reiterate my suggestion of `arrow.opaque` :-)
How do you disambiguate if a URL is supported both natively by Arrow, and by fsspec?
Well, that sounds reasonable to me. @amol- @jorisvandenbossche @raulcd What do you think?
AFAIR, you can already do this explicitly using e.g. `fsspec+hf://datasets/HuggingFaceTB/smoltalk/data/everyday-conversations/`. Can you try that?
Perhaps we can make it work then? :)
@AlenkaF Perhaps you're interested in the above?