Rok Mihevc
Rok Mihevc
@pvardanis I can confirm this is still behavior on main branch. As per [docs](https://arrow.apache.org/docs/python/generated/pyarrow.FixedSizeListArray.html) this is expected (but unintuitive): > [values](https://arrow.apache.org/docs/python/generated/pyarrow.FixedSizeListArray.html#pyarrow.FixedSizeListArray.values) Return the underlying array of values which backs the...
@pvardanis By calculating your own offset I mean something like this: ```python i = 1 array.values.values.slice(offset=i * array.type.list_size, length=array.type.list_size) [ 3, 4 ] ``` I think this should be zero-copy.
Great to hear! Closing the issue. If there's more reports like this we should maybe consider some kind of `.flattened_slice_view` method?
@PeopleMakeCulture the documentation PR is welcome, feel free to open a PR.
Thanks for documenting Joris! Super happy this won't cause friction anymore.
After speaking with @wiredfool in person I agree `FixedShapeTensorArray` is indeed the best option for this use case and adding metadata under somesort of "`app_metadata`" namespace.
cc @wgtmac @tustvold @alippai @mapleFU @AlenkaF
Apologies for taking a while to reply. I've split this into two cases: `FixedSizeListType` (length is constant) and `VariableSizeListType` (length differs per row) for the sake of discussion. I would...
Thanks for the review @etseidl ! I've updated this with your suggestions.
> @rok is there anything I can help with? @alippai thanks for pinging. I was advised on the parquet sync call to re-open a ML discussion on this, but I...