wiredfool
wiredfool
I've just put in a comment on that in here: https://github.com/apache/arrow/issues/43831#issuecomment-2318186432 -- what I don't see in a tensor is how to represent that in the PyCapsule interface, unless it's...
PR #8330 has been updated to read an arrow array as a pillow image.
I think this is really where I'm thinking -- the currently unsupported features: https://github.com/python-pillow/Pillow/blob/main/docs/reference/arrow_support.rst#unsupported-features * A streaming interface might be useful for images allocated using the arena allocator. * The...
@Joshix-1 That's definitely an issue that I'm aware of. We do have the band names, and they were added for that purpose, but I wasn't clear on what the standards...
@kylebarron So, in the ArrowSchema.metadata, where there's a key-value store, you'd recommend a key of `pillow` and metadata of a json payload? Or `ARROW:extension:name`: `'pillow` and `Arrow:extension:metadata`: json blob
So: Assuming that we have a 100x200 (w*h) CMYK image, the extension schema metadata for the top level would be: `arrow.fixed_shape_tensor`: `{"shape": [100,200,4], "dim_names": ["W", "H", "C"]}` **edit** This may...
Another option for additional metadata for tensors: ``` { "dim_names": ["H", "W", "C"], "application": {"dim_map":{"C": ["R", "G", "B"]}}} ```
> > What's the metadata design for the pixel format and band layout > > There's a brief description in `Imaging.h`. Can you put together a markdown summary of what...
For clarity -- my PR is just about exposing the existing memory structure as an arrow array, not adding multibyte or replacing storage with arrow.
No, there's no support for CUDA. Pull requests are appreciated.