palantir-python-sdk icon indicating copy to clipboard operation
palantir-python-sdk copied to clipboard

Support for dataframes with lists, structs, etc.

Open nicholsn opened this issue 1 year ago • 0 comments

I have a dataset in Palantir that is using a list datatype for a column and when I try to access the dataset the sdk it raises an AssertionError. In the stacktrace I see a few comments such as The dataset must have a schema and be tabular or this method will raise an Error.

Does this mean that palantir-python-sdk doesn't support table structures with complex types?

If so, given that pyarrow and pandas support these structures, would it be possible to add support for additional types?

Edit: I'll note that I'm able to read tables w/o complex types and this package is looking very helpful!

nicholsn avatar Nov 06 '23 22:11 nicholsn