krishanunandy

> The reason Dtype is an Object is probably because the type is represented as a Python String object. That's my understanding too. >Isn't the missing value of the String...

Good find. It seems though, that - 1. PyAthena casts strings as `object` type (i.e. Numpy arrays) instead of the new dedicated `StringDtype` 1. The `StringDtype` is still experimental and...

Hi @laurenyu, I'm having the same issue as @mattiamatrix above, where instructing Spark to use the Glue catalog as a metastore doesn't throw any errors but also does not appear...

Hi @metrizable! Thanks for following up! I ran the code snippet you posted on my SageMaker instance that's running the `conda_python3` kernel and I get an output identical to the...

We ended up using an EMR backend for running Spark on SageMaker as a workaround but I'll try your solution and report back. Appreciate the follow up!