Scott Strickland

Results 10 comments of Scott Strickland

hey @kosteev ! does it work for you to use `SparkContext.get_or_create()`? https://github.com/tubular/sparkly/blob/master/sparkly/session.py#L50-L55 https://github.com/tubular/sparkly/blob/master/sparkly/session.py#L121 Of course, if the creation of `SparkContext()` is external to your control, we'd have to do something...

Ah... So to clarify, all I wanted to do was return (already compiled) regex types as part of an enrichment record. So it changes nothing about how things are keyed...

Just ran into this. Any reason not to just print complex types (array, map, row) as json? It's not viable for me to use SQL workarounds because so much of...

FYI I just ran into the same issue, and came here to see if anyone else had too (or had a solution). Seems like there could be an easy fix...

Hi- I think supporting the native s3table interface has merit; in particular because the rest path involves an extra hop (and involvement with the glue team in AWS)... and more...

Hi @kevinjqliu , can we consider reopening this issue considering this: https://github.com/apache/iceberg-python/pull/1429#issuecomment-3423334847 In summary, supporting the native s3table interface will insulate us from bugs like these in glue. Schema evolution...

Ran into this and after doing some testing I believe the problem is on the AWS side. Just commenting here because it may have more visibility than on the [AWS...

hi @jmferland, I stumbled across this thread because I'm trying to do basically the same thing, and was surprised to find that I cannot (at least, not easily). Just wondering...

I also ran into this problem today. Looks like at python version 0.8.2, there was a change from openssl -> rustls. I tried installing 0.8.1, and to my surprise and...

@TeddyHartanto I ran into this as well. I found an [interesting PR for the prometheus JMX exporter which creates an example for spark3](https://github.com/prometheus/jmx_exporter/pull/543). What stuck out to me was that...