pylivy
pylivy copied to clipboard
acroz
A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
is there a way I can download 100K rows using download_sql?
Current behavior means that if the spark DF has duplicated column names then only one instance of that column gets recovered in the returned Pandas DF when we call the...
We have found some edge cases when using `read` to return a dataframe related to the transformation `toJSON` and then `json.loads`. Specifically if all values of a column are `null`...
At Jampp we developed a pep 249 DB API spec using this connector, much like the ones from [PyHive](https://github.com/dropbox/PyHive/) or [PyDruid](https://github.com/druid-io/pydruid/) using the LivySession API for SQL. It is currently...
* Adds the session `name` to the session model * Updates the `from_json` session model to use the `name` if it is provided in the livy API response * Updates...
Hi looks livy 0.6.0 broke the session api any will to make that compatible ?
Hi, this PR resolves the issue #56 by fixing the Livy Batch model and related tests. The current Batch model is based on the official documentation from Livy at https://livy.incubator.apache.org/docs/latest/rest-api.html,...
Right now the only way to return an empty dataset or null result is to construct an empty Spark frame. This is kind of clunky to do. Might it make...
Ideally add tests for basic auth (possibly with Knox) and Kerberos.
