pylivy icon indicating copy to clipboard operation
pylivy copied to clipboard

Upgrade for livy 0.6.0

Open parisni opened this issue 5 years ago • 4 comments

Hi

looks livy 0.6.0 broke the session api

any will to make that compatible ?

parisni avatar Apr 16 '19 09:04 parisni

Yeah, definitely. I'll look at it when I get a chance.

Do you know the specifics of what they've changed off hand?

acroz avatar Apr 16 '19 10:04 acroz

Hi @parisni - we are using Livy 0.7.0 in the integration tests. Is there something we're not testing that is broken?

acroz avatar Jun 20 '20 17:06 acroz

Hi we are using livy 0.6.0 installed in a cloudera cluster with kerberos and it seems the proxyUser is not set. The session json looks like this: {"id":13,"name":null,"appId":null,"owner":null,"state":"starting","kind":"pyspark","appInfo":{"driverLogUrl":null,"sparkUiUrl":null},"log":[...]}

BjoernWaechter avatar May 03 '21 15:05 BjoernWaechter

Hi @BjoernWaechter @acroz @parisni, I created a PR to resolve this issue and tested it on our cluster, now the code should work as expected.

zeninpalm avatar Jul 16 '21 03:07 zeninpalm