[ZEPPELIN-5973] Bump Livy 0.8.0-incubating

[pan3793]

trafficstars

What is this PR for?

Apache Livy 0.8.0-incubating was released at 2023-10-10, this PR aims to upgrade the built-in livy to the latest one.

What type of PR is it?

Improvement

Todos

• [ ] - Task

What is the Jira issue?

ZEPPELIN-5973

How should this be tested?

Pass CI

Screenshots (if appropriate)

Questions:

• Does the license files need to update? No.
• Is there breaking changes for older versions? No.
• Does this needs documentation? Yes, corresponding docs was updated

[pan3793]

@jongyoul @Reamer this PR is ready for review, appreciate it if you have time to take a look.

[pan3793]

@jongyoul @zjffdu actually, we can refactor the test code of livy module by using a sub-process to call $LIVY_HOME/livy-server to manage the Livy server for testing, instead of pulling livy jars and invoking Java/Scala class directly.

I have a half-done PoC locally, if you don't mind, I will continue it when I have free time. Or if you think it's not a good idea, then let's keep it as-is.

[Reamer]

I do not use livy. If there is a way to simplify the test execution we should take it. Currently the test execution is very specific.