Paulo Miguel Almeida

@zhaohehuhu If that helps, this is the terraform code that can provision an EMR Serverless cluster with the right permissions https://gist.github.com/PauloMigAlmeida/5cebf3efcd0f105d73646a6a9e8cc2f3 Instructions on how to deploy and run it are...

@zhaohehuhu EMRServerless doesn't run in a customer-managed VPC. It's accessible via an API that should be invoked using one of the AWS SDKs instead. API method: https://docs.aws.amazon.com/emr-serverless/latest/APIReference/API_StartJobRun.html AWS SDK for...

@zhaohehuhu I'm almost certain that it isn't supported but let me check that internally first and I will come back to you with an answer tomorrow. On a separate note,...

@zhaohehuhu I got hold of a EMR Serverless specialist internally. Thrift communication isn't possible at this moment on EMR Serverless =/

@pan3793 Seems to be that we don't have thrift server running on those nodes for the serverless offering.

@pan3793 got you point now. Does the thrift communication initiate from the EMR serverless to the kyuubi server? Or is it the other way around? In case, it's the former:...