incubator-livy icon indicating copy to clipboard operation
incubator-livy copied to clipboard
verified publisher icon apache

[LIVY-988] Support for escaping backtick from spark-submit arguments

Open s0nskar opened this issue 2 years ago • 5 comments

What changes were proposed in this pull request?

Fixes - #415

Adding support for escaping backticks from spark-submit arguments.

  • This feature will be behind a flag livy.server.escapeBackTicks (default: false)
  • This also handles the case where the user is already escaping backtick and livy won't perform double escaping.

How was this patch tested?

  • Added unit test for escape backticks function.

s0nskar avatar Aug 26 '23 14:08 s0nskar

cc: @pralabhkumar

s0nskar avatar Aug 26 '23 14:08 s0nskar

Hi @s0nskar . I am looking into this .

pralabhkumar avatar Sep 02 '23 15:09 pralabhkumar

@s0nskar Build is failing because of checkstyle issue , please look into fixing this.

pralabhkumar avatar Sep 02 '23 15:09 pralabhkumar

@pralabhkumar My company uses AWS EMR for data processing, and EMR uses livy for job submissions. We ran into issue with backticks recently because the content in backticks gets removed.

Would you mind following up on this PR and include it in the future releases?

RonZhang724 avatar Feb 14 '24 15:02 RonZhang724

@pralabhkumar PTAL

s0nskar avatar Apr 04 '24 14:04 s0nskar