kyuubi icon indicating copy to clipboard operation
kyuubi copied to clipboard

[TASK][EASY] Create simple atlas table entity in kyuubi lineage plugin

Open wForget opened this issue 10 months ago • 0 comments

What's the level of this task?

EASY

Code of Conduct

Search before creating

  • [X] I have searched in the task list and found no similar tasks.

Mentor

  • [X] I have sufficient expertise on this task, and I volunteer to be a mentor of this task to guide contributors through the task.

Skill requirements

  • knowledge on kyuubi and apache atlas

Background and Goals

Currently, kyuubi lineage plugin only creates atlas spark_process entity. If table entity is not created in advance through other way, it will not be ingested into atlas.

Implementation steps

We need to create table entities (spark_table or hive_table) while creating spark_process entity.

Additional context

Introduction of 2024H1 Kyuubi Code Contribution Program

wForget avatar Apr 15 '24 08:04 wForget