kyuubi
kyuubi copied to clipboard
[TASK][EASY] Create simple atlas table entity in kyuubi lineage plugin
What's the level of this task?
EASY
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Search before creating
- [X] I have searched in the task list and found no similar tasks.
Mentor
- [X] I have sufficient expertise on this task, and I volunteer to be a mentor of this task to guide contributors through the task.
Skill requirements
- knowledge on kyuubi and apache atlas
Background and Goals
Currently, kyuubi lineage plugin only creates atlas spark_process
entity. If table entity is not created in advance through other way, it will not be ingested into atlas.
Implementation steps
We need to create table entities (spark_table or hive_table) while creating spark_process entity.
Additional context
Introduction of 2024H1 Kyuubi Code Contribution Program