PlayBooks icon indicating copy to clipboard operation
PlayBooks copied to clipboard

Bigquery integration

Open sidPhoenix17 opened this issue 1 year ago • 3 comments

What new integration do you require?

Please describe.

Describe what all querying / actions you need to perform with this integration

Do your need this integration to start using Playbooks or expand your usage?

Additional context

Add any other context about the new integration here.

Thank you for your new integration request!

sidPhoenix17 avatar Aug 10 '24 10:08 sidPhoenix17

Hey @sidPhoenix17, I would like to work on the issue, if it is up for grabs. can you give me more context on the issue.

vpavankalyan avatar Aug 21 '24 11:08 vpavankalyan

Hi @vpavankalyan , you can go ahead and pick it up.

@dimittal @droid-mohit can you help share exact behaviour here?

sidPhoenix17 avatar Aug 21 '24 15:08 sidPhoenix17

Hi @vpavankalyan There are 3 types of changes to be added in the repo for a new integration-

  1. handle connection to bigquery engine via playbooks
  2. define and implement changes to execute big query (google sql) and get results in table format on playbooks
  3. define assets that can be used in tasks to help create the tasks for bigquery

You can follow the below PRs in same order to achieve the same

  • New connector PR: https://github.com/DrDroidLab/PlayBooks/pull/280
  • New Task Source PR: https://github.com/DrDroidLab/PlayBooks/pull/282/files
  • Asset manager PR: https://github.com/DrDroidLab/PlayBooks/pull/284

These PRs are a good starting point to plan your changes. Please note there might be some changes added to the repo since the time these PRs were created, so you might have to navigate those. Feel free to reach out on our slack community if you get stuck anywhere.

You can follow this guide for setting up playbooks on your local - https://www.youtube.com/watch?v=OiwgXSncNuo&list=PL-09IrZSH_gJXP4XfosRsMBIcj6iFu4ts&index=11

droid-mohit avatar Aug 22 '24 06:08 droid-mohit