dbt-superset-lineage icon indicating copy to clipboard operation
dbt-superset-lineage copied to clipboard

Added dbt labels as part of columns info when pushing decscriptions

Open aibunny opened this issue 1 year ago • 7 comments

The labels are added in this format which I noticed is commonly used:

models:
  - name: book
    description: Book mart
    columns:
      - name: author
        description: The author
        label: Author

aibunny avatar Feb 12 '24 10:02 aibunny

@aibunny Thanks for contributing, appreciate it!

As mentioned in #40, I think it needs to be put under meta.label, not just label (as this wouldn't show up in dbt Docs, otherwise).

Moreover, this should be also added to the opposite way, i.e. from dbt to Superset. Could you please look into that as well?

one-data-cookie avatar Feb 12 '24 10:02 one-data-cookie

@aibunny Thanks for contributing, appreciate it!

As mentioned in #40, I think it needs to be put under meta.label, not just label (as this wouldn't show up in dbt Docs, otherwise).

Moreover, this should be also added to the opposite way, i.e. from dbt to Superset. Could you please look into that as well?

Thanks lemme do that. I did that since it fit my use-case but after testing the meta.lable it now makes more sense, what do you mean the opposite way?

aibunny avatar Feb 12 '24 11:02 aibunny

Thanks lemme do that.

Pefect, thanks!

what do you mean the opposite way?

Ignore me, I misread the code changes.

one-data-cookie avatar Feb 12 '24 12:02 one-data-cookie

ok, done

aibunny avatar Feb 13 '24 05:02 aibunny

I ran some functional tests because I didn't have any other tests to work with. Basically, I tested different cases: one with a metafield and labels, another with a metafield but no labels, and finally, a scenario with no metafield at all.

aibunny avatar Feb 16 '24 10:02 aibunny

I ran some functional tests

You mean against dbt and Superset? Which versions did you use? Did it work as expected then?

one-data-cookie avatar Feb 16 '24 22:02 one-data-cookie

I ran some functional tests

You mean against dbt and Superset? Which versions did you use? Did it work as expected then?

yes , I used dbt 1.7 and superset api v1

aibunny avatar Feb 17 '24 07:02 aibunny