PyAirbyte icon indicating copy to clipboard operation
PyAirbyte copied to clipboard

💡 Feature Request: Add a prefix for cache table name

Open jiangsong216 opened this issue 10 months ago • 3 comments

The cache table name is now just the data stream name, which cases conflicts if different data source has the same data stream name. It would be nice to add a prefix for cache table name.

jiangsong216 avatar Apr 18 '24 11:04 jiangsong216

Besides, I would like to add this feature if possible

jiangsong216 avatar Apr 18 '24 11:04 jiangsong216

@jiangsong216 - Thanks very much for submitting this issue. Are you thinking that we would default the prefix to the name of the source - so that instead of a default table name of issues, we'd get something like github_issues?

I've been thinking about this too and we logged something (below) quite a while back but haven't been able to prioritize it.

If you still would like to contribute, can you confirm the proposed spec details? If the proposal lines up with long-term plans, I'd happily add the accepting pull requests label and invite you to contribute the feature/enhancement if you have time.

Relates to:

  • #3

cc @bindipankhudi - since we were recently discussing this.

aaronsteers avatar Apr 27 '24 03:04 aaronsteers

I found that we can specify a prefix or suffix explicitly when creating a cache, so my problem is solved

As for adding a default prefix for cache tables, can we simply include some source_name in sql.base.get_sql_table_name like this?

微信图片_20240429155446

jiangsong216 avatar Apr 29 '24 07:04 jiangsong216