PyAirbyte
PyAirbyte copied to clipboard
💡 Feature Request: Add a prefix for cache table name
The cache table name is now just the data stream name, which cases conflicts if different data source has the same data stream name. It would be nice to add a prefix for cache table name.
Besides, I would like to add this feature if possible
@jiangsong216 - Thanks very much for submitting this issue. Are you thinking that we would default the prefix to the name of the source - so that instead of a default table name of issues
, we'd get something like github_issues
?
I've been thinking about this too and we logged something (below) quite a while back but haven't been able to prioritize it.
If you still would like to contribute, can you confirm the proposed spec details? If the proposal lines up with long-term plans, I'd happily add the accepting pull requests
label and invite you to contribute the feature/enhancement if you have time.
Relates to:
- #3
cc @bindipankhudi - since we were recently discussing this.
I found that we can specify a prefix or suffix explicitly when creating a cache, so my problem is solved
As for adding a default prefix for cache tables, can we simply include some source_name in sql.base.get_sql_table_name like this?