seatable-api-python icon indicating copy to clipboard operation
seatable-api-python copied to clipboard

Improve Airtable import

Open simonhammes opened this issue 5 months ago • 0 comments

Improvements

  • Improved log messages
  • Airtable schema is retrieved using Airtable's meta API instead of trying to decude field types from row values
    • Note: This needs the schema.bases:read scope
  • Allows excluding specific column types (e.g. files) from data sync
  • Allows excluding specific columns from data sync using a list of tuples (table_name, column_name)
  • Creates a separate table in the SeaTable base to track columns that need to be manually migrated (e.g. link-formula)

I also commented out two sleep() statements since Airtable's API seems to be quite slow and I never hit a rate limit. Using a library like requests-ratelimiter might be a more robust option to a) prevent rate limits and b) prevent the migration process from being unnecessarily slow.

simonhammes avatar Sep 23 '24 13:09 simonhammes