db_migrator icon indicating copy to clipboard operation
db_migrator copied to clipboard

Foreign table removal management

Open fljdin opened this issue 1 year ago • 1 comments

Hi,

Currently, foreign table removal is performed at the same time as table creation and data loading. The materialize_foreign_table method consists of the following steps:

  • Foreign table renaming (ALTER FOREIGN TABLE %I.%I RENAME TO %I)
  • Creation of identical table, with partitioning defined or not (CREATE TABLE %I.%I (LIKE %I.%I))
  • Creation of table partitions if required (CREATE TABLE %1$I.%3$I PARTITION OF %1$I.%2$I %4$s)
  • Load data or not (INSERT INTO %I.%I SELECT * FROM %I.%I)
  • Delete foreign table (DROP FOREIGN TABLE %I.%I)

If only one of these steps is unsuccessful, the foreign table remains unchanged.

However, with the db_migrate_tables method, the foreign table is removed if any error occurs. In the event that you wish to repeat the migration of an erroneous table, you need to rebuild the foreign table, which can be tedious, although it is now possible with the low-level function construct_foreign_tables_statements.

How about postponing the removal of foreign tables until the end of the migration, with a call to the db_migrate_finish method?

fljdin avatar Oct 10 '23 14:10 fljdin