lakeFS icon indicating copy to clipboard operation
lakeFS copied to clipboard

lakeFS Database migration

Open N-o-Z opened this issue 2 years ago • 0 comments

Support migration of lakeFS database between different KV implementations by adding 2 flows:

  1. Export - dump all the data from old database into file
  2. Import - load data from file to the new database

Database migration will be allowed only on the same lakeFS version

Import was already implemented as part of the Postgres KV migration What's left is to add the export functionality and add the required validations

Open question:

  • What should we do with the lakeFS metadata? Consider the scenario where data is exported from one system and imported to another. Do we want to support it?

N-o-Z avatar Aug 15 '22 08:08 N-o-Z