Ampersand icon indicating copy to clipboard operation
Ampersand copied to clipboard

Make the Ampersand compiler read a dataset, to prepare for migration

Open stefjoosten opened this issue 1 year ago • 1 comments

Problem

As a migration engineer, I want to use the population in an existing database as part of the initial population of a migrated database.

Solution

I want the compiler to read all triples from an external database, and write them to the current database.

Considerations

  1. We may be able to reuse some code that is used to validate the Haskell semantics against the database semantics (--validate). That would be the code to attach to the database and to read stuff from it.
  2. There are two tasks that can be done in parallel:
    • read the population from an existing (running) MariaDB server.
    • write the population to the current MariaDB server.
  3. For future maintainability, we will want to reuse this for reading Excel sheets, and other structured sources.
  4. To enable verifiable and maintainable code, we want to read data from the database into a structure that contains triples (i.e. a dataset).

stefjoosten avatar Jul 23 '23 13:07 stefjoosten