browsertrix icon indicating copy to clipboard operation
browsertrix copied to clipboard

Add support for exporting/importing an org and all its data from db

Open tw4l opened this issue 2 years ago • 2 comments
trafficstars

Export

Data

  • [X] Org (filtered by id)
  • [X] Crawls (filtered by oid)
  • [X] Crawl files
  • [X] Crawl configs (filtered by oid)
  • [X] Crawl config revisions (filtered by crawl configs returned in step above)
  • [X] Collections (filtered by oid)
  • [X] Profiles (filtered by oid)
  • [X] Profile files
  • [X] Limited user information (id, role, and email included in org export)
  • [X] Database version - for now import fails if export version doesn't match current db version

Files

Separate process?

  • [ ] Crawl files
  • [ ] Profile files

Import

Data

  • [x] Import data from JSON
  • [ ] Generate new passwords for users?

Files

Separate process?

  • [ ] Crawl files
  • [ ] Profile files

tw4l avatar May 25 '23 22:05 tw4l

May also need to export/import configmaps if we expect imported workflows to be able to run crawls

tw4l avatar Nov 14 '23 19:11 tw4l

Re-create configmaps on workflow import

tw4l avatar Nov 15 '23 19:11 tw4l

@tw4l does this need frontend work?

SuaYoo avatar May 20 '24 18:05 SuaYoo

@tw4l does this need frontend work?

We had previously talked about this being an API-only feature, since only we would run it, at least for now. But happy to revisit that!

tw4l avatar May 20 '24 18:05 tw4l