browsertrix
browsertrix copied to clipboard
Add support for exporting/importing an org and all its data from db
trafficstars
Export
Data
- [X] Org (filtered by id)
- [X] Crawls (filtered by oid)
- [X] Crawl files
- [X] Crawl configs (filtered by oid)
- [X] Crawl config revisions (filtered by crawl configs returned in step above)
- [X] Collections (filtered by oid)
- [X] Profiles (filtered by oid)
- [X] Profile files
- [X] Limited user information (id, role, and email included in org export)
- [X] Database version - for now import fails if export version doesn't match current db version
Files
Separate process?
- [ ] Crawl files
- [ ] Profile files
Import
Data
- [x] Import data from JSON
- [ ] Generate new passwords for users?
Files
Separate process?
- [ ] Crawl files
- [ ] Profile files
May also need to export/import configmaps if we expect imported workflows to be able to run crawls
Re-create configmaps on workflow import
@tw4l does this need frontend work?
@tw4l does this need frontend work?
We had previously talked about this being an API-only feature, since only we would run it, at least for now. But happy to revisit that!