periodum-api icon indicating copy to clipboard operation
periodum-api copied to clipboard

PubChem remaining tasks

Open nesimtunc opened this issue 3 years ago • 0 comments

Per our conversation with @nesimtunc, here are the tasks that need to be done

  • [ ] Create a table in the DB for keeping track of the imported/failed compounds.
  • [ ] Use that table to rerun the script if the script crashes unexpectedly.
  • [ ] Limit retry amounts for failed compounds.
  • [ ] Create an endpoint to show the statistics, ie: the time to import a number of compounds, success/fail ratio, how many compounds are left to import
  • [ ] Create a POST endpoint to trigger the import script with an authentication(token may be stored in .env) header with a JSON body that includes the startID and endID and an option to continue from the last compound
  • [ ] Create a POST endpoint to trigger pause and stop the import script

Originally posted by @T410 in https://github.com/evrimagaci/periodum-api/issues/16#issuecomment-1106256014

nesimtunc avatar Apr 27 '22 13:04 nesimtunc