unfetter icon indicating copy to clipboard operation
unfetter copied to clipboard

Remove/lessen requirement for Processor to run

Open infosec-alchemist opened this issue 6 years ago • 1 comments

If processor does not run, then unfetter-discover-api will fail. It appears that processor must run everytime the Docker stack starts.

There will be cases where the processor does not need to run first. Reduce this api requirement.

infosec-alchemist avatar Jun 07 '18 17:06 infosec-alchemist

The processor flags were added to fix a more serious bug where the API, CTF ingest, and the socket server could fail due to the processor being finished loading configurations. This was fixed in this previous issue: https://github.com/unfetter-discover/unfetter/issues/871

The following behavior should be present:

  • If the processor never runs, the PROCESSOR_STATUS flag (inside of mongo) won't exist
  • If the processor is running, the PROCESSOR_STATUS flag will be PENDING
  • If the processor finishes, either successfully or unsuccessfully, the PROCESSOR_STATUS flag will be set to COMPLETE
  • The API and Socket Server wait for PROCESSOR_STATUS to be COMPLETE before running
  • If PROCESSOR_STATUS is COMPLETE, the processor will never be required to be run again

j987987 avatar Jun 07 '18 18:06 j987987