unfetter
unfetter copied to clipboard
Remove/lessen requirement for Processor to run
If processor does not run, then unfetter-discover-api will fail. It appears that processor must run everytime the Docker stack starts.
There will be cases where the processor does not need to run first. Reduce this api requirement.
The processor flags were added to fix a more serious bug where the API, CTF ingest, and the socket server could fail due to the processor being finished loading configurations. This was fixed in this previous issue: https://github.com/unfetter-discover/unfetter/issues/871
The following behavior should be present:
- If the processor never runs, the
PROCESSOR_STATUS
flag (inside of mongo) won't exist - If the processor is running, the
PROCESSOR_STATUS
flag will bePENDING
- If the processor finishes, either successfully or unsuccessfully, the
PROCESSOR_STATUS
flag will be set toCOMPLETE
- The API and Socket Server wait for
PROCESSOR_STATUS
to beCOMPLETE
before running - If
PROCESSOR_STATUS
isCOMPLETE
, the processor will never be required to be run again