validate icon indicating copy to clipboard operation
validate copied to clipboard

As a user, I want to sacrifice resources for faster processing

Open al-niessner opened this issue 1 year ago • 0 comments

Checked for duplicates

Yes - I've already checked

🧑‍🔬 User Persona(s)

Define the number of processors/threads to use in processing. When validating a large bundle like in NASA-PDS/harvest#143 it takes 12325 seconds or 3:45 hours while only using about 40% of CPU and memory each. Halving the processing time would be wonderful.

💪 Motivation

Efficiency of human resources vs computer resources.

📖 Additional Details

Is it even possible to run validate using multiple threads/processors? It may be its current architecture is limited to single thread/processor. Evaluate its ability or amount of change required to move to multi processing then revisit this issue.

Acceptance Criteria

Given When I perform Then I expect

⚙️ Engineering Details

No response

al-niessner avatar Nov 30 '23 18:11 al-niessner