mars
mars copied to clipboard
Create a metric system for optimization
Information to Collect
- Execution details of every job
- Data read amount (with confidence)
- Execution cost (with confidence)
- Network transfer amount (with confidence)
- Peak memory cost in execution
Information to Infer
- Earliest / latest finish time of worker at a time point