ml-commons
ml-commons copied to clipboard
Batch inference
Description
Add task to batch predict request
// todo: will add unit tests and ITs by 07/22/24
Issues Resolved
Check List
- [ ] New functionality includes testing.
- [ ] All tests pass
- [ ] New functionality has been documented.
- [ ] New functionality has javadoc added
- [x] Commits are signed per the DCO using --signoff
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.