inference
inference copied to clipboard
Add missing interactive configurations
MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅
@nv-alicheng to review.
@pgmpablo157321 how hard would it be to make interactive a third scenario, but use the same code path as server? If it's too complicated we can live with the current hack and solve it next round.