djl-serving icon indicating copy to clipboard operation
djl-serving copied to clipboard

Published 20 hours ago • verified publisher icon deepjavalibrary

Refactor huggingface handler

Open sindhuvahinis opened this issue 10 months ago • 0 comments

Description

  • Extracting Rolling batch handling away from huggingface.py, but the UX wont change, the handler would still be djl_python.huggingface

sindhuvahinis avatar Apr 22 '24 18:04 sindhuvahinis