djl-serving icon indicating copy to clipboard operation
djl-serving copied to clipboard

Published 20 hours ago • verified publisher icon deepjavalibrary

Refactor huggingface and rolling batch handlers

Open sindhuvahinis opened this issue 9 months ago • 0 comments

Description

Testing

Tested in my EC2 local machine. Built a container and ran the CI by pushing the image in my private dockerhub account. https://github.com/deepjavalibrary/djl-serving/actions/runs/9019241325/job/24781785296

In the CI, one of the test is failing, but can't reproduce it in my local EC2 machine.

sindhuvahinis avatar May 10 '24 23:05 sindhuvahinis