optimum-intel icon indicating copy to clipboard operation
optimum-intel copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

concurrency without model cloning

Open dtrawins opened this issue 11 months ago • 3 comments

Support for multi threading in execution?

  • [ ] Did you make sure to update the documentation with your changes?
  • [x] Did you write any new necessary tests?

dtrawins avatar Feb 27 '24 10:02 dtrawins

@slyalin @eaidova can you add your comments?

dtrawins avatar Mar 01 '24 15:03 dtrawins

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

HuggingFaceDocBuilderDev avatar Mar 04 '24 13:03 HuggingFaceDocBuilderDev

I think we're close to merge, just waiting for couple of points above to be addressed, let me know if you need any help from my side @dtrawins (fixing conflicts / applying suggested changes)

echarlaix avatar May 14 '24 22:05 echarlaix