optimum-intel icon indicating copy to clipboard operation
optimum-intel copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

OV Tokenizers Leftovers

Open apaniukov opened this issue 9 months ago • 1 comments

What does this PR do?

Updates left from Convert Tokenizers By Default PR

  • Support SD Pipeline Slow Tokenizer Conversion
  • Support Tokenizers Conversion for SD Mixed Quantization Pipeline
  • Move Converted OV Tokenizers to a Separate Folder

Before submitting

  • [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • [ ] Did you make sure to update the documentation with your changes?
  • [ ] Did you write any new necessary tests?

apaniukov avatar May 02 '24 11:05 apaniukov

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

HuggingFaceDocBuilderDev avatar May 02 '24 11:05 HuggingFaceDocBuilderDev

Hi @IlyasMoutawwakil, Could you merge the PR? The failed test is network-related: image

apaniukov avatar May 08 '24 11:05 apaniukov