responsible-ai-toolbox icon indicating copy to clipboard operation
responsible-ai-toolbox copied to clipboard

Pin datasets version in nlp-feature-extractors to resolve the huggingface-hub dependency conflict

Open tongyu-microsoft opened this issue 2 years ago • 1 comments
trafficstars

This PR is to pin datasets>=2.9.0 https://pypi.org/project/datasets/#history

Description

We are seeing dependency vulnerability on responsible text image due to protobuf version pin in nlp-feature-extractors 0.0.3. And we want to upgrade nlp-feature-extractors to latest version, so that it doesn't have protobuf as dependency. But there is a dependency conflict for huggingface-hub where transformers requires huggingface-hub<1.0,>=0.11.0, and datasets in nlp-features-extractors requires huggingface-hub<0.1.0. Upgrading datasets to v2.9.0 can fix the dependency conflicts.

Checklist

  • [ ] I have added screenshots above for all UI changes.
  • [ ] I have added e2e tests for all UI changes.
  • [ ] Documentation was updated if it was needed.

tongyu-microsoft avatar Feb 01 '23 21:02 tongyu-microsoft

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/tongy/pinDatasetsVersion/dashboard/index.html

github-actions[bot] avatar Feb 01 '23 22:02 github-actions[bot]