FasterTransformer icon indicating copy to clipboard operation
FasterTransformer copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

Deberta Support

Open yaysummeriscoming opened this issue 2 years ago • 1 comments

Deberta is now the SOTA encoder model and is seeing a lot of uptake. It's currently in the top 10 most downloaded models on HF model hub, with 5.5M downloads (https://huggingface.co/microsoft/deberta-base). Would be great if it could be supported in FT

yaysummeriscoming avatar Sep 30 '22 10:09 yaysummeriscoming

Thank you for the suggestion, we will consider it.

byshiue avatar Oct 03 '22 00:10 byshiue

The model is supported in latest v5.3 version. Currently, we provide example on TensorFlow 2. More features and examples are developing.

byshiue avatar Jan 23 '23 03:01 byshiue

Awesome, thank you!

yaysummeriscoming avatar Jan 23 '23 15:01 yaysummeriscoming