rust-bert icon indicating copy to clipboard operation
rust-bert copied to clipboard

Published 20 hours ago • verified publisher icon guillaume-be

[FEATURE] GODEL support

Open schneiderfelipe opened this issue 2 years ago • 2 comments

Hi @guillaume-be!

How hard would it be to add support for GODEL?

It is the natural successor to DialoGPT, so would it be of similar effort to #57?

schneiderfelipe avatar Jan 19 '23 21:01 schneiderfelipe

Hello,

Looking at the GODEL codebase, it seems that the transformers's generate function is called directly on the input: https://github.com/microsoft/GODEL/blob/7e2c6bd13fe8a403955179022449a1c24077b471/GODEL/server.py#L75

The generate function in this crate aligns with the Python library, and should yield the same results. I expect the effort would be significantly lower than the original DialoGPT. It leverages T5 which is already implemented. The weights would have to be converted/uploaded to the Huggingface hub and T5 registered as an option for the dialogue pipeline.

Please let me know if you would be interested in taking this up and happy to provide guidance as needed.

guillaume-be avatar Feb 22 '23 18:02 guillaume-be

Hey @guillaume-be, sorry for the late reply. Unfortunately this is currently not within my reach (bandwidth) anymore. Sorry!

schneiderfelipe avatar Apr 02 '23 13:04 schneiderfelipe