fastertransformer_backend icon indicating copy to clipboard operation
fastertransformer_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

Feature request: Conversion from GPTBigCodeForCausalLM / Starcoder

Open michaelfeil opened this issue 2 years ago • 1 comments

Is it possible to integrate converter scripts for the GPTBigCodeForCausalLM architecture from the transformers libary?

This would enable integration of models like Starcoder / Santacoder.

With this, community projects like https://github.com/fauxpilot/fauxpilot/issues/200 would have a great benefit.

michaelfeil avatar May 19 '23 15:05 michaelfeil

Agree ! Maybe starcoder is the SOTA model until 2023.05.25 of the <20B models. It would bring great benefits to the people who use it.

Xingxiangrui avatar May 25 '23 02:05 Xingxiangrui