vanna icon indicating copy to clipboard operation
vanna copied to clipboard

Published 20 hours ago • verified publisher icon vanna-ai

Supporting AutoModelForCausalLM

Open jis478 opened this issue 10 months ago • 1 comments

Hi, I'm writing a new class like this for models in the AutoModelForCausalLM format. Originally I've been testing sql-coder model with this but thought this could be generalized as a class. Do you have an on-going PR or can i make one?

jis478 avatar Apr 23 '24 23:04 jis478

This isn't something that I've heard from other users so please feel free to make a PR!

zainhoda avatar Apr 24 '24 12:04 zainhoda

Thanks, I've made PR (https://github.com/vanna-ai/vanna/pull/391)

jis478 avatar Apr 29 '24 02:04 jis478

By the way the original Sql-coder repo is also implemented using the Huggingface Transformers library with its own prompt template. As pointed out in https://github.com/vanna-ai/vanna/issues/303#issuecomment-2052692155, it would be great if you tested it out again with the original repo (I'm currently working on getting it to run on Vanna, based on this PR as well)

jis478 avatar Apr 30 '24 00:04 jis478

By the way the original Sql-coder repo is also implemented using the Hugging Face Transformers library with its own prompt template. As pointed out in #303 (comment), it would be great if you tested it out again (I'm currently working on getting it to run on Vanna, based on this PR as well)

Would be of interest to me as well, @zainhoda. Great suggestion, @jis478! :]

andreped avatar May 02 '24 13:05 andreped