FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

Support FLAN-T5

Open zhisbug opened this issue 1 year ago • 4 comments

  • [ ] Support cli inference of Flan-T5
  • [ ] Support web UI serving of Flan-T5
  • [ ] Support fine-tuning of Flan-T5

zhisbug avatar Apr 06 '23 22:04 zhisbug

Hello team, I’d like to work on this.

ethanyanjiali avatar Apr 07 '23 14:04 ethanyanjiali

@ethanyanjiali we have an internal developer working on this as well. Do you want me to connect you to him?

zhisbug avatar Apr 08 '23 21:04 zhisbug

@zhisbug Yes. that would be great. Zhuohan has my wechat.

ethanyanjiali avatar Apr 08 '23 22:04 ethanyanjiali

this is a good idea, FLAN models are more tuned to academic tasks (which is useful) but does not provide conversational replies. Why not do this for FLAN UL2 20B model instead? That is the current best open-source FLAN model.

timothylimyl avatar Apr 10 '23 01:04 timothylimyl

all supported.

zhisbug avatar May 07 '23 09:05 zhisbug