ray-llm icon indicating copy to clipboard operation
ray-llm copied to clipboard

Published 20 hours ago • verified publisher icon ray-project

Missing RWKV/rwkv-raven-14b from the model list?

Open PicoCreator opened this issue 2 years ago • 5 comments

RWKV is shown in the main readme

  • https://github.com/ray-project/aviary#listing-all-available-models

but is missing in the current models page

  • https://github.com/ray-project/aviary/tree/master/models

PicoCreator avatar Jun 02 '23 14:06 PicoCreator

Yes, that is correct. We have had some trouble getting it to work, so it has been disabled for now (you can see enabled: false in the RWKV yaml). We will re-enable it once we can pinpoint the issue.

Yard1 avatar Jun 02 '23 14:06 Yard1

Oh, the RWKV.yaml itself is not there (so cant see the enabled: false)

PicoCreator avatar Jun 03 '23 06:06 PicoCreator

My bad, we must have removed it from the repo at some point! Happy to add it back in.

Yard1 avatar Jun 03 '23 06:06 Yard1

Yes please, i would like to help debug the issue if possible (im from the RWKV community)

PicoCreator avatar Jun 06 '23 07:06 PicoCreator

The problem was that using batch size > 1 resulted in all the responses but one turning into gibberish. We've used the Transformers integration. YAML attached: RWKV--rwkv-raven-14b.txt

Yard1 avatar Jun 06 '23 16:06 Yard1