typesense icon indicating copy to clipboard operation
typesense copied to clipboard

cf/mistral/mistral-7b-instruct-v0.1 is only accepted Cloudflare Workers AI model

Open huge10 opened this issue 1 year ago • 1 comments

Description

Trying to use Cloudflare Workers AI models other then cf/mistral/mistral-7b-instruct-v0.1

Steps to reproduce

For example, use cf/meta/llama-3-8b-instruct as model_name

Expected Behavior

Model gets created

Actual Behavior

Message is returned: Model name is not a valid Cloudflare model

Metadata

Typesense Version: v26.0

OS: Any

huge10 avatar May 12 '24 08:05 huge10

@huge10 After #1744, you can use other models from Cloudflare too, but we had to change naming of Cloudflare models a little bit, for instance, you need to use cloudflare/@cf/meta/llama-3-8b-instruct for Llama3 8B

ozanarmagan avatar Jun 06 '24 10:06 ozanarmagan