agnai icon indicating copy to clipboard operation
agnai copied to clipboard
verified publisher icon agnaistic

Add Claude 3.5 Haiku

Open Rafario448 opened this issue 1 year ago • 1 comments

Please add support for Claude 3.5 haiku, and the new 3.5 sonnet (latest) its one of my favorite LMMs specially on how accurate it follows my prompts and how easy it is to jailbreak with Prefill.

Rafario448 avatar Nov 08 '24 14:11 Rafario448

Also I tried openrouter to use Claude 3.5 haiku, but for some reason, when using claude, Agnai is only sending the Chat history (System message and Prefill are missing) this doesn't happen using OAI, or other open source models on Open Router. (pictured the exact same prompt) image

(This can also be noticed in Openrouter's activity window: Same prompt, much smaller entry token count) image

Rafario448 avatar Nov 08 '24 14:11 Rafario448