helicone
helicone copied to clipboard
Anthropic Stream Issue
Path: /getting-started/integration-method/anthropic
Is there not away to enable anthropic so that it streams?
I tried using openai's but anthropic isn't really compatible with it.
any suggestions on the best to use anthropic and helicone but stream the text?
Hi, we do support streaming for anthropic. Here is an example curl:
curl --request -N POST \
--url https://anthropic.hconeai.com/v1/messages \
--header 'Content-Type: application/json' \
--header 'Helicone-Auth: Bearer {HELICONE_API_KEY}' \
--header 'anthropic-version: 2023-06-01' \
--header 'x-api-key: {ANTHROPIC_API_KEY}' \
--data '{
"model": "claude-3-opus-20240229",
"max_tokens": 100,
"stream": true,
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "Tell me a story"
}
]
}
]
}'
same issue here
Closing, since @colegottdank 's solution is the way to do it :D