Alpaca icon indicating copy to clipboard operation
Alpaca copied to clipboard

fireworks ai does not work

Open olumolu opened this issue 8 months ago • 9 comments

can't fetch models

olumolu avatar Apr 12 '25 16:04 olumolu

Did you add models to your account?

Fireworks AI doesn't provide any models by default, you'll need to deploy them from their web interface

Jeffser avatar Apr 12 '25 16:04 Jeffser

Did you add models to your account?

Fireworks AI doesn't provide any models by default, you'll need to deploy them from their web interface

you can use the models which are serverless without deploy on your account i have tested them. need to figure out what is the issue.

olumolu avatar Apr 12 '25 16:04 olumolu

Those are not exposed to the API

Jeffser avatar Apr 12 '25 17:04 Jeffser

Those are not exposed to the API

they are you can just yourself with a curl


curl \
--header 'Authorization: Bearer '$FIREWORKS_API_KEY \
--header 'Content-Type: application/json' \
--data '{
"model": "accounts/fireworks/models/llama-v3p3-70b-instruct",
"messages": [{
  "role": "user",
  "content": "Say this is a test"
}]
}' \
--url https://api.fireworks.ai/inference/v1/chat/completions

$FIREWORKS_API_KEY replace this with your api key you can change the model name also

accounts/fireworks/models/llama4-scout-instruct-basic

another model

olumolu avatar Apr 12 '25 17:04 olumolu

What I'm saying is that serverless models are not exposed to the API that gets the available models, of course you can just type the model name but that's not how Alpaca works

Jeffser avatar Apr 12 '25 17:04 Jeffser

What I'm saying is that serverless models are not exposed to the API that gets the available models, of course you can just type the model name but that's not how Alpaca works

but i dont know how it works how can i deplay them from web interface have you tested and it worked for you so need to know what i am missing

olumolu avatar Apr 12 '25 17:04 olumolu

Hey @Jeffser i have looked for but i couldn't not figure out can you confirm if it worked for you.

olumolu avatar Apr 13 '25 19:04 olumolu

I don't wanna pay for it honestly

Jeffser avatar Apr 13 '25 20:04 Jeffser

I don't wanna pay for it honestly

They provide $1 for free

olumolu avatar Apr 14 '25 02:04 olumolu