catwalk icon indicating copy to clipboard operation
catwalk copied to clipboard

add: ollama cloud

Open vorticalbox opened this issue 2 months ago • 4 comments

  • [x] I have read CONTRIBUTING.md.

  • [x] I have created a discussion that was approved by a maintainer (for new features).

  • Set Claude Haiku 4.5 as default small model

  • Update Claude Sonnet 4.5 pricing (reduced output costs)

  • Remove outdated Claude 3.5 Haiku and Opus models

  • Reorder models by relevance

vorticalbox avatar Oct 30 '25 09:10 vorticalbox

this looks great! Is there a way i can preview this before the merge? @vorticalbox and @charmcrush any eta on merge?

gotjoshua avatar Dec 03 '25 18:12 gotjoshua

Hey! Sorry for the delay on this one. In order to get this in we'll need to do some work in Fantasy to support Ollama Cloud, since it's not OpenAI or Anthropic compatible. No ETA yet but we'd love to get support for this in.

meowgorithm avatar Dec 03 '25 18:12 meowgorithm

Hey! Sorry for the delay on this one. In order to get this in we'll need to do some work in Fantasy to support Ollama Cloud, since it's not OpenAI or Anthropic compatible. No ETA yet but we'd love to get support for this in.

I already have a pr open in fantasy to support it i just need to update my branch

https://github.com/charmbracelet/fantasy/pull/63

vorticalbox avatar Dec 03 '25 19:12 vorticalbox

this looks great! Is there a way i can preview this before the merge? @vorticalbox and @charmcrush any eta on merge?

  • Clone both repos: git clone <crush_repo> and git clone <fantasy_repo>.
  • In crush/go.mod, add a replace directive pointing to your local fantasy folder: replace charm.land/fantasy => ../fantasy
  • Create providers.json in the Crush repo and paste in the JSON from the provided source.
  • From the Crush repo, run: go crush update-providors path/to/providers.json
  • Start Crush: go run main.go

After this, Crush will run with fantasy support and can use Ollama Cloud.

vorticalbox avatar Dec 03 '25 19:12 vorticalbox