julep icon indicating copy to clipboard operation
julep copied to clipboard

Published 20 hours ago • verified publisher icon julep-ai

Grok-1 Tool Support

Open ngoiyaeric opened this issue 1 year ago • 1 comments
trafficstars

Current open source Grok does not support function calling. https://x.ai/blog/grok-os Do you guys have any backend for loading open source language models into your stack, something like ollama or llocal.

ngoiyaeric avatar Jun 04 '24 11:06 ngoiyaeric

Yes, we can add support for other models hosted through ollama/replicate etc.

As for tool calls, it is possible to set/add a flag like add_function_to_prompt = True which would then prompt the model to use the function calling spec and return the JSON of the tool call.

alt-glitch avatar Jun 04 '24 12:06 alt-glitch

@creatorrr has this issue been resolved?

ngoiyaeric avatar Oct 10 '24 16:10 ngoiyaeric