Adithya Balagoni
Adithya Balagoni
facing same issue!
one way is that u can make ur fastapi endpoint openaicomptabile endpoint..and then uses as an provider -const provider = createOpenAICompatible({ name: 'some-model-name', apiKey: "hello", baseURL: 'http://localhost:8000/api/v1/', }); - const...
one approach can be ..just take/send as a user message by adding xml tags and parse at the server side ( backend api) to construct json..and there by call the...
> Do you have sample? Or I can add to content ? as below > > { "model": "provider-name", "messages": [ { "role": "user", "content": "{"input": "I want to book...