Ken Brownfield comments

Repositories
Issues
Comments

Results 13 comments of


                                            Ken Brownfield

How can I add prompt caching directive?

It looks like the System object is now an array of Messages, so either a new major version bump or a new "MessageRequest2" with "everything" duplicated... unless I'm misreading their...

How can I add prompt caching directive?

Can you update to go.mod for v4.0.0 to identify itself as /v4? @madebywelch

How can I add prompt caching directive?

Also, as I'm prepping for this, implementing the cache control on "user" messages becomes awkward when you have conversation history. For a RAG case, ideally I'd like to store the...