MYXjason
MYXjason
Sorry for the late reply. I use the Agno framework to call local models, which is compatible with the OpenAI API. I monitored the communication between the client and the...
Additionally, to facilitate testing, the prompt_token_ids and response_token_ids in the custom triplet extractor were assigned random values. Theoretically, these should instead be derived from the tokenizer of the local model.
Thank you for your feedback. This is a really great project, and I hope examples for Agno can be provided later on.