lanarky
lanarky copied to clipboard
ajndkr
The web framework for building LLM microservices
### Scenario While running following client, httpx throws the exception denoting that Content-Type is 'text/plain' instead of 'text/event-stream' ```python import json import click from lanarky.clients import StreamingClient @click.command() @click.option("--input", required=True)...
New milestone feature: support for `llama-index` framework ### Acceptance Criteria - [x] investigate streaming with llama-index - [ ] add adapter modules for `llama-index`
### Discussed in https://github.com/ajndkr/lanarky/discussions/65 Originally posted by **votkon** May 26, 2023 That would be great to have chat logging implemented somehow. Currently, it is impossible(?) to save the **chain.memory.chat_memory.messages** on...
New milestone feature: support for `guidance` framework ### Acceptance Criteria - [ ] investigate streaming with guidance - [ ] add `GuidanceRouter`
New milestone feature: db integration with sqlalchemy Useful for storing user conversations, tracking token usage, and so on. ### Acceptance Criteria - [ ] add lifespan event for sqlalchemy session...
Hi, I was wondering how we could plug the OpenAI Functions into Lanarky. It takes the conversation chain as an input and Functions seem to be called by Agents Do...
I should be able to hit my End Point "/chat" on Vercel. ### Scenario I deployed my python application on Vercel ### Actual result When I try to hit my...
### Description LLMChain was deprecated ### Acceptance criteria - [ ] ### Contribute - [ ] Yes, I can implement this feature and open a PR
### Scenario ChatCompletionChunk(id='chatcmpl-9RcbQpfZm1cThi6f3lw1rjLEbmxcr', choices=[] the openai 'choices' of chunk maybe empty. ### Actual result You need to add a check for an empty array. ### Expected result - ### Acceptance...