awesome-ai-sdks
awesome-ai-sdks copied to clipboard
e2b-dev
A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents
:gift: Awesome SDKs for AI Apps and Agents
Try out E2B's cloud runtime for AI agents
👉 Submit new product here
Welcome to our list of products for AI apps and agents. A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying of AI apps.
The list is done according to our best knowledge, although definitely not comprehensive. Discussion, corrections, and feedback are appreciated! :heart:
Have anything to add?
Do you have something to add or improve about our list? Do it via pull request.
:star: For any new project, please also include a suggestion for a category in the visual, where it fits the most, or suggest a new category. :star:
:mag_right: Products allowing to choose your own LLM
AutoGen
AutoGen is a framework by Microsoft that enables development of LLM applications using multiple agents that can converse with each other to solve task
Description
- AutoGen agents are customizable, conversable, and seamlessly allow human participation
- They can operate in various modes that employ combinations of LLMs, human inputs, and tools
- AutoGen's design offers multiple advantages:
- it gracefully navigates the strong but imperfect generation and reasoning abilities of these LLMs
- it leverages human understanding and intelligence, while providing valuable automation through conversations between agents
- it simplifies and unifies the implementation of complex LLM workflows as automated agent chats
Links
Guides and examples
Context
Context is the product analytics platform for chat interfaces
Helicone
An open-source observability platform for GPT-3. Allows to track usage, costs, and latency with one line of code.
Langfuse
Langfuse is an open-source analytics for LLM apps. The analytics is currently in a closed alph
LangSmith
A unified platform for debugging, testing, evaluating, and monitoring LLM applications. LangSmith is now in closed beta.
Links
AgentLabs
A dynamic AI Automation Platform for Interoperability & AI Agent Management
AGiXT
A dynamic AI Automation Platform for Interoperability & AI Agent Management
Agents
Agents is an open-source library/framework for building autonomous language agents.
Description
- Long-short Term Memory: Language agents in the library are equipped with both long-term memory implemented via VectorDB + Semantic Search and short-term memory (working memory) maintained and updated by an LLM.
- Tool Usage: Language agents in the library can use any external tools via function-calling and developers can add customized tools/APIs here.
- Web Navigation: Language agents in the library can use search engines to navigate the web and get useful information.
- Multi-agent Communication: In addition to single language agents, the library supports building multi-agent systems in which language agents can communicate with other language agents and the environment. Different from most existing frameworks for multi-agent systems that use pre-defined rules to control the order for agents' action, Agents includes a controller function that dynamically decides which agent will perform the next action using an LLM by considering the previous actions, the environment, and the target of the current states. This makes multi-agent communication more flexible.
- Human-Agent interaction: In addition to letting language agents communicate with each other in an environment, our framework seamlessly supports human users to play the role of the agent by himself/herself and input his/her own actions, and interact with other language agents in the environment.
- Symbolic Control: Different from existing frameworks for language agents that only use a simple task description to control the entire multi-agent system over the whole task completion process, Agents allows users to use an SOP (Standard Operation Process) that defines subgoals/subtasks for the overall task to customize fine-grained workflows for the language agents.
Links
Axflow
Axflow is a comprehensive end-to-end open-source LLM framework for TypeScript. It provides a family of modular libraries, which can be incrementally adopted, and together form an end-to-end opinionated framework for AI development. Axflow targets enterprises and allows them to develop AI applications. They provide a toolkit to orchestrate, monitor, and continuously improve AI applications in production.
Links
ChatDev
ChatDev is a framework for building communicative agents for software development
Description
- ChatDev is a cutting-edge AI NPC gaming research platform that seamlessly blends numerous advanced model interfaces, allowing for intricate manipulation of NPC interactions within meticulously crafted simulated social settings.
- ChatDev stands as a virtual software company that operates through various intelligent agents holding different roles, including Chief Executive Officer, Chief Product Officer, Chief Technology Officer, programmer, reviewer, tester, art designer .
Links
Chidori
Chidori is a reactive runtime for building AI agents. It provides a framework for building AI agents that are reactive, observable, and robust. It supports building agents with Node.js, Python, and Rust. It is currently in alpha and is not yet ready for production use.
Fixie
Fixie is a platform for conversational AI that enables to build agents in any language. They have their own agent protocol.
Links
GenWorlds
GenWorlds is an event-based communication framework enabling developers to seamlessly blend deterministic and non-deterministic processes in building interactive multi-agent systems.
Main Advantage
Flexibility in Process Management: GenWorlds excels in letting developers choose how to balance deterministic (predictable) and non-deterministic (AI-driven) processes. This is crucial for tailoring system reliability and intelligence to specific needs.
Key Features
- Customizable Systems: GenWorlds emphasizes flexibility, allowing users to tailor systems according to their specific needs.
- Intuitive Abstraction Layer: Offers a basic interface with primitives to build agents, objects, and worlds without predefined constraints, supporting both deterministic and non-deterministic processes.
- Pre-Built Elements for Rapid Development: Comes equipped with a variety of ready-made agents, objects, and worlds, speeding up the setup process while still allowing extensive customization.
- Smooth Deployment Mechanisms: GenWorlds is built around a FastAPI web-socket server, facilitating easy dockerization and deployment, and providing versatile connectivity options suitable for various web systems.
Links
Haystack by Deepset
Haystack is an open-source LLM framework for building production-ready applications.
Hugging Face Agents
A platform for deploying LLM agents with tools. They provide three types of agents: HfAgent uses inference endpoints for open-source models, LocalAgent uses a model of your choice locally and OpenAiAgent uses OpenAI closed models.
Links
Langchain
LangChain is a framework designed to simplify the creation of applications using large language models.
Langroid
Multi-Agent framework for building LLM Applications.
Description
Langroid is an intuitive, lightweight, extensible and principled
Python framework to easily build LLM-powered applications.
You set up Agents, equip them with optional components (LLM,
vector-store and methods), assign them tasks, and have them
collaboratively solve a problem by exchanging messages.
This Multi-Agent paradigm is inspired by the
Actor Framework
(but you do not need to know anything about this!).
Langroid is a fresh take on LLM app-development, where considerable thought has gone
into simplifying the developer experience; it does not use Langchain.
- Works with most commercial/remote and open/local LLMs.
- Set up Multi-agent, multi-LLM system: use stronger LLMs for agents requiring strong reasoning and instruction-following, and delegate simpler tasks to weaker/local LLMs.
- Supports OpenAI function-calling as well as native equivalent called
ToolMessage, which works with LLMs that do not have built-in function-calling. Simply specify structure as a (nested) Pydantic object. - Batteries-included: vector-databases for RAG (Retrieval-Augmented Generation), caching, logging/observability.
- Specialized agents available:
DocChatAgent,SQLChatAgent,TableChatAgent(for tabular data, e.g. csv/dataframes). -
DocChatAgenthandles text, PDF, Docx files/URLS, and has state-of-the art techniques for retrieval combining lexical and semantic search. - Documentation: https://langroid.github.io/langroid/
Rift by Morph
Rift is an AI-native language server for AI agents. It's an open-source VS Code extension that allows merging the output of code generation agents.
Steamship
Steamship is a platform that allows to build, scale, and monitor AI agents with serverless cloud hosting, vector search, webhooks, callbacks, and more.
Vercel AI SDK
An open-source library for building AI-powered user interfaces.
WunderGraph Agent SDK
An open-source library that helps you to integrate OpenAI into your existing API infrastructure. You can use it to validate user input, enhance existing APIs with AI capabilities, and build APIs on top of AI Agents.
E2b
E2b is an operating system for AI agents, that is, a set of tools, APIs, and cloud environments for agents.
Links
- Web
- GitHub
-
Twitter
- Vasek Mlejnsky (CEO, founder)
- Tomas Valenta (CEO, founder)
- Tereza Tizkova (Growth & Community)
- Jakub Novak (Software Engineer)
- Discord
AgentMemory
Easy-to-use agent memory, powered by chromadb and postgres
Links
Cadea
Cadea is a platform that helps you create, manage, and monitor chatbots that can answer questions about your internal documents
Description
- Cadea allows you to deploy AI tools in your organization with strict security protocols, encryption, and monitoring
- Still in waitlist version
Links
LlamaIndex
LlamaIndex (formerly GPT Index) is a data framework for LLM applications to ingest, structure, and access private or domain-specific data.
MemGPT
MemGPT is teaching LLMs memory management for unbounded context
Description
- MemGPT manages a virtual context (inspired by virtual memory in operating systems) to create unbounded LLM context
- MemGPT allows to create perpetual chatbots 🤖 with self-editing memory
Links
PromethAI
About Memory management for the AI Applications and AI Agents
Turbopuffer
A truly serverless vector database
Description
- Cheap. $1/month per million vectors. That's 10-70x cheaper than other vector databases. $4 per million queries.
- Serverless. Pay only for what you use. Don't worry about manual scaling. Reasonably
- Fast. ~100ms latency on 1m vectors. Much faster soon.
Links
Vectara
Vectara is a cloud-native, API-driven LLM-powered search app platform
Description
- Purpose of Vectara is to serve the world’s largest sites and applications at blazing fast speeds
Links
:mag_right: Products with LLM lock-in
BondAI
BondAI is an open-source framework tailored for integrating and customizing Conversational AI Agents.
OpenAI Assistants API
The Assistants API allows you to build AI assistants within your own applications, leveraging models, tools, and knowledge to respond to user queries.
Links
SID
SID is a YC S23 company that creates personal data infrastructure for AI
Description
- SID makes data infrastructure for AI easy by letting AI devs connect to all of their customers' data with a single button and API
- It is a fully-hosted retrieval pipeline that makes it easy to connect services like Google Mail, Notion, GDrive, or fully custom data. In one afternoon, you can connect to any data source you'd like and instantly scale to millions of users.
Links
Who's behind this?
This list is made by the team behind E2B. E2b is building a Sandbox Runtime for LLM apps and agents - that is, a set of custom sandboxed cloud environments for AI-powered apps and agentic workflows. Get started here.
Join the community
- Follow us on X
- Join our Discord
Feel free to reach out to us at [email protected]. Check out also our database of AI agents.
e2b-dev