AI Frameworks

Libraries and frameworks for building AI applications

30 tools

Agno

Open Source

Lightweight Python framework for building multi-modal agents. Memory, knowledge, and tool use built-in.

AI Frameworks

AutoGen

Open Source

Microsoft's multi-agent framework. Agents collaborate via conversation to solve complex tasks autonomously.

AI Frameworks

Claude Agent SDK

Open Source

Anthropic's TypeScript SDK for building Claude-powered agents. Tool use, multi-turn, and structured output.

AI Frameworks

CrewAI

Open Source

Framework for orchestrating role-playing AI agents. Define crew roles, goals, and tasks for collaborative problem solvin...

AI Frameworks

DSPy

Open Source

Programming framework for LLMs by Stanford. Compile declarative programs into optimized prompts automatically.

AI Frameworks

Flowise

Open Source

Drag-and-drop UI for building LLM flows. No-code/low-code alternative to LangChain with visual pipeline editor.

AI Frameworks

Guidance

Open Source

Microsoft's constrained generation library. Interleave generation, prompting, and logical control for reliable output.

AI Frameworks

Haystack

Open Source

End-to-end NLP framework by deepset. Pipeline-based architecture for search, QA, and RAG applications.

AI Frameworks

Instructor

Open Source

Structured output extraction from LLMs using Pydantic. Retry logic and validation built-in. Python, TS, Ruby, Go.

AI Frameworks

LangChain

Open Source

Most popular framework for building LLM applications. Chains, agents, memory, and tool use with large ecosystem.

AI Frameworks

LangChain.js

Open Source

JavaScript/TypeScript port of LangChain. Full feature parity with Python version for Node.js and edge runtimes.

AI Frameworks

Langflow

Open Source

Visual framework for building multi-agent and RAG applications. DataStax-backed with cloud deployment option.

AI Frameworks

LangGraph

Open Source

LangChain's framework for building stateful multi-agent applications with cycles, branching, and persistence.

AI Frameworks

LangServe

Open Source

Deploy LangChain runnables as REST APIs. Auto-generated docs, playground UI, and streaming support.

AI Frameworks

Letta (MemGPT)

Open Source

Framework for LLM agents with long-term memory. Virtual context management for unbounded conversation history.

AI Frameworks

LiteLLM

Open Source

Unified API for 100+ LLM providers. Drop-in OpenAI replacement with load balancing and spend tracking.

AI Frameworks

llama.cpp

Open Source

C/C++ LLM inference engine. Run quantized models on CPU/GPU with minimal dependencies. GGUF format standard.

AI Frameworks

LlamaIndex

Open Source

Data framework for LLM applications. Specializes in RAG and connecting LLMs to external data sources.

AI Frameworks

Mastra

Open Source

TypeScript framework for AI agents and workflows. Built-in RAG, tool use, and workflow orchestration.

AI Frameworks

Mem0

Open Source

Memory layer for AI applications. Persistent, adaptive memory across sessions for personalized AI experiences.

AI Frameworks

n8n

Freemium

Workflow automation platform with AI nodes. Connect LLMs to 400+ integrations. Self-hostable with fair-code license.

AI Frameworks

OpenAI Agents SDK

Open Source

Official OpenAI framework for building multi-agent systems. Handoffs, guardrails, and tracing built-in.

AI Frameworks

Outlines

Open Source

Structured generation library. Guarantees valid JSON, regex-constrained output from any open LLM.

AI Frameworks

PydanticAI

Open Source

Agent framework by the Pydantic team. Type-safe agent definition with dependency injection and structured responses.

AI Frameworks

Semantic Kernel

Open Source

Microsoft's SDK for integrating AI into .NET, Python, and Java apps. Native Azure OpenAI and plugin system.

AI Frameworks

smolagents

Open Source

Hugging Face's lightweight agent library. Code-based agents that write and execute Python to solve tasks.

AI Frameworks

Spring AI

Open Source

Spring ecosystem integration for AI. Portable API across providers with Spring Boot auto-configuration.

AI Frameworks

Text Generation Inference

Open Source

Hugging Face's production-ready inference server. Optimized for Transformer models with tensor parallelism support.

AI Frameworks

Vercel AI SDK

Open Source

TypeScript toolkit for building AI apps. Streaming, tool calling, structured output with React/Next.js integration.

AI Frameworks

vLLM

Open Source

High-throughput LLM serving engine. PagedAttention for efficient memory, continuous batching, OpenAI-compatible API.

AI Frameworks