Frameworks
Frameworks are how you scale your LLM logic. They bring order to chaos: prompt flows, tool usage, memory handling, and deployment-ready architecture. If you’re serious about AI, this is your dev foundation.
-
Semantic KernelMicrosoft's open-source SDK for building AI agents and orchestrating LLM calls in C#, Python, and Java, designed for enterprise .NET and Java codebases.
-
Vercel AI SDKOpen-source TypeScript toolkit for building AI-powered applications and agents, with unified APIs across model providers and first-class React/Next.js streaming support.
-
MastraOpen-source TypeScript agent framework from the team behind Gatsby, with built-in workflows, RAG, memory, and evals for building production AI agents in a JS-native stack.
-
LangSmithLangChain's observability and evaluation platform for LLM applications, tracing every step of a chain or agent run and scoring outputs against test datasets.
-
StackSpot AIMulti-agent platform covering the software development lifecycle, letting teams orchestrate agents for code generation, review, and deployment.
-
Claude Agent SDK
Anthropic's SDK for Python and TypeScript that exposes the Claude Code agent loop, tools, hooks and MCP support for building custom agents.
-
OpenAI Agents SDK
Lightweight open-source framework from OpenAI for multi-agent workflows with handoffs, guardrails and built-in tracing.
-
Pydantic AI
Python agent framework from the Pydantic team that brings type-safe, validated structured outputs and dependency injection to LLM apps.
-
Agno
Python framework (formerly Phidata) for building multi-agent systems with memory, knowledge and tools, plus a runtime for serving them.
-
smolagents
Hugging Face's minimal agent library where agents write and run their actions as Python code, working with any LLM.
-
Google ADK
Google's open-source Agent Development Kit for building, evaluating and deploying multi-agent systems, optimized for Gemini but model-agnostic.
-
Letta
Framework for building stateful agents with long-term memory that learn and self-improve over time.
-
Mem0
Memory layer for AI agents and apps that stores and retrieves user context across sessions.
-
Instructor
Library for getting validated, structured outputs from LLMs using Pydantic models.
-
BAML
Domain-specific language for writing type-safe LLM functions and structured prompts.
-
Strands Agents
Open-source, model-driven SDK from AWS for building and running AI agents in a few lines of code.
-
Genkit
Open-source framework from Google for building AI-powered apps with flows, tracing and model plugins.
-
Outlines
Structured generation library that guarantees LLM output matches a schema, regex or grammar.
-
LangChain
Open-source framework for building LLM applications, with integrations for over 100 model providers and a standard agent loop around create_agent.
-
Microsoft Agent Framework
Microsoft's open-source framework for building, orchestrating and deploying multi-agent systems in Python and .NET.
-
Langflow
Visual builder for AI agents and RAG workflows, with an API and MCP server for every flow.
-
Dify
Open-source platform for building agentic workflows and LLM apps with a visual canvas, RAG and observability.
-
Flowise
Open-source low-code tool for building LLM chatflows and agents with a drag-and-drop UI.
-
n8n
Source-available workflow automation platform with built-in AI agent nodes and hundreds of integrations.
-
HaystackOpen-source Python framework from deepset for building production RAG pipelines and agents, with a modular pipeline architecture that predates the current agent framework wave.
-
DSPyStanford's framework for programming language models declaratively, replacing hand-tuned prompt strings with modules that get automatically optimized against your own data.
-
Guidance
Programming paradigm for steering language models with constrained, interleaved control and generation.
-
ParselResearch framework that breaks a programming task into natural-language function descriptions, then has a code LLM generate and test implementations.
-
Vibe CompilerSelf-compiling JavaScript tool that processes markdown prompt stacks through an LLM to generate code, then uses that process to rewrite itself.
-
DevOpsGPTOpen-source multi-agent system that turns natural-language requirements into working software, pulling and pushing code through Git. Around 6,000 stars.
-
LangGraph
LangChain's graph-based runtime for stateful agents, modeling each step as a node with checkpointing at every super-step for time-travel debugging.
-
CrewAI
Standalone Python framework for multi-agent systems, with no LangChain dependency, where agents get a role, a goal, and tools, then collaborate.
-
AutoGen
Microsoft Research's early multi-agent framework for Python, now in maintenance mode since October 2025, limited to bug fixes from community contributors.
-
LlamaIndex
Open-source data framework for RAG and agents over enterprise data, with 150-plus connectors through LlamaHub for sources like Notion and SQL.