Meta tags:
description=Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic. - katanemo/plano;

Headings (most frequently used words):

uh, oh, plano, navigation, your, code, saved, searches, to, and, files, build, footer, agents, search, repositories, users, issues, pull, requests, provide, feedback, katanemo, overview, menu, use, filter, results, more, quickly, folders, latest, commit, history, repository, agentic, apps, with, contact, getting, started, contribution, about, releases, 70, packages, contributors, languages, define, in, yaml, write, simple, agent, start, query, get, observability, model, agility, for, free, what, you, didn, have, topics, resources, license, contributing, stars, watchers, forks,

Text of the page (most frequently used words):
and (47), plano (32), you (27), for (23), code (20), your (18), the (18), routing (16), agent (15), model (15), llm (14), #agents (14), github (13), #agentic (13), with (12), security (10), orchestration (9), all (9), can (8), this (8), reload (8), our (8), what (8), from (8), json (8), there (7), please (7), apps (7), logic (7), build (7), config (7), weather (7), view (7), support (6), proxy (6), observability (6), core (6), documentation (6), name (6), yaml (6), request (6), messages (6), use (6), enterprise (6), navigation (5), was (5), error (5), while (5), loading (5), page (5), contributing (5), license (5), gateway (5), openai (5), server (5), data (5), new (5), traces (5), add (5), moderation (5), out (5), production (5), signals (5), end (5), every (5), http (5), chat (5), flights (5), stream (5), demos (5), run (5), app (5), claude (5), commit (5), skills (5), search (5), that (4), contact (4), docs (4), community (4), releases (4), readme (4), llms (4), guardrails (4), feedback (4), features (4), more (4), guide (4), workflows (4), get (4), built (4), like (4), gpt (4), grade (4), write (4), localhost (4), completions (4), paris (4), weather_agent (4), content (4), see (4), handles (4), fastapi (4), any (4), framework (4), package (4), lock (4), actions (4), issues (4), packages (3), stars (3), resources (3), topics (3), native (3), plane (3), smart (3), stay (3), focused (3), star (3), first (3), memory (3), hooks (3), filter (3), capture (3), tracing (3), apis (3), management (3), provider (3), agility (3), travel (3), both (3), routes (3), flight_agent (3), nyc (3), type (3), application (3), query (3), start (3), async (3), await (3), import (3), language (3), searches (3), building (3), services (3), developer (3), safety (3), applications (3), files (3), open (3), katanemo (3), insights (3), pull (3), requests (3), signed (3), settings (3), another (3), tab (3), window (3), refresh (3), session (3), sign (3), saved (3), copilot (3), platform (3), solutions (3), explore (3), time (2), manage (2), status (2), footer (2), 2026 (2), contributors (2), latest (2), repository (2), forks (2), 469 (2), apache (2), envoy (2), planoai (2), dev (2), repo (2), found (2), useful (2), updates (2), land (2), here (2), adding (2), contribution (2), metrics (2), logs (2), chains (2), multi (2), route (2), alias (2), preferences (2), quickstart (2), discord (2), parameter (2), orchestrator (2), frameworks (2), latency (2), why (2), zero (2), learning (2), otel (2), rich (2), unified (2), api (2), quirks (2), declare (2), descriptions (2), intent (2), without (2), infrastructure (2), instrumentation (2), free (2), 8001 (2), complete (2), plan (2), flight (2), options (2), role (2), find (2), prerequisites (2), generate (2), streamingresponse (2), chunk (2), true (2), weather_data (2), create (2), def (2), days (2), agent_orchestration (2), travel_agents (2), full (2), tools (2), body (2), asyncopenai (2), are (2), simple (2), evaluation (2), between (2), description (2), powered (2), change (2), access_key (2), url (2), locally (2), into (2), scale (2), jump (2), pulls (2), rote (2), plumbing (2), industry (2), protection (2), via (2), across (2), reach (2), guardrail (2), continuous (2), work (2), turbo (2), bun (2), build_filter_image (2), archgw (2), workspace (2), dockerfile (2), pre (2), gitmodules (2), gitignore (2), dockerignore (2), tests (2), crates (2), cli (2), 723 (2), commits (2), last (2), message (2), menu (2), quality (2), wiki (2), projects (2), discussions (2), appearance (2), cancel (2), available (2), repositories (2), business (2), advanced (2), source (2), customer (2), devops (2), perform, action, not, share, personal, information, cookies, privacy, terms, inc, other, css, shell, javascript, typescript, python, rust, languages, jul, report, watching, watchers, custom, properties, activity, inference, llmops, generative, envoyproxy, prompt, about, would, love, welcome, contributions, whether, fixing, bugs, improving, creating, tutorials, help, much, appreciated, visit, details, roadmap, intelligent, running, minutes, ready, try, check, comprehensive, getting, started, touch, join, actively, monitor, offer, uses, purpose, lightweight, instead, heavyweight, giving, fraction, cost, efficient, restart, update, test, redeploy, pipeline, export, spans, automatic, instrument, service, state, handle, each, classifier, concern, didn, have, traced, opentelemetry, needed, curl, returns, info, then, user, want, next, week, some, intelligently, single, conversation, follow, install, set, environment, text, event, media_type, return, model_dump_json, yield, system, response, back, through, get_weather_data, implementation, fetch, call, post, empty, api_key, 12001, base_url, point, responses, just, servers, implement, compatible, endpoint, auto, 100, random_sampling, show, seattle, airports, live, schedules, will, rain, tokyo, gets, real, forecasts, city, worldwide, different, models, plano_orchestrator_v1, router, port, travel_assistant, listeners, anthropic_api_key, anthropic, sonnet, default, openai_api_key, model_providers, 10520, 10510, don, classifiers, fallbacks, adapters, urls, natural, version, define, working, modular, blocks, letting, configure, only, need, edge, proxying, together, fit, cleanly, existing, architectures, below, showcases, three, capabilities, family, hosted, charge, central, region, give, great, experience, either, these, keys, important, learn, how, improve, speed, obervability, high, level, network, sequence, diagram, matters, most, product, backed, its, who, critical, modern, worklaods, leading, research, jailbreak, policies, consistently, plus, semantic, names, automatically, low, modifying, solves, moving, delivery, concerns, process, dataplane, easy, shipping, safely, reliably, repeatably, hard, after, thrill, quick, hack, hidden, middleware, right, glue, scattered, overview, decouples, brittle, abstractions, centralizing, shouldn, bespoke, codebase, improvement, filters, deliver, faster, items, history, date, folders, file, tags, branches, main, additional, 103, fork, must, notification, notifications, public, dismiss, alert, switched, accounts, resetting, focus, qualifiers, results, quickly, submit, include, email, address, contacted, read, piece, take, input, very, seriously, provide, syntax, tips, clear, users, pricing, premium, ons, collections, trending, archive, program, accelerator, maintainer, lab, programs, fund, developers, sponsors, partners, trust, center, forum, ebooks, reports, events, webinars, stories, software, development, topic, industries, government, manufacturing, financial, healthcare, cases, devsecops, modernization, case, nonprofits, startups, small, medium, teams, enterprises, company, size, marketplace, changelog, blog, stop, leaks, before, they, secret, secure, fix, vulnerabilities, changes, review, track, instant, environments, codespaces, automate, workflow, integrate, external, mcp, registry, direct, issue, merge, better, creation, toggle, skip,

Text of the page (random words):
github katanemo plano plano is an ai native proxy server and data plane for agentic apps smart llm routing observability agent orchestration and guardrails so you stay focused on your agents core logic github skip to content navigation menu toggle navigation sign in appearance settings platform ai code creation github copilot write better code with ai github copilot app direct agents from issue to merge mcp registry new integrate external tools developer workflows actions automate any workflow codespaces instant dev environments issues plan and track work code review manage code changes application security github advanced security find and fix vulnerabilities code security secure your code as you build secret protection stop leaks before they start explore why github documentation blog changelog marketplace view all features solutions by company size enterprises small and medium teams startups nonprofits by use case app modernization devsecops devops ci cd view all use cases by industry healthcare financial services manufacturing government view all industries view all solutions resources explore by topic ai software development devops security view all topics explore by type customer stories events webinars ebooks reports business insights github skills support services documentation customer support community forum trust center partners view all resources open source community github sponsors fund open source developers programs security lab maintainer community accelerator github stars archive program repositories topics trending collections enterprise enterprise solutions enterprise platform ai powered developer platform available add ons github advanced security enterprise grade security features copilot for business enterprise grade ai features premium support enterprise grade 24 7 support pricing search or jump to search code repositories users issues pull requests search clear search syntax tips provide feedback we read every piece of feedback and take your input very seriously include my email address so i can be contacted cancel submit feedback saved searches use saved searches to filter your results more quickly name query to see all available qualifiers see our documentation cancel create saved search sign in sign up appearance settings resetting focus you signed in with another tab or window reload to refresh your session you signed out in another tab or window reload to refresh your session you switched accounts on another tab or window reload to refresh your session dismiss alert message uh oh there was an error while loading please reload this page katanemo plano public notifications you must be signed in to change notification settings fork 469 star 6 9k code issues 103 pull requests 28 discussions actions projects wiki security and quality 0 insights additional navigation options code issues pull requests discussions actions projects wiki security and quality insights katanemo plano main branches tags go to file code open more actions menu folders and files name name last commit message last commit date latest commit history 723 commits 723 commits claude skills claude skills github workflows github workflows apps apps cli cli config config crates crates demos demos docs docs packages packages skills skills tests tests dockerignore dockerignore gitignore gitignore gitmodules gitmodules pre commit config yaml pre commit config yaml claude md claude md contributing md contributing md dockerfile dockerfile license license readme md readme md archgw code workspace archgw code workspace build_filter_image sh build_filter_image sh bun lock bun lock package lock json package lock json package json package json turbo json turbo json view all files repository files navigation readme contributing apache 2 0 license more items the ai native proxy server and data plane for agentic apps plano pulls out the rote plumbing work and decouples you from brittle framework abstractions centralizing what shouldn t be bespoke in every codebase like agent routing and orchestration rich agentic signals and traces for continuous improvement guardrail filters for safety and moderation and smart llm routing apis for model agility use any language or ai framework and deliver agents faster to production quickstart guide build agentic apps with plano documentation contact star ️ the repo if you found plano useful new releases and updates land here first overview building agentic demos is easy shipping agentic applications safely reliably and repeatably to production is hard after the thrill of a quick hack you end up building the hidden middleware to reach production routing logic to reach the right agent guardrail hooks for safety and moderation evaluation and observability glue for continuous learning and model provider quirks scattered across frameworks and application code plano solves this by moving core delivery concerns into a unified out of process dataplane orchestration low latency orchestration between agents add new agents without modifying app code model agility route by model name alias semantic names or automatically via preferences agentic signals zero code capture of signals plus otel traces metrics across every agent ️ moderation memory hooks build jailbreak protection add moderation policies and memory consistently via filter chains plano pulls rote plumbing out of your framework so you can stay focused on what matters most the core product logic of your agentic applications plano is backed by industry leading llm research and built on envoy by its core contributors who built critical infrastructure at scale for modern worklaods high level network sequence diagram jump to our docs to learn how you can use plano to improve the speed safety and obervability of your agentic applications important plano and the plano family of llms like plano orchestrator are hosted free of charge in the us central region to give you a great first run developer experience of plano to scale and run in production you can either run these llms locally or contact us on discord for api keys build agentic apps with plano plano handles orchestration model management and observability as modular building blocks letting you configure only what you need edge proxying for agentic orchestration and guardrails or llm routing from your services or both together to fit cleanly into existing architectures below is a simple multi agent travel agent built with plano that showcases all three core capabilities full working code see demos agent_orchestration travel_agents for complete weather and flight agents you can run locally 1 define your agents in yaml config yaml version v0 3 0 what you declare agent urls and natural language descriptions what you don t write intent classifiers routing logic model fallbacks provider adapters or tracing instrumentation agents id weather_agent url http localhost 10510 id flight_agent url http localhost 10520 model_providers model openai gpt 4o access_key openai_api_key default true model anthropic claude 3 5 sonnet access_key anthropic_api_key listeners type agent name travel_assistant port 8001 router plano_orchestrator_v1 powered by our 4b parameter routing model you can change this to different models agents id weather_agent description gets real time weather and forecasts for any city worldwide handles what s the weather in paris will it rain in tokyo id flight_agent description searches flights between airports with live status and schedules handles flights from nyc to la show me flights to seattle tracing random_sampling 100 auto capture traces for evaluation 2 write simple agent code your agents are just http servers that implement the openai compatible chat completions endpoint use any language or framework weather_agent py from fastapi import fastapi request from fastapi responses import streamingresponse from openai import asyncopenai app fastapi point to plano s llm gateway it handles model routing for you llm asyncopenai base_url http localhost 12001 v1 api_key empty app post v1 chat completions async def chat request request body await request json messages body get messages days 7 your agent logic fetch data call apis run tools see demos agent_orchestration travel_agents for the full implementation weather_data await get_weather_data request messages days stream the response back through plano async def generate stream await llm chat completions create model openai gpt 4o messages role system content f weather weather_data messages stream true async for chunk in stream yield f data chunk model_dump_json n n return streamingresponse generate media_type text event stream 3 start plano query your agents prerequisites follow the prerequisites guide to install plano and set up your environment start plano planoai up config yaml query plano intelligently routes to both agents in a single conversation curl http localhost 8001 v1 chat completions h content type application json d model gpt 4o messages role user content i want to travel from nyc to paris next week what is the weather like there and can you find me some flights plano routes to weather_agent for paris weather then routes to flight_agent for nyc paris flights returns a complete travel plan with both weather info and flight options 4 get observability and model agility for free every request is traced end to end with opentelemetry no instrumentation code needed what you didn t have to build infrastructure concern without plano with plano agent orchestration write intent classifier routing logic declare agent descriptions in yaml model management handle each provider s api quirks unified llm apis with state management rich tracing instrument every service with otel automatic end to end traces and logs learning signals build pipeline to capture export spans zero code agentic signals adding agents update routing code test redeploy add to config restart why it s efficient plano uses purpose built lightweight llms like our 4b parameter orchestrator instead of heavyweight frameworks or gpt 4 for routing giving you production grade routing at a fraction of the cost and latency contact to get in touch with us please join our discord server we actively monitor that and offer support there getting started ready to try plano check out our comprehensive documentation quickstart guide get up and running in minutes llm routing route by model name alias or intelligent preferences agent orchestration build multi agent workflows filter chains add guardrails moderation and memory hooks observability traces metrics and logs contribution we would love feedback on our roadmap and we welcome contributions to plano whether you re fixing bugs adding new features improving documentation or creating tutorials your help is much appreciated please visit our contribution guide for more details star ️ the repo if you found plano useful new releases and updates land here first about plano is an ai native proxy server and data plane for agentic apps smart llm routing observability agent orchestration and guardrails so you stay focused on your agents core logic planoai dev topics proxy routing gateway prompt proxy server openai envoy envoyproxy llms generative ai llmops llm inference llm proxy ai gateway llm gateway llm routing ai gateway support resources readme license apache 2 0 license contributing contributing uh oh there was an error while loading please reload this page activity custom properties stars 6 9k stars watchers 51 watching forks 469 forks report repository releases 70 0 4 27 latest jul 9 2026 69 releases packages 0 uh oh there was an error while loading please reload this page uh oh there was an error while loading please reload this page contributors uh oh there was an error while loading please reload this page languages rust 70 6 python 17 5 typescript 10 2 javascript 0 7 shell 0 4 css 0 3 other 0 3 footer 2026 github inc footer navigation terms privacy security status community docs contact manage cookies do not share my personal information you can t perform that action at this time