Meta tags:
description=The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] - Issues · BerriAI/litellm;

Headings (most frequently used words):

bug, the, issues, feature, bedrock, not, on, and, search, saved, searches, navigation, use, to, results, footer, uh, oh, componentized, pod, with, litellm, ttl, messages, v1, counter, prisma, same, for, trace, code, repositories, users, pull, requests, provide, feedback, all, menu, filter, your, more, quickly, chart, hardening, hook, parity, helm, gateway, backend, images, ignore, use_ddtrace, no, apm, traces, aws, converse, prompt, caching, 1h, fails, http, 400, content, text, cache_control, ephemeral, extra, inputs, are, permitted, count_tokens, returns, 500, provider, errors, instead, of, falling, back, local, tokenizer, clear, license, boundaries, between, mit, enterprise, features, zai, glm, tool_call, ids, exceed, 64, char, tooluseid, limit, multi, turn, tool, calls, end, user, budget, can, be, bypassed, via, stale, per, fallback, spend, after, redis, clean, miss, non_root, cannot, run, migrations, because, engines, is, writable, nullable, dailytagspend, conflict, columns, cause, duplicate, inserts, database, cpu, exhaustion, in, web, ui, ai, hub, page, colored, pills, should, color, langfuse, callback, uses, session_id, trace_id, as, id, responses, never, populates, level, userid, sessionid, metadata,

Text of the page (most frequently used words):
#litellm (21), open (17), 2026 (15), opened (15), bug (15), berriai (14), status (13), jul (12), github (11), issues (11), security (10), and (10), something (10), isn (10), working (10), code (10), the (8), search (8), all (8), enterprise (7), you (6), your (6), view (6), llm (5), translation (5), issue (5), reload (5), this (4), not (4), community (4), navigation (4), use (4), features (4), with (4), feedback (4), quality (4), support (4), can (3), for (3), dashboard (3), page (3), feature (3), proxy (3), bedrock (3), projects (3), insights (3), actions (3), pull (3), requests (3), signed (3), settings (3), another (3), tab (3), window (3), refresh (3), session (3), sign (3), saved (3), documentation (3), grade (3), copilot (3), platform (3), solutions (3), explore (3), manage (2), footer (2), trace (2), sdk (2), duplicate (2), related (2), same (2), prisma (2), pod (2), counter (2), clear (2), messages (2), ttl (2), content (2), louis (2), vauterin (2), componentized (2), gateway (2), results (2), state (2), jun (2), ishaan (2), berri (2), creation (2), new (2), discussions (2), there (2), was (2), error (2), while (2), loading (2), please (2), appearance (2), cancel (2), see (2), available (2), searches (2), repositories (2), business (2), advanced (2), developer (2), topics (2), source (2), resources (2), customer (2), services (2), devops (2), app (2), merge (2), perform, that, action, time, share, personal, information, cookies, contact, docs, privacy, terms, inc, oreporan, 34226, langfuse, callback, uses, session_id, trace_id, responses, never, populates, level, userid, sessionid, metadata, akshay183, 34228, potential, kosta, 34231, web, hub, colored, pills, should, color, emerzon, 34232, nullable, dailytagspend, conflict, columns, cause, inserts, database, cpu, exhaustion, ppmdatix, 34236, non_root, cannot, run, migrations, because, engines, writable, fenterchen, 34238, end, user, budget, bypassed, via, stale, per, fallback, spend, after, redis, clean, miss, prashantkmrjha, 34239, zai, glm, tool_call, ids, exceed, char, tooluseid, limit, multi, turn, tool, calls, world, 34241, license, boundaries, between, mit, antonsauh, duvo, 34243, count_tokens, returns, 500, provider, errors, instead, falling, back, local, tokenizer, 17atharvakanase, 34248, aws, converse, prompt, caching, fails, http, 400, text, cache_control, ephemeral, extra, inputs, are, permitted, 34251, backend, images, ignore, use_ddtrace, apm, traces, 34252, chart, hardening, hook, parity, helm, closed, 31263, rust, migration, fastest, litest, sub, 1ms, overheads, 30484, stability, sprint, roadmap, 472, 361, sep, 2023, wish, had, restricted, repository, collapse, sidebar, preview, labels, milestones, views, recent, activity, mentioned, created, assigned, additional, options, star, fork, 10k, must, change, notification, notifications, public, message, dismiss, alert, switched, accounts, out, resetting, focus, create, qualifiers, our, query, name, filter, more, quickly, submit, include, email, address, contacted, read, every, piece, take, input, very, seriously, provide, syntax, tips, users, jump, pricing, premium, add, ons, powered, collections, trending, archive, program, stars, accelerator, maintainer, lab, programs, fund, developers, sponsors, partners, trust, center, forum, skills, ebooks, reports, events, webinars, stories, type, software, development, topic, industries, government, manufacturing, financial, healthcare, industry, cases, devsecops, modernization, case, nonprofits, startups, small, medium, teams, enterprises, company, size, marketplace, changelog, blog, why, stop, leaks, before, they, start, secret, protection, secure, build, find, fix, vulnerabilities, application, enforce, changes, review, plan, track, work, instant, dev, environments, codespaces, automate, any, workflow, workflows, integrate, external, tools, mcp, registry, direct, agents, from, write, better, toggle, menu, skip,

Text of the page (random words):
issues berriai litellm github skip to content navigation menu toggle navigation sign in appearance settings platform ai code creation github copilot write better code with ai github copilot app direct agents from issue to merge mcp registry new integrate external tools developer workflows actions automate any workflow codespaces instant dev environments issues plan and track work code review manage code changes code quality enforce quality at merge application security github advanced security find and fix vulnerabilities code security secure your code as you build secret protection stop leaks before they start explore why github documentation blog changelog marketplace view all features solutions by company size enterprises small and medium teams startups nonprofits by use case app modernization devsecops devops ci cd view all use cases by industry healthcare financial services manufacturing government view all industries view all solutions resources explore by topic ai software development devops security view all topics explore by type customer stories events webinars ebooks reports business insights github skills support services documentation customer support community forum trust center partners view all resources open source community github sponsors fund open source developers programs security lab maintainer community accelerator github stars archive program repositories topics trending collections enterprise enterprise solutions enterprise platform ai powered developer platform available add ons github advanced security enterprise grade security features copilot for business enterprise grade ai features premium support enterprise grade 24 7 support pricing search or jump to search code repositories users issues pull requests search clear search syntax tips provide feedback we read every piece of feedback and take your input very seriously include my email address so i can be contacted cancel submit feedback saved searches use saved searches to filter your results more quickly name query to see all available qualifiers see our documentation cancel create saved search sign in sign up appearance settings resetting focus you signed in with another tab or window reload to refresh your session you signed out in another tab or window reload to refresh your session you switched accounts on another tab or window reload to refresh your session dismiss alert message uh oh there was an error while loading please reload this page berriai litellm public uh oh there was an error while loading please reload this page notifications you must be signed in to change notification settings fork 10k star 54 4k code issues 1 5k pull requests 2 6k discussions actions projects security and quality 12 insights additional navigation options code issues pull requests discussions actions projects security and quality insights issues assigned to me created by me mentioned recent activity views projects milestones labels feedback preview collapse sidebar all issues new issue issue creation is restricted in this repository i wish litellm had 361 opened on sep 13 2023 472 litellm stability sprint roadmap 30484 ishaan berri opened on jun 15 2026 24 litellm rust migration the fastest and litest ai gateway sub 1ms overheads 31263 ishaan berri opened on jun 25 2026 16 issues search issues is issue state open is issue state open search search results open closed feature componentized chart pod hardening hook parity with litellm helm status open 34252 in berriai litellm louis vauterin opened on jul 22 2026 bug componentized gateway backend images ignore use_ddtrace no apm traces status open 34251 in berriai litellm louis vauterin opened on jul 22 2026 bug aws bedrock converse prompt caching 1h ttl fails with http 400 messages 0 content 0 text cache_control ephemeral ttl extra inputs are not permitted bug something isn t working something isn t working llm translation status open 34248 in berriai litellm 17atharvakanase opened on jul 22 2026 bug v1 messages count_tokens returns 500 on provider counter errors instead of falling back to local tokenizer llm translation proxy status open 34243 in berriai litellm antonsauh duvo opened on jul 22 2026 clear license boundaries between mit and enterprise features llm translation status open 34241 in berriai litellm no world opened on jul 22 2026 bug bedrock zai glm 5 tool_call ids exceed bedrock s 64 char tooluseid limit on multi turn tool calls llm translation status open 34239 in berriai litellm prashantkmrjha opened on jul 22 2026 bug end user budget can be bypassed via stale per pod fallback spend after redis counter clean miss bug something isn t working something isn t working proxy status open 34238 in berriai litellm fenterchen opened on jul 22 2026 bug litellm non_root cannot run prisma migrations because prisma engines is not writable bug something isn t working something isn t working sdk status open 34236 in berriai litellm ppmdatix opened on jul 22 2026 bug nullable dailytagspend conflict columns cause duplicate inserts and database cpu exhaustion proxy status open 34232 in berriai litellm emerzon opened on jul 22 2026 bug in the web ui on the ai hub page the colored feature pills should use the same color for the same feature bug something isn t working something isn t working ui dashboard issues related to the litellm ui dashboard issues related to the litellm ui dashboard status open 34231 in berriai litellm kosta github opened on jul 22 2026 bug bug something isn t working something isn t working llm translation potential duplicate sdk status open 34228 in berriai litellm akshay183 opened on jul 22 2026 bug langfuse callback uses session_id not trace_id as trace id for v1 responses and never populates trace level userid sessionid metadata status open 34226 in berriai litellm oreporan opened on jul 22 2026 footer 2026 github inc footer navigation terms privacy security status community docs contact manage cookies do not share my personal information you can t perform that action at this time