Meta tags:
description=GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.;

Headings (most frequently used words):

ai, eval, this, repositories, saved, searches, llm, navigation, to, your, topic, footer, promptfoo, giskard, uptrain, verifywise, athina, parea, multinear, search, code, users, issues, pull, requests, provide, feedback, menu, use, filter, results, more, quickly, here, are, 151, public, matching, improve, page, add, repo, arize, phoenix, oss, truera, trulens, ql, tuui, evals, quesmaorg, binaryaudit, re, align, just, sdk, py, fastxyz, skill, optimizer, grigio, simple, whitecircle, circle, guard, bench, kuk, rulm, sbs2, izam, mohammed, ragrank, striveworks, valor, harnexa, nexa, gauge, alan, turing, institute, prompto,

Text of the page (most frequently used words):
llm (79), evaluation (44), eval (29), code (28), and (23), updated (22), issues (22), pull (21), #requests (21), star (21), python (18), 2026 (14), for (14), github (12), your (12), security (11), framework (10), all (10), language (9), jul (8), llms (8), llmops (8), prompt (8), mcp (8), you (7), more (7), model (7), discussions (7), benchmark (7), evals (7), testing (7), agents (7), this (6), with (6), topic (6), learning (6), open (6), source (6), engineering (6), enterprise (6), view (6), the (5), topics (5), machine (5), simple (5), typescript (5), platform (5), support (5), search (5), community (4), 2025 (4), large (4), toolkit (4), agent (4), sdk (4), monitoring (4), governance (4), openai (4), use (4), red (4), stars (4), explore (4), can (3), manage (3), navigation (3), page (3), add (3), models (3), library (3), feb (3), metrics (3), detection (3), benchmarking (3), rag (3), how (3), context (3), see (3), applications (3), evaluating (3), tool (3), tools (3), parea (3), analysis (3), anthropic (3), uptrain (3), cases (3), observability (3), most (3), repositories (3), another (3), tab (3), window (3), refresh (3), session (3), reload (3), sign (3), saved (3), documentation (3), feedback (3), grade (3), features (3), copilot (3), solutions (3), perform (2), that (2), footer (2), learn (2), repo (2), image (2), developers (2), improve (2), nlp (2), judge (2), mlops (2), valor (2), based (2), designed (2), sep (2), reliable (2), multinear (2), helps (2), its (2), good (2), are (2), sponsor (2), jupyter (2), notebook (2), guardrails (2), jailbreak (2), first (2), protection (2), guard (2), actions (2), may (2), skill (2), optimizer (2), evaluate (2), skills (2), performance (2), generative (2), issue (2), powered (2), 2024 (2), gpt (2), shell (2), find (2), athina (2), nist (2), rmf (2), auditing (2), act (2), compliance (2), risk (2), our (2), discord (2), verifywise (2), client (2), protocol (2), deepseek (2), api (2), claude (2), integration (2), test (2), root (2), cause (2), provide (2), insights (2), team (2), giskard (2), teaming (2), prompts (2), vulnerability (2), pentesting (2), promptfoo (2), recently (2), fewest (2), forks (2), sort (2), 151 (2), filter (2), sponsors (2), events (2), collections (2), trending (2), signed (2), appearance (2), settings (2), cancel (2), available (2), searches (2), business (2), advanced (2), developer (2), resources (2), customer (2), services (2), devops (2), app (2), action, time, not, share, personal, information, cookies, contact, docs, status, privacy, terms, inc, associate, repository, visit, landing, select, curate, description, links, easily, about, load, hut23, transformer, transformers, deep, natural, processing, asynchronous, querying, endpoints, prompto, alan, turing, institute, geval, relevance, scoring, blue, score, grounding, redteam, ranking, algorithm, rouge, metric, graph, nexa, gauge, harnexa, segmentation, object, classification, text, generation, computer, vision, lightweight, numpy, fast, seamless, striveworks, reliability, develop, apps, apr, free, assess, accuracy, facts, well, understands, tone, ragrank, izam, mohammed, 2023, russian, specific, бенчмарк, сравнивает, русские, аналоги, chatgpt, saiga, yandexgpt, gigachat, rulm, sbs2, kuk, mar, jailbreaks, guardrail, safeguard, kind, capabilities, systems, safeguards, circle, bench, whitecircle, intermediate, pattern, selection, grigio, calling, openrouter, cli, optimize, ensure, across, fastxyz, experimenting, s23, jan, gpt4, multi, aspect, interpretable, assessment, just, align, binary, cybersecurity, reverse, ability, backdoors, hidden, compiled, binaries, binaryaudit, quesmaorg, jun, ops, running, evaluations, generated, responses, 301, iso42001, iso27001, management, grc, audit, complete, iso, 42001, frameworks, regulations, join, channel, https, com, invite, d3k3e4uepr, 320, mcpb, inspector, host, agentic, qwen, playground, dxt, desktop, unitary, utility, accelerating, adoption, through, enabling, cross, vendor, orchestration, tuui, aug, hallucination, prompting, autoevaluation, experimentation, unified, grades, preconfigured, checks, covering, embedding, failure, give, resolve, them, agentops, explainable, neural, networks, tracking, experiments, trulens, truera, trustworthy, validation, responsible, fairness, oss, smolagents, aiengineering, llamaindex, langchain, datasets, phoenix, arize, scanners, cicd, rags, scanning, compare, gemini, declarative, configs, command, line, used, least, options, powershell, php, kotlin, javascript, html, here, public, matching, message, dismiss, alert, switched, accounts, out, resetting, focus, create, qualifiers, query, name, results, quickly, submit, include, email, address, contacted, read, every, piece, take, input, very, seriously, syntax, tips, clear, users, jump, pricing, premium, ons, archive, program, accelerator, maintainer, lab, programs, fund, partners, trust, center, forum, ebooks, reports, webinars, stories, type, software, development, industries, government, manufacturing, financial, healthcare, industry, devsecops, modernization, case, nonprofits, startups, small, medium, teams, enterprises, company, size, marketplace, changelog, blog, why, stop, leaks, before, they, start, secret, secure, build, fix, vulnerabilities, application, changes, review, plan, track, work, instant, dev, environments, codespaces, automate, any, workflow, workflows, integrate, external, registry, new, direct, from, merge, write, better, creation, toggle, menu, skip, content,

Text of the page (random words):
llm eval github topics github skip to content navigation menu toggle navigation sign in appearance settings platform ai code creation github copilot write better code with ai github copilot app direct agents from issue to merge mcp registry new integrate external tools developer workflows actions automate any workflow codespaces instant dev environments issues plan and track work code review manage code changes application security github advanced security find and fix vulnerabilities code security secure your code as you build secret protection stop leaks before they start explore why github documentation blog changelog marketplace view all features solutions by company size enterprises small and medium teams startups nonprofits by use case app modernization devsecops devops ci cd view all use cases by industry healthcare financial services manufacturing government view all industries view all solutions resources explore by topic ai software development devops security view all topics explore by type customer stories events webinars ebooks reports business insights github skills support services documentation customer support community forum trust center partners view all resources open source community github sponsors fund open source developers programs security lab maintainer community accelerator github stars archive program repositories topics trending collections enterprise enterprise solutions enterprise platform ai powered developer platform available add ons github advanced security enterprise grade security features copilot for business enterprise grade ai features premium support enterprise grade 24 7 support pricing search or jump to search code repositories users issues pull requests search clear search syntax tips provide feedback we read every piece of feedback and take your input very seriously include my email address so i can be contacted cancel submit feedback saved searches use saved searches to filter your results more quickly name query to see all available qualifiers see our documentation cancel create saved search sign in sign up appearance settings resetting focus you signed in with another tab or window reload to refresh your session you signed out in another tab or window reload to refresh your session you switched accounts on another tab or window reload to refresh your session dismiss alert message explore topics trending collections events github sponsors llm eval star here are 151 public repositories matching this topic language all filter by language all 151 python 80 typescript 30 jupyter notebook 7 html 5 go 3 javascript 3 shell 2 kotlin 1 php 1 powershell 1 sort most stars sort options most stars fewest stars most forks fewest forks recently updated least recently updated promptfoo promptfoo star 23 3k code issues pull requests test your prompts agents and rags red teaming pentesting vulnerability scanning for ai compare performance of gpt claude gemini deepseek and more simple declarative configs with command line and ci cd integration used by openai and anthropic testing ci evaluation ci cd pentesting cicd vulnerability scanners prompts evaluation framework red teaming rag llm prompt engineering llmops prompt testing llm eval llm evaluation llm evaluation framework updated jul 15 2026 typescript arize ai phoenix star 10 6k code issues pull requests discussions ai observability evaluation openai datasets agents ai monitoring ai observability prompt engineering llms langchain llmops anthropic llamaindex llm eval evals llm evaluation aiengineering smolagents updated jul 15 2026 python giskard ai giskard oss sponsor star 5 5k code issues pull requests discussions open source evaluation testing library for llm agents ai security mlops fairness ai responsible ai ml validation red team tools trustworthy ai ml testing llm ai red team ai testing llmops llm security llm eval llm evaluation rag evaluation agent evaluation updated jul 13 2026 python truera trulens star 3 4k code issues pull requests discussions evaluation and tracking for llm experiments and ai agents machine learning neural networks ai agents explainable ml agentops ai monitoring ai observability llms llmops llm eval evals llm evaluation agent evaluation updated jul 11 2026 python uptrain ai uptrain star 2 4k code issues pull requests discussions uptrain is an open source unified platform to evaluate and improve generative ai applications we provide grades for 20 preconfigured checks covering language code embedding use cases perform root cause analysis on failure cases and give insights on how to resolve them machine learning monitoring evaluation experimentation jailbreak detection autoevaluation root cause analysis prompt engineering llmops openai evals llm prompting llm eval llm test hallucination detection updated aug 18 2024 python ai ql tuui star 1 2k code issues pull requests a desktop mcp client designed as a tool unitary utility integration accelerating ai adoption through the model context protocol mcp and enabling cross vendor llm api orchestration testing agent ai mcp prompt claude dxt ai playground openai api llm anthropic llm eval qwen deepseek agentic ai model context protocol mcp client mcp host mcp inspector mcpb updated may 14 2026 typescript verifywise ai verifywise star 320 code issues pull requests discussions complete ai governance and llm evals platform with support for eu ai act iso 42001 nist ai rmf and 20 more ai frameworks and regulations join our discord channel https discord com invite d3k3e4uepr auditing ai audit compliance grc governance risk management iso27001 ai risk ai compliance ai governance ai governance model llm eval llm evaluation eu ai act ai auditing iso42001 nist ai rmf updated jul 15 2026 typescript athina ai athina evals star 301 code issues pull requests python sdk for running evaluations on llm generated responses evaluation evaluation metrics evaluation framework llmops llm eval llm ops llm evaluation llm evaluation toolkit updated jun 6 2025 python quesmaorg binaryaudit star 93 code issues pull requests an open source benchmark for evaluating ai agents ability to find backdoors hidden in compiled binaries benchmark ai reverse engineering cybersecurity binary analysis llm eval updated jul 14 2026 shell re align just eval star 90 code issues pull requests a simple gpt based evaluation tool for multi aspect interpretable assessment of llms evaluation gpt4 llm llm eval llm evaluation llm evaluation toolkit updated jan 29 2024 python parea ai parea sdk py star 82 code issues pull requests python sdk for experimenting testing evaluating monitoring llm powered applications parea ai yc s23 metrics good first issue llm prompt engineering generative ai llmops llm eval llm tools llm evaluation llm evaluation toolkit llms benchmarking llm evaluation framework updated feb 13 2025 python fastxyz skill optimizer star 71 code issues pull requests benchmark evaluate and optimize skills to ensure reliable performance across all llms cli benchmark sdk ai mcp evaluation optimizer eval evaluation framework ai agent llm llm eval evals openrouter llm evaluation framework tool calling llm evals ai skill updated may 28 2026 typescript grigio llm eval simple star 70 code issues pull requests llm eval simple is a simple llm evaluation framework with intermediate actions and prompt pattern selection llm llm eval llm evaluation benchmark updated feb 28 2026 python whitecircle circle guard bench star 70 code issues pull requests first of its kind ai benchmark for evaluating the protection capabilities of large language model llm guard systems guardrails and safeguards benchmarking benchmark ai jailbreak safeguard guardrail guardrails large language models llm large language model llm security llm eval llm evaluation llm as a judge llm jailbreaks updated mar 7 2026 python kuk rulm sbs2 star 62 code issues pull requests бенчмарк сравнивает русские аналоги chatgpt saiga yandexgpt gigachat russian specific llm eval updated sep 26 2023 jupyter notebook izam mohammed ragrank sponsor star 47 code issues pull requests discussions your free llm evaluation toolkit helps you assess the accuracy of facts how well it understands context its tone and more this helps you see how good your llm applications are machine learning evaluation language model rag llm prompt engineering llmops llm eval updated apr 21 2026 python multinear multinear star 45 code issues pull requests develop reliable ai apps reliability evaluation llm llms llm eval llm evaluation llms benchmarking llm evaluation framework updated sep 2 2025 python striveworks valor star 41 code issues pull requests discussions valor is a lightweight numpy based library designed for fast and seamless evaluation of machine learning models nlp computer vision evaluation text generation classification object detection image segmentation evaluation metrics model evaluation mlops llm eval updated feb 9 2026 python harnexa nexa gauge star 39 code issues pull requests an graph eval framework for llm s rouge metric ranking algorithm redteam grounding llm blue score llm eval llm evaluation framework llm judge relevance scoring geval updated jul 13 2026 python alan turing institute prompto star 38 code issues pull requests an open source library for asynchronous querying of llm endpoints python nlp machine learning natural language processing deep learning transformers transformer hut23 large language models llms llm eval llm evaluation updated jul 18 2025 python load more improve this page add a description image and links to the llm eval topic page so that developers can more easily learn about it curate this topic add this topic to your repo to associate your repository with the llm eval topic visit your repo s landing page and select manage topics learn more footer 2026 github inc footer navigation terms privacy security status community docs contact manage cookies do not share my personal information you can t perform that action at this time