Meta tags:
description= Learn how to use Humanloop for prompt engineering, evaluation and monitoring. Comprehensive guides and tutorials for LLMOps.;
Headings (most frequently used words):
humanloop, is, the, llm, evals, platform, for, enterprises, get, started, with,
Text of the page (most frequently used words):
and (17), the (16), humanloop (14), prompt (11), evaluate (8), evals (8), for (8), with (7), code (7), agent (7), #started (6), evaluation (6), observability (5), feedback (5), llms (5), management (5), logs (5), create (5), set (5), llm (4), page (4), get (4), txt (4), api (4), prompts (4), from (4), your (3), quickstart (3), engineering (3), our (3), product (3), best (3), development (3), platform (3), data (3), environment (3), files (3), vercel (3), sdk (3), manage (3), capture (3), user (3), run (3), dataset (3), via (3), reference (3), docs (3), next (2), guides (2), key (2), concepts (2), enables (2), you (2), practices (2), work (2), first (2), experts (2), they (2), features (2), through (2), teams (2), enterprises (2), getting (2), book (2), demo (2), sign (2), sso (2), authentication (2), access (2), roles (2), rbacs (2), security (2), compliance (2), runtime (2), template (2), library (2), supported (2), models (2), deployment (2), options (2), environments (2), logging (2), tool (2), calling (2), use (2), external (2), evaluators (2), human (2), evaluator (2), migrating (2), rag (2), app (2), agents (2), integrating (2), overview (2), changelog (2), index (2), level (2), any (2), built, quickly, apps, improve, them, yes, was, this, helpful, above, learn, more, about, customer, stories, manager, engineer, adopt, these, are, designed, together, fast, loop, works, both, that, experience, great, developers, subject, matter, smes, enable, non, technical, domain, pms, seamlessly, engineers, collaborative, put, heart, continuously, refining, enhancing, iteration, driven, most, successful, focus, two, build, robust, using, class, tooling, will, sunset, need, export, please, see, migration, guide, september, 8th, 2025, copy, light, keys, invite, collaborators, monitor, production, link, function, directory, deploy, snippets, editor, store, log, call, spot, check, evaluations, compare, debug, multiple, reviewers, judge, existing, upload, csv, directories, datasets, flows, tools, node, organization, how, tutorials, explanation, integrations, ask, search, documentation, available, root, append, url, markdown, version,
Text of the page (random words):
humanloop is the llm evals platform for enterprises humanloop docs for ai agents a documentation index is available at the root level at llms txt append llms txt to any url for a page level index or md for the markdown version of any page v5 0 v5 0 search ask ai sign in book a demo docs reference changelog v5 0 v5 0 docs reference changelog getting started overview quickstart integrations explanation integrating humanloop key concepts tutorials evaluate an agent in the ui evaluate an agent in code evaluate a rag app capture user feedback how to guides migrating from humanloop evaluation prompt management observability organization management reference deployment options supported models template library vercel ai sdk prompt and agent files humanloop runtime environment security and compliance data management access roles rbacs sso and authentication llms txt overview quickstart evals in code agent evals in the ui create prompt in the ui set up logging vercel ai sdk observability in next js observability in node js integrating humanloop files prompts agents evaluators tools flows datasets logs directories environments evaluate an agent in the ui evaluate an agent in code evaluate a rag app capture user feedback migrating from humanloop run an evaluation via the ui run an evaluation via the api upload a dataset from csv create a dataset via the api create a dataset from existing logs set up a code evaluator set up llm as a judge set up a human evaluator run a human evaluation manage multiple reviewers compare and debug prompts set up ci cd evaluations spot check your logs use external evaluators evaluate external logs create a prompt call a prompt log to a prompt store prompts in code tool calling in editor re use snippets in prompts deploy to an environment create a directory link a tool for function calling monitor production logs capture user feedback logging through api invite collaborators manage api keys manage environments deployment options supported models template library vercel ai sdk prompt and agent files humanloop runtime environment security and compliance data management access roles rbacs sso and authentication llms txt sign in book a demo light getting started humanloop is the llm evals platform for enterprises copy page the humanloop platform will be sunset on september 8th 2025 if you need to export your data please see our migration guide humanloop enables product teams to build robust ai features with llms using best in class tooling for evaluation prompt management and observability the most successful ai teams focus on two best practices evals driven development they put evals at the heart of product development continuously refining and enhancing ai features through feedback and iteration collaborative development they enable non technical domain experts and pms to work seamlessly with engineers on prompt engineering and evaluation get started with humanloop humanloop enables you to adopt these best practices our evals prompt engineering and observability are designed to work together in a fast feedback loop it works both ui first and code first so that the experience is great for developers and subject matter experts smes i m an engineer get started with evals in code i m a product manager get started with prompt engineering in our ui get started with the guides above or learn more about humanloop s key concepts and customer stories was this page helpful yes no quickstart quickly evaluate your llm apps and improve them next built with
|