Meta tags:
description=A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications. - NVIDIA/DALI;

Headings (most frequently used words):

dali, uh, oh, navigation, saved, searches, nvidia, to, and, files, footer, resources, contributing, search, code, repositories, users, issues, pull, requests, provide, feedback, menu, use, filter, your, results, more, quickly, folders, latest, commit, history, repository, about, releases, 98, contributors, languages, in, action, highlights, success, stories, roadmap, installing, examples, tutorials, additional, reporting, problems, asking, questions, acknowledgements, topics, license, stars, watchers, forks,

Text of the page (most frequently used words):
the (55), dali (53), and (42), data (31), gpu (27), nvidia (27), for (19), github (17), with (17), images (16), #processing (15), code (15), you (12), security (12), learning (12), 255 (12), deep (11), all (10), technology (10), conference (10), model (10), can (9), loading (9), import (9), your (8), that (7), this (7), please (7), reload (7), page (7), contributing (7), are (7), enterprise (7), version (7), documentation (7), ndd (7), def (7), dynamic (7), mode (7), view (7), docs (6), cuda (6), inference (6), from (6), more (6), examples (6), event (6), loss (6), pred (6), 224 (6), types (6), pass (6), skills (6), navigation (5), was (5), latest (5), license (5), pipeline (5), tensorflow (5), pytorch (5), library (5), execution (5), training (5), applications (5), problem (5), use (5), feedback (5), support (5), file (5), see (5), search (5), time (4), community (4), there (4), error (4), while (4), readme (4), resources (4), fast (4), image (4), com (4), accelerated (4), optimized (4), provide (4), pull (4), requests (4), developer (4), recording (4), pre (4), preprocessing (4), workflows (4), advanced (4), source (4), open (4), pipelines (4), jpeg (4), backward (4), loss_func (4), labels (4), 256 (4), reader (4), images_dir (4), readers (4), data_root_dir (4), name (4), agents (4), features (4), include (4), rst (4), txt (4), flake8 (4), actions (4), quality (4), issues (4), not (3), cmake (3), python (3), repository (3), stars (3), custom (3), topics (3), user (3), guide (3), highly (3), building (3), blocks (3), engine (3), accelerate (3), built (3), acknowledgements (3), other (3), problems (3), external (3), label (3), slides (3), accelerating (3), triton (3), release (3), paddlepaddle (3), install (3), https (3), our (3), roadmap (3), issue (3), any (3), have (3), path (3), well (3), multiple (3), cpu (3), portable (3), frameworks (3), torch (3), files (3), tools (3), commit (3), insights (3), signed (3), settings (3), another (3), tab (3), window (3), refresh (3), session (3), sign (3), saved (3), grade (3), copilot (3), platform (3), solutions (3), explore (3), action (2), information (2), manage (2), footer (2), 2026 (2), releases (2), forks (2), 669 (2), apache (2), augmentation (2), audio (2), index (2), containing (2), about (2), major (2), contributions (2), gale (2), layton (2), make (2), check (2), still (2), questions (2), reports (2), follow (2), outlined (2), document (2), start (2), one (2), welcome (2), blog (2), 2019 (2), integration (2), michał (2), joaquin (2), anton (2), guirao (2), powered (2), 2022 (2), introduction (2), 2023 (2), end (2), server (2), 2024 (2), performance (2), ebay (2), additional (2), which (2), main (2), nightly (2), found (2), tutorials (2), build (2), refer (2), installation (2), plugin (2), specific (2), requires (2), case (2), installed (2), pip (2), cuda120 (2), plan (2), change (2), its (2), items (2), type (2), models (2), industry (2), software (2), pose (2), best (2), stories (2), easy (2), direct (2), storage (2), developers (2), create (2), across (2), popular (2), api (2), as_tensor (2), coin_flip (2), random (2), mirror (2), 225 (2), 229 (2), std (2), 406 (2), 456 (2), 485 (2), mean (2), crop_w (2), crop_h (2), crop_mirror_normalize (2), resize_y (2), resize_x (2), resize (2), rest (2), happens (2), rgb (2), output_type (2), device (2), image_random_crop (2), decoders (2), batch_size (2), true (2), random_shuffle (2), file_root (2), single (2), join (2), dali_extra_path (2), environ (2), points (2), dali_extra (2), run (2), different (2), train_data (2), get_dali_pipeline (2), daligenericiterator (2), pipeline_def (2), add (2), skill (2), provides (2), such (2), they (2), bottleneck (2), input (2), pyproject (2), toml (2), guided_contribution_tutorial (2), png (2), bandit (2), yml (2), style_guide (2), doxyfile (2), dali_extra_version (2), dali_deps_version (2), copyright (2), cmakelists (2), gitmodules (2), gitignore (2), git (2), blame (2), ignore (2), revs (2), clang (2), format (2), third_party (2), plugins (2), platforms (2), internal_tools (2), docker (2), dali_tf_plugin (2), conda (2), greptile (2), githooks (2), claude (2), 319 (2), commits (2), last (2), message (2), menu (2), projects (2), appearance (2), cancel (2), available (2), searches (2), repositories (2), business (2), customer (2), services (2), devops (2), app (2), merge (2), perform, share, personal, cookies, contact, status, privacy, terms, inc, shell, languages, contributors, jun, report, watching, watchers, properties, activity, paddle, mxnet, neural, network, machine, deeplearning, html, originally, trevor, przemek, tredak, simon, andrei, ivanov, serge, panev, test, sure, reproduces, remove, related, request, verifiable, parts, needed, reproduce, strip, dependency, show, less, spend, reproducing, dedicate, fixes, complete, little, possible, produces, same, minimal, appreciate, bug, when, need, help, process, ensure, posted, stack, overflow, reporting, asking, looking, task, good, contribution, contribute, guidelines, posts, 2018, trędak, josh, park, anurag, dixit, tensorrt, xavier, janusz, lisiecki, zientkiewicz, 2020, albert, wolant, 2021, krzysztof, łęcki, szołucha, rafał, banaś, effective, real, life, kevin, green, geospatial, brandon, tuttle, breakout, yiheng, wang, optimizing, serving, highest, select, stays, sync, branch, depending, note, interactive, jupyter, notebook, directory, getting, started, compilation, paths, older, weekly, builds, etc, requirements, comes, preinstalled, containers, cloud, supporting, appropriate, based, toolkit, driver, extra, url, pypi, upgrade, installing, strongly, encourage, comment, mentioned, high, level, overview, should, aware, may, order, does, reflect, priority, following, represents, inside, framework, mlperf, standard, benchmarking, compute, hardware, improve, resource, utilization, computing, infrastructure, lightning, state, art, estimation, research, things, learned, competition, during, kaggle, computer, vision, competitions, success, backend, allows, between, memory, gpudirect, accelerates, classification, resnet, object, detection, ssd, workloads, asr, jasper, rnn, extensible, needs, operators, flexible, graphs, let, scalable, gpus, supports, jax, formats, lmdb, recordio, tfrecord, coco, 2000, wav, flac, ogg, 264, vp9, hevc, functional, style, highlights, next_epoch, experimental, enumerate, reader_name, return, mixed, decode, device_id, num_threads, npx, guidance, practices, follows, tip, addition, implementations, resulting, challenges, portability, maintainability, implemented, using, because, easily, retargeted, addresses, offloading, additionally, relies, own, maximize, throughput, prefetching, parallel, batch, handled, transparently, require, complex, multi, stage, decoding, cropping, resizing, many, augmentations, these, currently, executed, become, limiting, scalability, collection, video, used, drop, replacement, loaders, iterators, history, date, folders, tags, branches, options, 195, star, fork, must, notification, notifications, public, dismiss, alert, switched, accounts, out, resetting, focus, qualifiers, query, filter, results, quickly, submit, email, address, contacted, read, every, piece, take, very, seriously, syntax, tips, clear, users, jump, pricing, premium, ons, collections, trending, archive, program, accelerator, maintainer, lab, programs, fund, sponsors, partners, trust, center, forum, ebooks, events, webinars, development, topic, industries, government, manufacturing, financial, healthcare, cases, devsecops, modernization, nonprofits, startups, small, medium, teams, enterprises, company, size, marketplace, changelog, why, stop, leaks, before, secret, protection, secure, find, fix, vulnerabilities, application, enforce, changes, review, track, work, instant, dev, environments, codespaces, automate, workflow, integrate, mcp, registry, new, write, better, creation, toggle, skip, content,

Text of the page (random words):
github nvidia dali a gpu accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications github skip to content navigation menu toggle navigation sign in appearance settings platform ai code creation github copilot write better code with ai github copilot app direct agents from issue to merge mcp registry new integrate external tools developer workflows actions automate any workflow codespaces instant dev environments issues plan and track work code review manage code changes code quality enforce quality at merge application security github advanced security find and fix vulnerabilities code security secure your code as you build secret protection stop leaks before they start explore why github documentation blog changelog marketplace view all features solutions by company size enterprises small and medium teams startups nonprofits by use case app modernization devsecops devops ci cd view all use cases by industry healthcare financial services manufacturing government view all industries view all solutions resources explore by topic ai software development devops security view all topics explore by type customer stories events webinars ebooks reports business insights github skills support services documentation customer support community forum trust center partners view all resources open source community github sponsors fund open source developers programs security lab maintainer community accelerator github stars archive program repositories topics trending collections enterprise enterprise solutions enterprise platform ai powered developer platform available add ons github advanced security enterprise grade security features copilot for business enterprise grade ai features premium support enterprise grade 24 7 support pricing search or jump to search code repositories users issues pull requests search clear search syntax tips provide feedback we read every piece of feedback and take your input very seriously include my email address so i can be contacted cancel submit feedback saved searches use saved searches to filter your results more quickly name query to see all available qualifiers see our documentation cancel create saved search sign in sign up appearance settings resetting focus you signed in with another tab or window reload to refresh your session you signed out in another tab or window reload to refresh your session you switched accounts on another tab or window reload to refresh your session dismiss alert message uh oh there was an error while loading please reload this page nvidia dali public notifications you must be signed in to change notification settings fork 669 star 5 7k code issues 195 pull requests 23 actions projects security and quality 0 insights additional navigation options code issues pull requests actions projects security and quality insights nvidia dali main branches tags go to file code open more actions menu folders and files name name last commit message last commit date latest commit history 4 319 commits 4 319 commits agents agents claude claude githooks githooks github github greptile greptile cmake cmake conda conda dali dali dali_tf_plugin dali_tf_plugin docker docker docs docs include dali include dali internal_tools internal_tools platforms platforms plugins plugins qa qa skills dali dynamic mode skills dali dynamic mode third_party third_party tools tools clang format clang format flake8 flake8 flake8 ag flake8 ag git blame ignore revs git blame ignore revs gitignore gitignore gitmodules gitmodules acknowledgements txt acknowledgements txt cmakelists txt cmakelists txt contributing md contributing md copyright copyright dali_deps_version dali_deps_version dali_extra_version dali_extra_version doxyfile doxyfile license license readme rst readme rst security rst security rst style_guide md style_guide md version version bandit yml bandit yml dali png dali png guided_contribution_tutorial md guided_contribution_tutorial md pyproject toml pyproject toml view all files repository files navigation readme contributing apache 2 0 license more items nvidia dali the nvidia data loading library dali is a gpu accelerated library for data loading and pre processing to accelerate deep learning applications it provides a collection of highly optimized building blocks for loading and processing image video and audio data it can be used as a portable drop in replacement for built in data loaders and data iterators in popular deep learning frameworks deep learning applications require complex multi stage data processing pipelines that include loading decoding cropping resizing and many other augmentations these data processing pipelines which are currently executed on the cpu have become a bottleneck limiting the performance and scalability of training and inference dali addresses the problem of the cpu bottleneck by offloading data preprocessing to the gpu additionally dali relies on its own execution engine built to maximize the throughput of the input pipeline features such as prefetching parallel execution and batch processing are handled transparently for the user in addition the deep learning frameworks have multiple data pre processing implementations resulting in challenges such as portability of training and inference workflows and code maintainability data processing pipelines implemented using dali are portable because they can easily be retargeted to tensorflow pytorch and paddlepaddle tip the dali dynamic mode skill provides ai agents with guidance on the dynamic mode api and best practices it can be installed as follows npx skills add nvidia skills skill dali dynamic mode for more information see the nvidia skills github repository dali in action pipeline mode from nvidia dali pipeline import pipeline_def import nvidia dali types as types import nvidia dali fn as fn from nvidia dali plugin pytorch import daligenericiterator import os to run with different data see documentation of nvidia dali fn readers file points to https github com nvidia dali_extra data_root_dir os environ dali_extra_path images_dir os path join data_root_dir db single jpeg def loss_func pred y pass def model x pass def backward loss model pass pipeline_def num_threads 4 device_id 0 def get_dali_pipeline images labels fn readers file file_root images_dir random_shuffle true name reader decode data on the gpu images fn decoders image_random_crop images device mixed output_type types rgb the rest of processing happens on the gpu as well images fn resize images resize_x 256 resize_y 256 images fn crop_mirror_normalize images crop_h 224 crop_w 224 mean 0 485 255 0 456 255 0 406 255 std 0 229 255 0 224 255 0 225 255 mirror fn random coin_flip return images labels train_data daligenericiterator get_dali_pipeline batch_size 16 data label reader_name reader for i data in enumerate train_data x y data 0 data data 0 label pred model x loss loss_func pred y backward loss model dynamic mode import os import nvidia dali types as types import nvidia dali experimental dynamic as ndd import torch to run with different data see documentation of ndd readers file points to https github com nvidia dali_extra data_root_dir os environ dali_extra_path images_dir os path join data_root_dir db single jpeg def loss_func pred y pass def model x pass def backward loss model pass reader ndd readers file file_root images_dir random_shuffle true for images labels in reader next_epoch batch_size 16 images ndd decoders image_random_crop images device gpu output_type types rgb the rest of processing happens on the gpu as well images ndd resize images resize_x 256 resize_y 256 images ndd crop_mirror_normalize images crop_h 224 crop_w 224 mean 0 485 255 0 456 255 0 406 255 std 0 229 255 0 224 255 0 225 255 mirror ndd random coin_flip x torch as_tensor images y torch as_tensor labels gpu pred model x loss loss_func pred y backward loss model highlights easy to use functional style python api multiple data formats support lmdb recordio tfrecord coco jpeg jpeg 2000 wav flac ogg h 264 vp9 and hevc portable across popular deep learning frameworks tensorflow pytorch paddlepaddle jax supports cpu and gpu execution scalable across multiple gpus flexible graphs let developers create custom pipelines extensible for user specific needs with custom operators accelerates image classification resnet 50 object detection ssd workloads as well as asr models jasper rnn t allows direct data path between storage and gpu memory with gpudirect storage easy integration with nvidia triton inference server with dali triton backend open source dali success stories during kaggle computer vision competitions dali is one of the best things i have learned in this competition lightning pose state of the art pose estimation research model to improve the resource utilization in advanced computing infrastructure mlperf the industry standard for benchmarking compute and deep learning hardware and software we optimized major models inside ebay with the dali framework dali roadmap the following issue represents a high level overview of our 2024 plan you should be aware that this roadmap may change at any time and the order of its items does not reflect any type of priority we strongly encourage you to comment on our roadmap and provide us feedback on the mentioned github issue installing dali to install the latest dali release for the latest cuda version 12 x pip install nvidia dali cuda120 or pip install extra index url https pypi nvidia com upgrade nvidia dali cuda120 dali requires nvidia driver supporting the appropriate cuda version in case of dali based on cuda 12 it requires cuda toolkit to be installed dali comes preinstalled in the tensorflow pytorch and paddlepaddle containers on nvidia gpu cloud for other installation paths tensorflow plugin older cuda version nightly and weekly builds etc and specific requirements please refer to the installation guide to build dali from source please refer to the compilation guide examples and tutorials an introduction to dali can be found in the getting started page more advanced examples can be found in the examples and tutorials page for an interactive version jupyter notebook of the examples go to the docs examples directory note select the latest release documentation or the nightly release documentation which stays in sync with the main branch depending on your version additional resources gpu technology conference 2024 optimizing inference model serving for highest performance at ebay yiheng wang event gpu technology conference 2023 developer breakout accelerating enterprise workflows with triton server and dali brandon tuttle event gpu technology conference 2023 gpu accelerating end to end geospatial workflows kevin green event gpu technology conference 2022 effective nvidia dali accelerating real life deep learning applications rafał banaś event gpu technology conference 2022 introduction to nvidia dali gpu accelerated data preprocessing joaquin anton guirao event gpu technology conference 2021 nvidia dali gpu powered data preprocessing by krzysztof łęcki and michał szołucha event gpu technology conference 2020 fast data pre processing with nvidia data loading library dali albert wolant joaquin anton guirao recording gpu technology conference 2019 fast ai data pre preprocessing with dali janusz lisiecki michał zientkiewicz slides recording gpu technology conference 2019 integration of dali with tensorrt on xavier josh park and anurag dixit slides recording gpu technology conference 2018 fast data pipeline for deep learning training t gale s layton and p trędak slides recording developer page blog posts contributing to dali we welcome contributions to dali to contribute to dali and make pull requests follow the guidelines outlined in the contributing document if you are looking for a task good for the start please check one from external contribution welcome label reporting problems asking questions we appreciate feedback questions or bug reports when you need help with the code follow the process outlined in the stack overflow document ensure that the posted examples are minimal use as little code as possible that still produces the same problem complete provide all parts needed to reproduce the problem check if you can strip external dependency and still show the problem the less time we spend on reproducing the problems the more time we can dedicate to the fixes verifiable test the code you are about to provide to make sure that it reproduces the problem remove all other problems that are not related to your request acknowledgements dali was originally built with major contributions from trevor gale przemek tredak simon layton andrei ivanov and serge panev about a gpu accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications docs nvidia com deeplearning dali user guide docs index html topics python machine learning deep learning neural network mxnet gpu image processing pytorch gpu tensorflow data processing data augmentation audio processing paddle image augmentation fast data pipeline resources readme license apache 2 0 license contributing contributing uh oh there was an error while loading please reload this page activity custom properties stars 5 7k stars watchers 87 watching forks 669 forks report repository releases 98 dali v2 2 0 latest jun 29 2026 97 releases uh oh there was an error while loading please reload this page contributors uh oh there was an error while loading please reload this page languages c 51 3 python 34 9 cuda 9 4 cmake 1 8 shell 1 3 c 1 3 footer 2026 github inc footer navigation terms privacy security status community docs contact manage cookies do not share my personal information you can t perform that action at this time