Meta tags:
description=Updating torch_gc() to explicitly set the correct CUDA device first before GC (to properly support multi-GPU systems using a non-zero --device-id. Garbage collection (torch_gc in modules/devices.py) currently causes an incorrect OOM on multi-GPU systems if the first CUDA device is already fully allocated. This is because torch.cuda.empty_cache() defaults to cuda:0 unless explicitly set otherwise first. Possibly another edge case here is that anyone currently running a non-zero --device-id doesn t have garbage collection working correctly.;

Headings (most frequently used words):

cuda, torch, empty_cache, defaults, to, device, unless, explicitly, 5095, footer, conversation, mlmcgoogan, commented, nov, 26, 2022, navigation,

Text of the page (most frequently used words):
this (17), github (16), automatic1111 (13), cuda (12), 2022 (11), the (11), applied (10), code (10), nov (10), #device (10), sign (9), pull (8), that (7), suggestions (7), changes (7), you (6), cannot (6), suggestion (6), commit (6), explicitly (6), all (6), jump (6), and (6), request (5), from (5), for (5), 5095 (5), merged (5), master (5), mlmcgoogan (5), torch (5), empty_cache (5), defaults (5), unless (5), can (4), about (4), security (4), multi (4), issues (4), account (4), set (4), first (4), open (4), another (3), your (3), while (3), line (3), batch (3), none (3), yet (3), these (3), projects (3), already (3), have (3), conversation (3), into (3), view (3), review (3), torch_gc (3), gpu (3), systems (3), characters (3), unicode (3), actions (3), discussions (3), stable (3), diffusion (3), webui (3), repository (3), signed (2), tab (2), window (2), refresh (2), session (2), reload (2), with (2), blog (2), pricing (2), contact (2), privacy (2), terms (2), footer (2), navigation (2), add (2), single (2), one (2), because (2), may (2), milestone (2), acheong08 (2), free (2), details (2), approved (2), otherwise (2), updating (2), oom (2), edge (2), garbage (2), collection (2), currently (2), case (2), non (2), zero (2), hidden (2), file (2), bidirectional (2), more (2), issue (2), community (2), project (2), insights (2), wiki (2), requests (2), source (2), manage (2), packages (2), web (2), capture (2), out, perform, action, time, training, api, docs, status, inc, queued, merge, comments, pending, reviews, has, been, marked, resolved, outdated, must, change, existing, order, create, valid, applying, deleted, lines, not, supported, only, per, viewing, subset, closed, invalid, were, made, participants, successfully, merging, close, development, labels, assigned, assignees, reviewers, comment, join, added, referenced, 5b2c316, eliminate, duplicated, check, passed, 997ac57, hide, requested, owner, use, specified, avoid, cases, c67c40f, reactions, sorry, something, went, wrong, modules, devices, causes, incorrect, fully, allocated, possibly, here, anyone, running, doesn, working, correctly, correct, before, properly, support, using, commented, contributor, copy, link, show, contains, text, interpreted, compiled, differently, than, what, appears, below, editor, reveals, learn, files, changed, checks, commits, bottom, clicking, agree, our, occasionally, send, related, emails, statement, service, password, email, address, pick, username, its, maintainers, question, new, 108, star, fork, notifications, public, message, user, suggested, results, collections, trending, topics, repositories, articles, readme, fund, developers, sponsors, resources, customer, stories, studies, devsecops, devops, automation, solution, education, startups, teams, enterprise, solutions, skills, documentation, features, explore, collaborate, outside, plan, track, work, write, better, copilot, instant, dev, environments, codespaces, find, fix, vulnerabilities, host, automate, any, workflow, product, toggle, skip, content, wayback, machine, http, archive, org, 20221130171236, https, com, timestamps, fail, success, 2023, 2021, dec, oct,

Text of the page (random words):
torch cuda empty_cache defaults to cuda 0 device unless explicitly by mlmcgoogan pull request 5095 automatic1111 stable diffusion webui github 1 capture 30 nov 2022 oct nov dec 30 2021 2022 2023 success fail about this capture timestamps the wayback machine http web archive org web 20221130171236 https github com automatic1111 stable diffusion webui pull 5095 skip to content toggle navigation sign up product actions automate any workflow packages host and manage packages security find and fix vulnerabilities codespaces instant dev environments copilot write better code with ai code review manage code changes issues plan and track work discussions collaborate outside of code explore all features documentation github skills blog solutions for enterprise teams startups education by solution ci cd automation devops devsecops case studies customer stories resources open source github sponsors fund open source developers the readme project github community articles repositories topics trending collections pricing in this repository all github jump to no suggested jump to results in this repository all github jump to in this user all github jump to in this repository all github jump to sign in sign up message automatic1111 stable diffusion webui public notifications fork 4 2k star 23 1k code issues 1 3k pull requests 108 discussions actions projects 0 wiki security insights more code issues pull requests discussions actions projects wiki security insights new issue have a question about this project sign up for a free github account to open an issue and contact its maintainers and the community pick a username email address password sign up for github by clicking sign up for github you agree to our terms of service and privacy statement we ll occasionally send you account related emails already on github sign in to your account jump to bottom torch cuda empty_cache defaults to cuda 0 device unless explicitly 5095 merged automatic1111 merged 1 commit into automatic1111 master from mlmcgoogan master nov 27 2022 merged torch cuda empty_cache defaults to cuda 0 device unless explicitly 5095 automatic1111 merged 1 commit into automatic1111 master from mlmcgoogan master nov 27 2022 12 2 conversation 0 commits 1 checks 1 files changed 1 conversation this file contains bidirectional unicode text that may be interpreted or compiled differently than what appears below to review open the file in an editor that reveals hidden unicode characters learn more about bidirectional unicode characters show hidden characters copy link contributor mlmcgoogan commented nov 26 2022 updating torch_gc to explicitly set the correct cuda device first before gc to properly support multi gpu systems using a non zero device id garbage collection torch_gc in modules devices py currently causes an incorrect oom on multi gpu systems if the first cuda device is already fully allocated this is because torch cuda empty_cache defaults to cuda 0 unless explicitly set otherwise first possibly another edge case here is that anyone currently running a non zero device id doesn t have garbage collection working correctly sorry something went wrong all reactions torch cuda empty_cache defaults to cuda 0 device unless explicitly c67c40f set otherwise first updating torch_gc to use the device set by device id if specified to avoid oom edge cases on multi gpu systems mlmcgoogan requested a review from automatic1111 as a code owner nov 26 2022 acheong08 approved these changes nov 27 2022 view changes automatic1111 approved these changes nov 27 2022 view changes hide details view details automatic1111 merged commit 997ac57 into automatic1111 master nov 27 2022 1 check passed automatic1111 added a commit that referenced this pull request nov 27 2022 eliminate duplicated code from 5095 5b2c316 sign up for free to join this conversation on github already have an account sign in to comment reviewers automatic1111 acheong08 assignees no one assigned labels none yet projects none yet milestone no milestone development successfully merging this pull request may close these issues none yet 3 participants add this suggestion to a batch that can be applied as a single commit this suggestion is invalid because no changes were made to the code suggestions cannot be applied while the pull request is closed suggestions cannot be applied while viewing a subset of changes only one suggestion per line can be applied in a batch add this suggestion to a batch that can be applied as a single commit applying suggestions on deleted lines is not supported you must change the existing code in this line in order to create a valid suggestion outdated suggestions cannot be applied this suggestion has been applied or marked resolved suggestions cannot be applied from pending reviews suggestions cannot be applied on multi line comments suggestions cannot be applied while the pull request is queued to merge footer 2022 github inc footer navigation terms privacy security status docs contact github pricing api training blog about you can t perform that action at this time you signed in with another tab or window reload to refresh your session you signed out in another tab or window reload to refresh your session