Meta tags:
description= Understand instance options available to support GPU-accelerated workloads such as machine learning, data processing, and graphics workloads on Compute Engine.;
keywords= compute engine, gce, gcp, google cloud, nvidia gpu models, nvidia gpus, gpu machine types, gpu types, gcp gpu, a4x max a4X, a4, a3, a2, g2, a3 ultra, a3 mega, a3 high, a3 edge, a2 ultra, a2 standard, g4, n1, nvidia gb200, rtx pro 6000, b200, h200, h100, a100, l4, t4, p100, v100, machine series, gpu accelerated vms, gpu memory, gpu count;
Headings (most frequently used words):
machine, nvidia, and, series, a3, n1, core, standard, a4x, tensor, cuda, gpus, types, a2, cores, max, type, ultra, mega, high, edge, architectures, gpu, stay, organized, with, collections, save, categorize, content, based, on, your, preferences, overview, a4, b200, a100, g4, rtx, pro, 6000, g2, l4, general, comparison, chart, performance, what, next, gb300, gb200, h200, h100, t4, p4, v100, p100, blackwell, architecture, hopper, ada, lovelace, ampere, volta, pascal, turing, products, pricing, support, resources, engage,
Text of the page (most frequently used words):
and (218), the (210), for (173), create (141), gpu (117), nvidia (116), #machine (113), vms (112), with (98), instance (95), memory (81), about (72), troubleshoot (62), bandwidth (59), types (58), gpus (56), performance (53), that (52), use (52), network (48), disks (47), manage (46), type (44), attached (43), disk (43), instances (42), workloads (41), server (41), view (40), compute (40), you (40), can (39), using (39), count (38), mig (37), from (36), engine (35), standard (35), overview (35), available (33), set (33), windows (33), a4x (32), configure (32), see (30), google (29), training (29), data (28), ssd (28), optimized (28), cloud (27), model (27), reservation (27), inference (26), local (26), hpc (25), series (25), gbps (25), storage (25), are (23), vcpu (23), number (23), h100 (22), 000 (22), virtual (22), your (22), maximum (22), cores (21), ultra (21), high (21), accelerator (21), hyperdisk (21), sql (21), support (20), following (20), graphics (20), cpu (20), monitor (20), images (20), p100 (19), a100 (19), yes (19), host (19), information (18), more (18), this (18), tflops (18), these (18), models (18), higher (18), cluster (18), access (18), resources (17), rtx (17), max (17), workload (17), intensive (17), custom (17), image (17), linux (17), policies (16), zones (16), tensor (16), when (16), blackwell (16), single (16), designed (16), tesla (16), egress (16), reservations (16), availability (15), not (15), best (15), vws (15), snapshots (15), groups (15), ssh (15), recommendations (15), configuration (15), other (14), 80gb (14), specifically (14), based (14), creation (14), load (14), apply (14), connect (14), used (13), pro (13), general (13), device (13), handle (13), add (13), highgpu (13), start (13), management (13), bulk (13), microsoft (13), architecture (12), have (12), core (12), operations (12), large (12), workstations (12), scale (12), temporary (12), separate (12), demands (12), attach (12), sole (12), persistent (12), regional (12), regions (11), fp16 (11), mega (11), h200 (11), gb300 (11), choose (11), spot (11), options (11), delete (11), practices (11), stateful (11), v100 (10), cuda (10), also (10), 6000 (10), b200 (10), gb200 (10), multiple (10), nvlink (10), one (10), platforms (10), gib (10), physical (10), provisioning (10), request (10), managed (10), metadata (10), migs (10), machines (10), migrate (10), logs (10), license (9), fp64 (9), table (9), architectures (9), edge (9), purpose (9), hardware (9), full (9), ideal (9), supported (9), depends (9), resource (9), creating (9), address (9), nic (9), flex (9), deploy (9), capacity (9), clusters (9), networking (9), application (9), licenses (9), tenant (9), openshift (9), shutdown (9), time (9), all (8), int8 (8), precision (8), which (8), throughput (8), uses (8), run (8), 500 (8), 192 (8), hbm3e (8), configurations (8), implemented (8), hyper (8), thread (8), cannot (8), exceed (8), given (8), actual (8), destination (8), factors (8), note (8), applications (8), serving (8), service (8), import (8), login (8), optimize (8), internal (8), install (8), disaster (8), recovery (8), agent (8), existing (8), update (8), guest (8), boot (8), keys (8), h4d (8), flexibility (8), dns (8), tpu (8), pricing (7), thumb (7), details (7), review (7), indicates (7), metric (7), applicable (7), mixed (7), provide (7), learning (7), metrics (7), video (7), transcoding (7), visualization (7), usage (7), 100 (7), capabilities (7), mesh (7), tbps (7), distributed (7), workstation (7), zone (7), 375 (7), default (7), resize (7), group (7), sxm (7), commitments (7), startup (7), balancing (7), benchmark (7), enable (7), manually (7), idle (7), addresses (7), back (7), mysql (7), zonal (7), remove (7), maintenance (7), templates (7), snapshot (7), backup (7), events (6), send (6), fp32 (6), matrix (6), 624 (6), 312 (6), foundation (6), hbm2 (6), 600 (6), 384 (6), get (6), peer (6), communication (6), multi (6), reserve (6), grace (6), superchips (6), hypercomputer (6), security (6), migration (6), updates (6), instant (6), files (6), nested (6), across (6), mode (6), demand (6), pools (6), failover (6), extension (6), change (6), new (6), transfer (6), customized (6), code (5), samples (5), understand (5), accelerate (5), int4 (5), 40gb (5), hopper (5), ada (5), lovelace (5), ampere (5), tf32 (5), fp8 (5), each (5), different (5), remote (5), 208 (5), some (5), has (5), 640 (5), ultragpu (5), must (5), kubernetes (5), slurm (5), deployment (5), cpus (5), bound (5), automatically (5), monitoring (5), databases (5), accounts (5), errors (5), future (5), drivers (5), virtualization (5), placement (5), node (5), highly (5), build (5), modify (5), schedules (5), audit (5), symphony (5), email (5), scripts (5), manager (5), between (5), operating (5), systems (5), enhanced (5), stop (5), tenancy (5), restore (5), control (5), faq (5), português (4), español (4), started (4), down (4), volta (4), turing (4), range (4), dense (4), structural (4), sparsity (4), 156 (4), 979 (4), fp4 (4), such (4), llms (4), gddr6 (4), 320 (4), hbm3 (4), 800 (4), size (4), end (4), shared (4), 750 (4), require (4), cost (4), instructions (4), deploying (4), services (4), documentation (4), platform (4), arm (4), chip (4), metal (4), infrastructure (4), tools (4), authentication (4), issues (4), ubuntu (4), console (4), tcp (4), pmu (4), share (4), projects (4), upgrade (4), live (4), autoscaling (4), cross (4), region (4), requests (4), calendar (4), health (4), active (4), containers (4), container (4), database (4), postgresql (4), extensions (4), work (4), suspend (4), location (4), graceful (4), locations (4), plans (4), replication (4), terms (3), system (3), 2026 (3), content (3), apache (3), check (3), pascal (3), tops (3), don (3), deep (3), feature (3), advanced (3), balanced (3), 250 (3), vector (3), units (3), 900 (3), massive (3), tables (3), bert (3), dlrm (3), recommenders (3), 128 (3), only (3), limit (3), 360 (3), without (3), tuning (3), megagpu (3), 160 (3), two (3), 872 (3), detailed (3), gke (3), how (3), features (3), exascale (3), bare (3), generation (3), document (3), family (3), specific (3), guides (3), observability (3), analytics (3), automatic (3), troubleshooting (3), encryption (3), serial (3), patterns (3), discounts (3), cuds (3), manual (3), scalable (3), resilient (3), autoscale (3), balancer (3), prevent (3), project (3), policy (3), list (3), testing (3), ibm (3), spectrum (3), perform (3), plan (3), during (3), prepare (3), rhel (3), environment (3), protect (3), certificates (3), query (3), state (3), disable (3), properties (3), account (3), increase (3), schedule (3), lifecycle (3), design (3), non (3), pool (3), move (3), tpus (3), product (3), 한국어 (2), 日本語 (2), עברית (2), brasil (2), italiano (2), indonesia (2), français (2), américa (2), latina (2), deutsch (2), english (2), sign (2), site (2), youtube (2), center (2), products (2), need (2), last (2), updated (2), utc (2), except (2), page (2), licensed (2), under (2), feedback (2), next (2), introduced (2), primarily (2), because (2), acceleration (2), demanding (2), double (2), computational (2), values (2), section (2), assume (2), multiplication (2), doubled (2), bfloat16 (2), 121 (2), 989 (2), 494 (2), providing (2), specialized (2), provides (2), reduced (2), 117 (2), rendering (2), requirements (2), 935 (2), refers (2), achieve (2), threads (2), performing (2), same (2), compare (2), 300 (2), gddr5 (2), gddr7 (2), hbm2e (2), 180 (2), europe (2), west1 (2), east1 (2), 104 (2), runs (2), northamerica (2), vcpus (2), come (2), specify (2), computing (2), titanium (2), 400 (2), 440 (2), direct (2), within (2), exchange (2), over (2), bus (2), omniverse (2), simulation (2), desktops (2), 680 (2), 340 (2), 170 (2), offers (2), fine (2), gpudirect (2), enabled (2), methods (2), 224 (2), 141gb (2), then (2), sockets (2), neoverse (2), connected (2), four (2), fast (2), c2c (2), nvl72 (2), artificial (2), intelligence (2), integrations (2), smaller (2), pre (2), accelerators (2), adds (2), sdk (2), languages (2), frameworks (2), costs (2), industry (2), solutions (2), hybrid (2), multicloud (2), pipelines (2), hosting (2), development (2), quota (2), commitment (2), consumption (2), registration (2), sles (2), export (2), port (2), collecting (2), nodes (2), report (2), api (2), rdp (2), app (2), latency (2), analyze (2), visible (2), committed (2), underutilized (2), insights (2), utilization (2), globally (2), web (2), autohealing (2), iis (2), external (2), autoscaler (2), autoscalers (2), activity (2), provider (2), place (2), running (2), directory (2), setting (2), redis (2), cloning (2), writer (2), always (2), alwayson (2), name (2), file (2), volumes (2), authenticate (2), method (2), synchronization (2), global (2), switch (2), byol (2), payg (2), byos (2), changes (2), families (2), guide (2), securing (2), event (2), simulate (2), topology (2), together (2), repairs (2), repair (2), failures (2), template (2), suspended (2), stopped (2), target (2), distribution (2), cancel (2), once (2), interfaces (2), ipv6 (2), static (2), decrease (2), basic (2), consistent (2), scoped (2), copy (2), appliances (2), asynchronous (2), encrypt (2), names (2), format (2), mount (2), extreme (2), credentials (2), organization (2), user (2), through (2), rdma (2), created (2), preemptible (2), constraints (2), apis (2), reference (2), technology (2), areas (2), close (2), subscribe, newsletter, our, third, decade, climate, action, join, cookies, privacy, tech, twitter, blog, engage, certification, getting, github, status, release, notes, community, forums, contact, sales, marketplace, easy, easytounderstand, solved, problem, solvedmyproblem, otherup, hard, hardtounderstand, incorrect, sample, incorrectinformationorsamplecode, missing, missingtheinformationsamplesineed, otherdown, tell, otherwise, noted, java, registered, trademark, oracle, its, affiliates, developers, creative, commons, attribution, bandwidths, learn, what, equipped, 260, 130, 125, first, generations, quantization, doesn, include, they, offering, foundational, 242, engines, transformer, versatile, energy, efficient, prioritize, accelerated, included, benefit, even, supports, 1871, 467, 233, introduces, expanded, breakthrough, involve, math, operate, instruction, simt, typically, individual, elements, vectors, language, any, expressed, significantly, than, dedicated, often, called, multiply, accumulate, form, backbone, sections, separated, into, 732, ring, ecc, 1597, 141, 186, moe, 279, interconnect, describes, comparison, chart, reach, september, caution, aren, northeast1, central1, fewer, lets, unlike, instead, exception, 432, 216, 108, defines, amount, allocate, 768, 200, 720, key, p2p, allows, directly, pcie, involving, suitable, low, solution, compared, edition, 16g, asia, south1, northeast2, edgegpu, tcpx, 936, 468, 234, standalone, flex_start, recommend, scheduler, either, limited, well, suited, both, tasks, 1128, 952, parameters, highest, 968, 744, 884, 140, 116, 960, 144, maxgpu, b300, differ, their, components, hypervisor, layer, rack, supercomputing, option, recommended, densely, allocated, schedulers, approaching, 4ogb, select, small, micro, later, involves, while, various, including, find, matches, outlines, processing, save, categorize, preferences, stay, organized, collections, home, concurrent, operation, renewal, nvme, resizing, common, pay, viewing, output, diagnostic, sudoers, screenshots, generate, bug, soft, lockups, locks, rescue, inaccessible, dumps, kernel, panic, fstab, unresponsive, suspension, reboots, shutdowns, connectivity, tips, nics, dpdk, improve, resiliency, reduce, compact, idpf, interface, irdma, driver, customize, per, sustained, merge, split, extend, renew, purchase, savings, dynamic, overcommit, floating, reliable, udp, backends, routing, https, scaling, consuming, consume, combine, cud, allow, sharing, decisions, signals, predictions, organize, labels, replica, states, observe, reports, tensorflow, tensorrt5, monte, carlo, spark, forwarding, others, integrate, clustering, 2016, sharepoint, strategies, passive, inactive, setups, built, validation, were, deployed, transition, test, hammerdb, bucket, aws, ec2, pacemaker, s2d, block, netapp, hot, standby, drbd, client, private, mailjet, mailgun, sendgrid, sending, blue, green, deployments, lamp, joomla, asp, net, interactive, mongodb, flask, terraform, servers, mtls, random, generator, virtio, rng, accurate, protocol, ntp, append, els, after, restrictions, packages, deprecate, versions, trusted, red, hat, knowledgebase, functionality, risks, command, vpc, controls, confidential, kek, secure, expiration, shielded, attributes, predefined, notices, process, faulty, unmanaged, affect, preserved, turn, off, alternate, fails, repairing, maintain, click, upgrades, override, selectively, applying, out, outage, rebalance, reenable, proactive, redistribution, shape, distribute, define, info, accidental, deletion, spread, edit, rename, reset, resume, restart, referrers, source, uuid, recover, corrupted, duplicate, clones, alerts, backups, vss, regionally, protection, considerations, synchronous, consistency, failback, replicate, make, provisioned, iops, limits, evaluate, settings, help, kms, customer, supplied, symbolic, links, practice, ram, additional, exapools, verify, identity, ptr, record, failure, rates, tags, restrict, automate, password, powershell, sac, securely, apps, root, vpn, bastion, iap, connection, browser, connections, networks, iso, imported, prerequisites, importing, exporting, bring, own, path, detach, reattach, constraint, accounting, provision, examples, reserved, team, slice, slices, scenarios, deterministic, base, ready, aci, configured, preempted, historical, alternative, similar, displays, ops, logging, subnet, public, minimum, hostname, quickstarts, iam, roles, permissions, office, licensing, premium, strategy, gemini, scores, discover, free, skip, main,
Text of the page (random words):
t sql server on hyperdisk deploying microsoft sql server for multi regional disaster recovery back up sql server databases to a google cloud storage bucket back up sql server databases using instant snapshots cloning a microsoft sql server database on compute engine load test sql server using hammerdb redis deployment options for redis on google cloud containers containers on compute engine deploy containers on vms and managed instance groups configure options to run your container transition from the container startup agent prepare for the shutdown of the container startup agent prevent the creation of vms that use the container metadata migrate containers that were deployed on vms during vm creation openshift workloads openshift on google cloud overview plan for openshift on google cloud overview of cluster services for openshift automatic configuration validation for openshift clusters built in integrations for openshift best practices for high availability with openshift disaster recovery for openshift on google cloud disaster recovery strategies for active passive and active inactive setups with openshift microsoft windows windows workloads best practices for windows server vms setting up active directory best practices for running active directory on google cloud deploy microsoft sharepoint server on compute engine deploying microsoft exchange server 2016 on compute engine windows server perform an in place upgrade of windows server run windows server failover clustering ibm spectrum symphony integrate ibm spectrum symphony with google cloud install the compute engine symphony provider install the google kubernetes symphony provider troubleshoot ibm spectrum symphony others load testing distributed load testing using kubernetes ssh port forwarding and load testing analytics monte carlo methods using apache spark machine learning run tensorflow inference workloads with tensorrt5 and nvidia t4 gpu monitor monitor logs view audit logs view usage reports view compute engine operations migrate from activity logs to audit logs view activity logs monitor resources monitor vm and sole tenant node usage observe and monitor vms monitor gpu performance monitor gpu performance on linux vms monitor gpu performance on windows vms monitor disks monitor disk health monitor the replica states of regional disks monitor disks list of metrics for pools monitor pools monitor reservations organize resources using labels scale autoscale groups of vms about autoscaling groups of vms create and manage autoscalers scale based on cpu utilization scale based on predictions scale based on load balancing serving capacity scale based on monitoring metrics scale based on schedules use an autoscaling policy with multiple signals manage autoscalers understand autoscaler decisions view autoscaler logs autoscale node groups reserve vm capacity choose a reservation type sharing reservations best practices for shared reservations allow a project to share reservations on demand reservations about on demand reservations create an on demand reservation for a single project for multiple projects combine an on demand reservation with a cud modify an on demand reservation delete an on demand reservation future reservations about future reservations create a reservation request for a single project for multiple projects modify a reservation request delete a reservation request future reservations in calendar mode about future reservations in calendar mode create a reservation request in calendar mode delete a reservation request in calendar mode view reservations or reservation requests consume a reservation prevent vms from consuming reservations load balancing about load balancing and scaling add an instance group to a load balancer request routing to a multi region external https load balancer cross region load balancing for microsoft iis backends set up internal tcp udp load balancing build reliable and scalable applications use autohealing for highly available applications use load balancing for highly available applications use autoscaling for highly scalable applications globally autoscale a web service on compute engine patterns for scalable and resilient applications patterns for using floating ip addresses on compute engine optimize resource utilization use recommendations to manage resources apply machine type recommendations to vms configure machine type recommendations apply machine type recommendations to migs view and apply idle resources recommendations view and understand vm insights view and understand mig insights manage idle vm recommendations idle vm recommendations overview view and apply idle vm recommendations configure idle vm recommendations manage reservation recommendations reservation recommendations overview view and apply idle reservation recommendations view and apply underutilized reservation recommendations configure idle reservation recommendations configure underutilized reservation recommendations overcommit cpus on sole tenant vms manual live migration about manual live migration manually live migrate vms share sole tenant node groups next generation dynamic resource management cost savings get discounts for committed usage about commitments and committed use discounts cuds resource based cuds purchase resource based commitments without attached reservations with attached reservations for os licenses manage resource based commitments renew commitments automatically extend commitment terms merge and split commitments upgrade commitments share resource based cuds across projects get discounts for sustained usage disk performance optimize hyperdisk performance optimize persistent disk performance optimize local ssd performance workload performance set the number of threads per core customize the number of visible cpu cores analyze the cpu performance using the pmu pmu overview enable the pmu in vms manage the pmu in vms network performance network bandwidth use google virtual nic use irdma network driver use idpf network interface configure a vm with higher bandwidth reduce latency by using compact placement policies optimize tcp network communication optimize tcp network performance optimize tcp network resiliency benchmark higher bandwidth vms optimize app latency with load balancing use dpdk to improve network performance network performance and gpu vms networking and gpu machines use higher network bandwidth patterns for using multiple host nics troubleshoot general tips troubleshoot connectivity troubleshoot rdp troubleshoot ssh troubleshoot os login troubleshoot vms troubleshoot vm operations troubleshoot vm creation troubleshoot resource availability errors troubleshoot bulk api vm creation troubleshoot vm reboots and shutdowns troubleshoot vm suspension troubleshoot vm updates troubleshoot unresponsive vms troubleshoot vm startup troubleshoot fstab errors troubleshoot kernel panic collecting core dumps rescue an inaccessible vm troubleshoot cpu bus locks troubleshoot cpu soft lockups troubleshoot vm configurations troubleshoot arm vms troubleshoot gpu vms troubleshoot nvidia gpu errors generate a nvidia bug report for blackwell gpus troubleshoot nested virtualization troubleshoot using vm screenshots troubleshoot sole tenant nodes troubleshoot vm performance issues troubleshoot sudoers files troubleshoot windows vms troubleshoot windows vms collecting diagnostic information troubleshoot using the serial console troubleshoot using the serial console viewing serial port output troubleshoot instance groups troubleshoot managed instance groups migs troubleshoot os management troubleshoot licenses troubleshoot image import and export troubleshooting sles pay as you go registration troubleshooting ubuntu pro registration troubleshoot metadata server troubleshoot metadata server troubleshoot networking issues troubleshoot common networking issues troubleshoot network drivers troubleshoot vm performance issues troubleshoot storage troubleshoot disk creation troubleshoot full disks and disk resizing troubleshoot disk encryption troubleshoot nvme disks troubleshoot instant snapshots troubleshoot standard snapshots troubleshoot reservations and commitments troubleshoot reservation creation troubleshoot reservation consumption troubleshooting reservation monitoring troubleshoot reservation updates troubleshoot future reservation creation and updates troubleshoot automatic commitment renewal troubleshoot quota errors troubleshoot concurrent operation quota errors troubleshoot workload authentication troubleshoot default service accounts troubleshoot workload to workload authentication ai and ml application development application hosting compute data analytics and pipelines databases distributed hybrid and multicloud industry solutions migration networking observability and monitoring security storage access and resources management costs and usage management infrastructure as code sdk languages frameworks and tools home documentation compute compute engine guides send feedback gpu machine types stay organized with collections save and categorize content based on your preferences this document outlines the nvidia gpu models that you can use to accelerate machine learning ml data processing and graphics intensive workloads on your compute engine instances this document also details which gpus come pre attached to accelerator optimized machine series such as a4x max a4x a4 a3 a2 g4 and g2 and which gpus you can attach to n1 general purpose instances use this document to compare the performance memory and features of different gpu models for a more detailed overview of the accelerator optimized machine family including information on cpu platforms storage options and networking capabilities and to find the specific machine type that matches your workload see accelerator optimized machine family for more information about gpus on compute engine see about gpus to view available regions and zones for gpus on compute engine see gpus regions and zone availability overview compute engine offers different machine types to support your various workloads some machine types support nvidia rtx virtual workstations vws when you create an instance that uses nvidia rtx virtual workstation compute engine automatically adds a vws license for information about pricing for virtual workstations see the gpu pricing page gpu machine types ai and ml workloads graphics and visualization other gpu workloads accelerator optimized a series machine types are designed for high performance computing hpc artificial intelligence ai and machine learning ml workloads the later generation a series are ideal for pre training and fine tuning foundation models that involves large clusters of accelerators while the a2 series can be used for training smaller models and single host inference for these machine types the gpu model is automatically attached to the instance accelerator optimized g series machine types are designed for workloads such as nvidia omniverse simulation workloads graphics intensive applications video transcoding and virtual desktops these machine types support nvidia rtx virtual workstations vws the g series can also be used for training smaller models and for single host inference for these machine types the gpu model is automatically attached to the instance for n1 general purpose machine types except for the n1 shared core f1 micro and g1 small you can attach a select set of gpu models some of these gpu models also support nvidia rtx virtual workstations vws a4x max nvidia gb300 ultra superchips nvidia gb300 a4x nvidia gb200 superchips nvidia gb200 a4 nvidia b200 nvidia b200 a3 ultra nvidia h200 nvidia h200 141gb a3 mega nvidia h100 nvidia h100 mega 80gb a3 high nvidia h100 nvidia h100 80gb a3 edge nvidia h100 nvidia h100 80gb a2 ultra nvidia a100 80gb nvidia a100 80gb a2 standard nvidia a100 4ogb nvidia tesla a100 g4 nvidia rtx pro 6000 nvidia rtx pro 6000 nvidia rtx pro 6000 vws g2 nvidia l4 nvidia l4 nvidia l4 vws the following gpu models can be attached to n1 general purpose machine types nvidia t4 nvidia tesla t4 nvidia tesla t4 vws nvidia p4 nvidia tesla p4 nvidia tesla p4 vws nvidia v100 nvidia tesla v100 nvidia p100 nvidia tesla p100 nvidia tesla p100 vws nvidia p100 is approaching end of support see nvidia p100 end of support you can also use some gpu machine types on ai hypercomputer ai hypercomputer is a supercomputing system that is optimized to support your artificial intelligence ai and machine learning ml workloads this option is recommended for creating a densely allocated performance optimized infrastructure that has integrations for google kubernetes engine gke and slurm schedulers a4x max and a4x machine series the a4x max and a4x machine series runs on an exascale platform based on nvidia s rack scale architecture and is optimized for compute and memory intensive network bound ml training and hpc workloads a4x max and a4x differ primarily in their gpu and networking components a4x max is available only as bare metal instances which provide direct access to the host server s cpu and memory without the compute engine hypervisor layer a4x max machine types nvidia gb300 a4x max accelerator optimized machine types use nvidia gb300 grace blackwell ultra superchips nvidia gb300 and are ideal for foundation model training and serving a4x max machine types are available as bare metal instances a4x max is an exascale platform based on nvidia gb300 nvl72 each machine has two sockets with nvidia grace cpus with arm neoverse v2 cores these cpus are connected to four nvidia b300 blackwell gpus with fast chip to chip nvlink c2c communication note when provisioning a4x max instances you must reserve capacity to create instances and clusters you can then create instances that use the features and services available from ai hypercomputer for more information see deployment options overview in the ai hypercomputer documentation attached nvidia gb300 grace blackwell ultra superchips machine type vcpu count 1 instance memory gb attached local ssd gib physical nic count maximum network bandwidth gbps 2 gpu count gpu memory 3 gb hbm3e a4x maxgpu 4g metal 144 960 12 000 6 3 600 4 1 116 1 a vcpu is implemented as a single hardware hyper thread on one of the available cpu platforms 2 maximum egress bandwidth cannot exceed the number given actual egress bandwidth depends on the destination ip address and other factors for more information about network bandwidth see network bandwidth 3 gpu memory is the memory on a gpu device that can be used for temporary storage of data it is separate from the instance s memory and is specifically designed to handle the higher bandwidth demands of your graphics intensive workloads a4x machine type nvidia gb200 a4x accelerator optimized machine types use nvidia gb200 grace blackwell superchips nvidia gb200 and are ideal for foundation model training and serving a4x is an exascale platform based on nvidia gb20...
|
