.. _here: """""""""""""""""""""""""""""""""" vGPU Types (only time-slicing) """""""""""""""""""""""""""""""""" Here you can find a list of vGPU types of the newer NVIDIA Architecture. For more details, please refer to the official `NVIDIA Documentation `_. ============= NVIDIA A100 ============= A100 PCIe 40GB ---------------- required license edition: vCS od vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | Maximum Display Resolution | Virtual Displays per vGPU | +===================+======================+====================+========================+==========================+=============================+============================+ | A100-40C | Training Workloads | 40960 | 1 | 1 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100-20C | Training Workloads | 20480 | 2 | 2 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100-10C | Training Workloads | 10240 | 4 | 4 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100-8C | Training Workloads | 8192 | 5 | 5 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100-5C | Inference Workloads | 5120 | 8 | 8 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100-4C | Inference Workloads | 4096 | 10 | 10 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ A100 HGX 40GB -------------- required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | Maximum Display Resolution | Virtual Displays per vGPU | +===================+======================+====================+========================+==========================+=============================+============================+ | A100X-40C | Training Workloads | 40960 | 1 | 1 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100X-20C | Training Workloads | 20480 | 2 | 2 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100X-10C | Training Workloads | 10240 | 4 | 4 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100X-8C | Training Workloads | 8192 | 5 | 5 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100X-5C | Inference Workloads | 5120 | 8 | 8 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100X-4C | Inference Workloads | 4096 | 10 | 10 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ A100 PCIe 80GB --------------- required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | Maximum Display Resolution | Virtual Displays per vGPU | +===================+======================+====================+========================+==========================+=============================+============================+ | A100D-80C | Training Workloads | 81920 | 1 | 1 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100D-40C | Training Workloads | 40960 | 2 | 2 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100D-20C | Training Workloads | 20480 | 4 | 4 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100D-16C | Inference Workloads | 16384 | 5 | 5 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100D-10C | Training Workloads | 10240 | 8 | 8 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100D-8C | Training Workloads | 8192 | 10 | 10 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100D-4C | Inference Workloads | 4096 | 20 | 20 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ A100 HGX 80GB -------------- required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | Maximum Display Resolution | Virtual Displays per vGPU | +===================+======================+====================+========================+==========================+=============================+============================+ | A100DX-80C | Training Workloads | 81920 | 1 | 1 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100DX-40C | Training Workloads | 40960 | 2 | 2 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100DX-20C | Training Workloads | 20480 | 4 | 4 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100DX-16C | Inference Workloads | 16384 | 5 | 5 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100DX-10C | Training Workloads | 10240 | 8 | 8 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100DX-8C | Training Workloads | 8192 | 10 | 10 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ | A100DX-4C | Inference Workloads | 4096 | 20 | 20 | 4096×2160 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+-----------------------------+----------------------------+ ============ NVIDIA A40 ============ A40 Q-Series ------------ required license edition: vWS +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+=======================+====================+========================+==========================+ | A40-48Q | Virtual Workstations | 49152 | 1 | 1 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-24Q | Virtual Workstations | 24576 | 2 | 2 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-16Q | Virtual Workstations | 16384 | 3 | 3 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-12Q | Virtual Workstations | 12288 | 4 | 4 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-8Q | Virtual Workstations | 8192 | 6 | 6 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-6Q | Virtual Workstations | 6144 | 8 | 8 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-4Q | Virtual Workstations | 4096 | 12 | 12 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-3Q | Virtual Workstations | 3072 | 16 | 16 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-2Q | Virtual Workstations | 2048 | 24 | 24 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ | A40-1Q | Virtual Workstations | 1024 | 32 | 32 | +-------------------+-----------------------+--------------------+------------------------+--------------------------+ A40 B-Series ------------ required license edition: vPC or vWS +-------------------+--------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+====================+====================+========================+==========================+ | A40-2B | Virtual Desktops | 2048 | 24 | 24 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ | A40-1B | Virtual Desktops | 1024 | 32 | 32 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ A40 C-Series ------------ required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+======================+====================+========================+==========================+ | A40-48C | Training Workloads | 49152 | 1 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A40-24C | Training Workloads | 24576 | 2 | 2 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A40-16C | Training Workloads | 16384 | 3 | 3 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A40-12C | Training Workloads | 12288 | 4 | 4 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A40-8C | Training Workloads | 8192 | 6 | 6 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A40-6C | Training Workloads | 6144 | 8 | 8 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A40-4C | Inference Workloads | 4096 | 8 | 8 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ A40 A-Series ------------ required license edition: vApps +-------------------+------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+========================+====================+========================+==========================+ | A40-48A | Virtual Applications | 49152 | 1 | 1 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-24A | Virtual Applications | 24576 | 2 | 2 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-16A | Virtual Applications | 16384 | 3 | 3 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-12A | Virtual Applications | 12288 | 4 | 4 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-8A | Virtual Applications | 8192 | 6 | 6 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-6A | Virtual Applications | 6144 | 8 | 8 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-4A | Virtual Applications | 4096 | 12 | 12 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-3A | Virtual Applications | 3072 | 16 | 16 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-2A | Virtual Applications | 2048 | 24 | 24 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A40-1A | Virtual Applications | 1024 | 32 | 32 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ ============ NVIDIA A30 ============ A30 C-Series ------------ required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+======================+====================+========================+==========================+ | A30-24C | Training Workloads | 24576 | 1 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A30-12C | Training Workloads | 12288 | 2 | 2 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A30-8C | Training Workloads | 8192 | 3 | 3 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A30-6C | Inference Workloads | 6144 | 4 | 4 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A30-4C | Inference Workloads | 4096 | 6 | 6 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ ============ NVIDIA A16 ============ A16 Q-Series ------------ required license edition: vWS +-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+==========================================+====================+========================+==========================+ | A16-16Q | Virtual Workstations | 16384 | 1 | 4 | +-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | A16-8Q | Virtual Workstations | 8192 | 2 | 8 | +-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | A16-4Q | Virtual Workstations | 4096 | 4 | 16 | +-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | A16-2Q | Virtual Workstations | 2048 | 8 | 32 | +-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | A16-1Q | Virtual Desktops, Virtual Workstations | 1024 | 16 | 64 | +-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ A16 B-Series ------------ required license edition: vPC or vWS +-------------------+--------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+====================+====================+========================+==========================+ | A16-2B | Virtual Desktops | 2048 | 8 | 32 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ | A16-1B | Virtual Desktops | 1024 | 16 | 64 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ A16 C-Series ------------ required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+======================+====================+========================+==========================+ | A16-16C | Training Workloads | 16384 | 1 | 4 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A16-8C | Training Workloads | 8192 | 2 | 8 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A16-4C | Inference Workloads | 4096 | 4 | 16 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ A16 A-Series ------------ required license edition: vApps +-------------------+------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+========================+====================+========================+==========================+ | A16-16A | Virtual Applications | 16384 | 1 | 4 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A16-8A | Virtual Applications | 8192 | 2 | 8 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A16-4A | Virtual Applications | 4096 | 4 | 16 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A16-2A | Virtual Applications | 2048 | 8 | 32 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A16-1A | Virtual Applications | 1024 | 16 | 64 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ ============ NVIDIA A10 ============ A10 Q-Series ------------ required license edition: vWS +-------------------+------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+========================+====================+========================+==========================+ | A10-24Q | Virtual Workstations | 24576 | 1 | | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-12Q | Virtual Workstations | 12288 | 2 | 2 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-8Q | Virtual Workstations | 8192 | 3 | 3 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-6Q | Virtual Workstations | 6144 | 4 | 4 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-4Q | Virtual Workstations | 4096 | 6 | 6 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-3Q | Virtual Workstations | 3072 | 8 | 8 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-2Q | Virtual Workstations | 2048 | 12 | 12 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-1Q | Virtual Workstations | 1024 | 24 | 24 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ A10 B-Series ------------ required license edition: vPC or vWS +-------------------+--------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+====================+====================+========================+==========================+ | A10-2B | Virtual Desktops | 2048 | 12 | 12 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ | A10-1B | Virtual Desktops | 1024 | 24 | 24 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ A10 C-Series ------------ required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+======================+====================+========================+==========================+ | A10-24C | Training Workloads | 24576 | 1 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A10-12C | Training Workloads | 12288 | 2 | 2 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A10-8C | Training Workloads | 8192 | 3 | 3 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A10-6C | Training Workloads | 6144 | 4 | 4 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | A10-4C | Inference Workloads | 4096 | 6 | 6 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ A10 A-Series ------------ required license edition: vApps +-------------------+------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+========================+====================+========================+==========================+ | A10-24A | Virtual Applications | 24576 | 1 | 1 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-12A | Virtual Applications | 12288 | 2 | 2 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-8A | Virtual Applications | 8192 | 3 | 3 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-6A | Virtual Applications | 6144 | 4 | 4 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-4A | Virtual Applications | 4096 | 6 | 6 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-3A | Virtual Applications | 3072 | 8 | 8 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-2A | Virtual Applications | 2048 | 12 | 12 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | A10-1A | Virtual Applications | 1024 | 24 | 24 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ ================= NVIDIA RTX A6000 ================= RTX A6000 Q-Series ------------------ required license edition: vWS +-------------------+------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+========================+====================+========================+==========================+ | RTXA6000-48Q | Virtual Workstations | 49152 | 1 | 1 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-24Q | Virtual Workstations | 24576 | 2 | 2 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-16Q | Virtual Workstations | 16384 | 3 | 3 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-12Q | Virtual Workstations | 12288 | 4 | 4 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-8Q | Virtual Workstations | 8192 | 6 | 6 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-6Q | Virtual Workstations | 6144 | 8 | 8 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-4Q | Virtual Workstations | 4096 | 12 | 12 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-3Q | Virtual Workstations | 3072 | 16 | 16 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-2Q | Virtual Workstations | 2048 | 24 | 24 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-1Q | Virtual Workstations | 1024 | 328 | 32 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ RTX A6000 B-Series ------------------- required license edition: vPC or vWS +-------------------+--------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+====================+====================+========================+==========================+ | RTXA6000-2B | Virtual Desktops | 2048 | 24 | 24 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ | RTXA6000-1B | Virtual Desktops | 1024 | 32 | 32 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ RTX A6000 C-Series ------------------ required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+======================+====================+========================+==========================+ | RTXA6000-48C | Training Workloads | 49152 | 1 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA6000-24C | Training Workloads | 24576 | 2 | 2 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA6000-16C | Training Workloads | 16384 | 3 | 3 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA6000-12C | Training Workloads | 12288 | 4 | 4 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA6000-8C | Training Workloads | 8192 | 6 | 6 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA6000-6C | Training Workloads | 6144 | 8 | 8 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA6000-4C | Inference Workloads | 4096 | 83 | 12 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ RTX A6000 A-Series ------------------ required license edition: vApps +-------------------+------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+========================+====================+========================+==========================+ | RTXA6000-48A | Virtual Applications | 49152 | 1 | 1 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-24A | Virtual Applications | 24576 | 2 | 2 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-16A | Virtual Applications | 16384 | 3 | 3 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-12A | Virtual Applications | 12288 | 4 | 4 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-8A | Virtual Applications | 8192 | 6 | 6 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-6A | Virtual Applications | 6144 | 8 | 8 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-4A | Virtual Applications | 4096 | 12 | 12 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-3A | Virtual Applications | 3072 | 16 | 16 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-2A | Virtual Applications | 2048 | 24 | 24 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA6000-1A | Virtual Applications | 1024 | 328 | 32 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ ================= NVIDIA RTX A5000 ================= RTX A5000 Q-Series ------------------ required license edition: vWS +-------------------+------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+========================+====================+========================+==========================+ | RTXA5000-24Q | Virtual Workstations | 24576 | 1 | 1 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-12Q | Virtual Workstations | 12288 | 2 | 2 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-8Q | Virtual Workstations | 8192 | 3 | 3 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-6Q | Virtual Workstations | 6144 | 4 | 4 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-4Q | Virtual Workstations | 4096 | 6 | 6 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-3Q | Virtual Workstations | 3072 | 8 | 8 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-2Q | Virtual Workstations | 2048 | 12 | 12 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-1Q | Virtual Workstations | 1024 | 24 | 24 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ RTX A5000 B-Series ------------------ required license edition: vPC or vWS +-------------------+--------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+====================+====================+========================+==========================+ | RTXA5000-2B | Virtual Desktops | 2048 | 12 | 12 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ | RTXA5000-1B | Virtual Desktops | 1024 | 24 | 24 | +-------------------+--------------------+--------------------+------------------------+--------------------------+ RTX A5000 C-Series ------------------- required license edition: vCS or vWS +-------------------+----------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+======================+====================+========================+==========================+ | RTXA5000-24C | Training Workloads | 24576 | 1 | 1 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA5000-12C | Training Workloads | 12288 | 2 | 2 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA5000-8C | Training Workloads | 8192 | 3 | 3 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA5000-6C | Training Workloads | 6144 | 4 | 4 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ | RTXA5000-4C | Inference Workloads | 4096 | 6 | 6 | +-------------------+----------------------+--------------------+------------------------+--------------------------+ RTX A5000 A-Series ------------------ required license edition: vApps +-------------------+------------------------+--------------------+------------------------+--------------------------+ | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+========================+====================+========================+==========================+ | RTXA5000-24A | Virtual Applications | 24576 | 1 | 1 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-12A | Virtual Applications | 12288 | 2 | 2 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-8A | Virtual Applications | 8192 | 3 | 3 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-6A | Virtual Applications | 6144 | 4 | 4 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-4A | Virtual Applications | 4096 | 6 | 6 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-3A | Virtual Applications | 3072 | 8 | 8 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-2A | Virtual Applications | 2048 | 12 | 12 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ | RTXA5000-1A | Virtual Applications | 1024 | 24 | 24 | +-------------------+------------------------+--------------------+------------------------+--------------------------+ ================ NVIDIA Tesla T4 ================ T4 Q-Series ------------ required license edition: vWS +-------------------+-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | enable_vgpu_type | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+===================+==========================================+====================+========================+==========================+ | nvidia-234 | T4-16Q | Virtual Workstations | 16384 | 1 | 1 | +-------------------+-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | nvidia-233 | T4-8Q | Virtual Workstations | 8192 | 2 | 2 | +-------------------+-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | nvidia-232 | T4-4Q | Virtual Workstations | 4096 | 4 | 4 | +-------------------+-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | nvidia-231 | T4-2Q | Virtual Workstations | 2048 | 8 | 8 | +-------------------+-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ | nvidia-230 | T4-1Q | Virtual Desktops, Virtual Workstations | 1024 | 16 | 16 | +-------------------+-------------------+------------------------------------------+--------------------+------------------------+--------------------------+ T4 B-Series ------------ required license edition: vPC or vWS +-------------------+-------------------+--------------------+--------------------+------------------------+--------------------------+ | enable_vgpu_type | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+===================+====================+====================+========================+==========================+ | nvidia-223 | T4-2B | Virtual Desktops | 2048 | 8 | 8 | +-------------------+-------------------+--------------------+--------------------+------------------------+--------------------------+ | nvidia-224 | T4-2B4 | Virtual Desktops | 2048 | 8 | 8 | +-------------------+-------------------+--------------------+--------------------+------------------------+--------------------------+ | nvidia-222 | T4-1B | Virtual Desktops | 1024 | 16 | 16 | +-------------------+-------------------+--------------------+--------------------+------------------------+--------------------------+ | nvidia-252 | T4-1B4 | Virtual Desktops | 1024 | 16 | 16 | +-------------------+-------------------+--------------------+--------------------+------------------------+--------------------------+ T4 C-Series ------------ required license edition: vCS or vWS +-------------------+-------------------+----------------------+--------------------+------------------------+--------------------------+ | enable_vgpu_types | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+===================+======================+====================+========================+==========================+ | nvidia-321 | T4-16C | Training Workloads | 16384 | 1 | 1 | +-------------------+-------------------+----------------------+--------------------+------------------------+--------------------------+ | nvidia-320 | T4-8C | Training Workloads | 8192 | 2 | 2 | +-------------------+-------------------+----------------------+--------------------+------------------------+--------------------------+ | nvidia-319 | T4-4C | Inference Workloads | 4096 | 4 | 4 | +-------------------+-------------------+----------------------+--------------------+------------------------+--------------------------+ T4 A-Series ------------ required license edition: vApps +-------------------+-------------------+------------------------+--------------------+------------------------+--------------------------+ | enable_vgpu_types | Virtual GPU Type | Intended Use Case | Frame Buffer (MB) | Maximum vGPUs per GPU | Maximum vGPUs per Board | +===================+===================+========================+====================+========================+==========================+ | nvidia-229 | T4-16A | Virtual Applications | 16384 | 1 | 1 | +-------------------+-------------------+------------------------+--------------------+------------------------+--------------------------+ | nvidia-228 | T4-8A | Virtual Applications | 8192 | 2 | 2 | +-------------------+-------------------+------------------------+--------------------+------------------------+--------------------------+ | nvidia-227 | T4-4A | Virtual Applications | 4096 | 4 | 4 | +-------------------+-------------------+------------------------+--------------------+------------------------+--------------------------+ | nvidia-226 | T4-2A | Virtual Applications | 2048 | 8 | 8 | +-------------------+-------------------+------------------------+--------------------+------------------------+--------------------------+ | nvidia-225 | T4-1A | Virtual Applications | 1024 | 16 | 16 | +-------------------+-------------------+------------------------+--------------------+------------------------+--------------------------+