Cloud GPU infrastructure lowers the cost barrier to entry by offering a pay-as-you-go model, eliminating the need for significant upfront capital expenditure on hardware. While on-prem may offer I/O cost savings or hardware control, the cloud’s accessibility and reduced initial investment make it a compelling choice for organizations seeking immediate GPU access without large sunk costs.

(Reference: NVIDIA AI Infrastructure and Operations Study Guide, Section on Cloud GPU Advantages)

Multi-node training is advantageous when a model’s size—its parameters, activations, and gradients—exceeds the memory capacity of a single GPU. By sharding the model across multiple nodes (using techniques like data parallelism or model parallelism), training becomes feasible and efficient. User count and inference scale are unrelated to training architecture needs, which focus on compute and memory distribution.

(Reference: NVIDIA AI Infrastructure and Operations Study Guide, Section on Multi-Node Training Benefits)

Training neural networks typically involves streaming large datasets from storage in a sequential read pattern. This ordered access maximizes throughput and minimizes seek overhead, as training pipelines ingest data in batches for processing across epochs. Writes (e.g., model checkpoints) are less frequent and typically sequential, while random writes are rare, making sequential reads the dominant pattern.(Note: The document incorrectly lists C as the answer; B aligns with NVIDIA’s documentation.)

(Reference: NVIDIA AI Infrastructure and Operations Study Guide, Section on Storage Access Patterns)

DGX OS, the operating system powering NVIDIA DGX systems, is built on Ubuntu Linux, specifically the Long-Term Support (LTS) version. It integrates Ubuntu’s robust base with NVIDIA-specific enhancements, including GPU drivers, tools, and optimizations tailored for AI and high-performance computing workloads. Neither Red Hat nor CentOS serves as the foundation for DGX OS, making Ubuntu the correct choice.

(Reference: NVIDIA DGX OS Documentation, System Requirements Section)

RoCE (RDMA over Converged Ethernet) enhances network performance by offloading data transport to the NIC via RDMA, bypassing CPU involvement. It’s particularly valuable when high CPU utilization limits bandwidth usage, as it reduces overhead and unlocks full link capacity. While RoCE can handle storage traffic, it’s less effective with high packet loss (requiring reliable networks), making CPU-bound scenarios its prime use case.

(Reference: NVIDIA Networking Documentation, Section on RoCE Benefits)

NVIDIA vGPU (Virtual GPU) software enables GPU virtualization by partitioning a physical GPU into multiple virtual instances, assignable to virtual machines or containers for accelerated workloads. Horizon is a VMware product, and “virtGPU” isn’t an NVIDIA offering, confirming vGPU as the correct solution.

(Reference: NVIDIA vGPU Documentation, Overview Section)

Remote Direct Memory Access (RDMA) reduces CPU utilization and latency through network adapters with hardware offloading. These adapters handle data transfers directly between memory locations, bypassing CPU-intensive operations like memory copies and protocol processing. Larger buffers and software like Magnum I/O may enhance performance, but hardware offloading is the core RDMA feature delivering these benefits.

(Reference: NVIDIA Networking Documentation, Section on RDMA Offloading)