AWS & NVIDIA Blackwell: Powering the Next AI Frontier

Amazon Web Services (AWS) and NVIDIA have collaborated to launch two powerful compute solutions designed to accelerate the development and deployment of advanced AI models: P6e-GB200 UltraServers and P6-B200 instances. Both leverage NVIDIA Blackwell GPUs, but cater to different needs. P6e-GB200 UltraServers are the flagship offering, boasting up to 72 interconnected Blackwell GPUs, delivering a staggering 360 petaflops of FP8 compute and 13.4 TB of HBM3e memory. This massive scale makes them ideal for training and deploying trillion-parameter models, enabling faster inference with features like disaggregated serving via NVIDIA Dynamo. The unified memory space and coordinated workload distribution minimize communication overhead, leading to more efficient distributed training. In contrast, P6-B200 instances offer a more versatile, 8-GPU configuration, suitable for medium to large-scale AI workloads. They are a good choice for those looking to port existing GPU workloads with minimal code changes or those needing x86 processor compatibility. Both instance types utilize the sixth-generation AWS Nitro System for enhanced security and stability, featuring live updates to minimize downtime. AWS integrates these instances seamlessly with various services like Amazon SageMaker HyperPod for managed infrastructure and Amazon EKS for Kubernetes-based deployments. The choice between the two depends on the specific workload requirements. P6e-GB200 excels in extreme scale and memory-intensive tasks, while P6-B200 offers a balance of performance and accessibility. While both offer significant performance improvements over previous generations, the high cost associated with these powerful systems might be a limiting factor for some users. The liquid cooling in P6e-GB200 UltraServers, while enabling higher compute density, adds to the complexity and cost compared to the air-cooled P6-B200 instances.

(Source: https://aws.amazon.com/blogs/machine-learning/aws-ai-infrastructure-with-nvidia-blackwell-two-powerful-compute-solutions-for-the-next-frontier-of-ai/)