Home Automobile NVIDIA H100 Tensor Core GPU Used on New Microsoft Azure Digital Machine Sequence Now Usually Out there

NVIDIA H100 Tensor Core GPU Used on New Microsoft Azure Digital Machine Sequence Now Usually Out there

0
NVIDIA H100 Tensor Core GPU Used on New Microsoft Azure Digital Machine Sequence Now Usually Out there

[ad_1]

Microsoft Azure customers can now flip to the most recent NVIDIA accelerated computing know-how to coach and deploy their generative AI functions.

Out there right this moment, the Microsoft Azure ND H100 v5 VMs utilizing NVIDIA H100 Tensor Core GPUs and NVIDIA Quantum-2 InfiniBand networking — permits scaling generative AI, excessive efficiency computing (HPC) and different functions with a click on from a browser.

Out there to prospects throughout the U.S., the brand new occasion arrives as builders and researchers are utilizing massive language fashions (LLMs) and accelerated computing to uncover new client and enterprise use instances.

The NVIDIA H100 GPU delivers supercomputing-class efficiency via architectural improvements, together with fourth-generation Tensor Cores, a brand new Transformer Engine for accelerating LLMs and the most recent NVLink know-how that lets GPUs discuss to one another at 900GB/sec.

The inclusion of NVIDIA Quantum-2 CX7 InfiniBand with 3,200 Gbps cross-node bandwidth ensures seamless efficiency throughout the GPUs at huge scale, matching the capabilities of top-performing supercomputers globally.

Scaling With v5 VMs

ND H100 v5 VMs are perfect for coaching and working inference for more and more advanced LLMs and laptop imaginative and prescient fashions. These neural networks drive probably the most demanding and compute-intensive generative AI functions, together with query answering, code era, audio, video and picture era, speech recognition and extra.

The ND H100 v5 VMs obtain as much as 2x speedup in LLMs just like the BLOOM 175B mannequin for inference versus earlier era cases, demonstrating their potential to additional optimize AI functions.

NVIDIA and Azure

NVIDIA H100 Tensor Core GPUs on Azure present enterprises the efficiency, versatility and scale to supercharge their AI coaching and inference workloads. The mix streamlines the event and deployment of manufacturing AI with the NVIDIA AI Enterprise software program suite built-in with Azure Machine Studying for MLOps, and delivers record-setting AI efficiency in industry-standard MLPerf benchmarks.

As well as, by connecting the NVIDIA Omniverse platform to Azure, NVIDIA and Microsoft are offering lots of of thousands and thousands of Microsoft enterprise customers with entry to highly effective industrial digitalization and AI supercomputing assets.

Be taught extra about new Azure v5 cases powered by NVIDIA H100 GPUs.

[ad_2]

LEAVE A REPLY

Please enter your comment!
Please enter your name here