Nvidia just lately unveiled the H200, a high-end GPU engineered to revolutionize synthetic intelligence (AI) mannequin coaching and deployment.
This development is a complicated improve from the H100, the powerhouse behind OpenAI’s GPT-4.
Nvidia Flexes New H200 AI Chip Stats
The H200 stands out with its 141GB of next-generation “HBM3” reminiscence. This can be a leap in know-how that facilitates environment friendly “inference”—the utilization of huge fashions post-training to generate textual content, photographs, or predictions. It’s poised to ship outputs almost twice as quick because the H100, showcasing a outstanding stride in AI processing capabilities.
Set to ship within the second quarter of 2024, the H200 will spar with AMD’s MI300X GPU. Each chips symbolize a brand new period of AI processing with their enhanced reminiscence options, important for accommodating intensive AI fashions.
This competitors additionally marks an important section within the evolution of AI {hardware}, with important implications for the tech trade’s future.
Moreover, the H200 is designed to combine seamlessly with present H100 setups. This ensures a easy transition for AI corporations already utilizing the earlier mannequin. This backward compatibility displays Nvidia’s strategic method to market adaptation and buyer retention. The brand new GPU can be accessible in numerous configurations, assembly numerous wants within the AI know-how ecosystem.
Learn extra: AI Shares: Greatest Synthetic Intelligence Corporations To Know in 2023
Battling In opposition to US Chip Restrictions
Nevertheless, this comes amid new US export restrictions on high-end chips, which might considerably impression Nvidia. A considerable portion of Nvidia’s knowledge middle income, roughly 20-25%, originates from China.
All in all, the most recent curbs purpose to restrict the development of China’s navy capabilities utilizing AI know-how. This has prompted Nvidia to redirect its superior programs to different markets and pause new AI chip orders from China.
Regardless of these challenges, Nvidia’s trajectory stays strong, with its inventory experiencing a meteoric rise of over 230% in 2023. The corporate initiatives a staggering $16 billion in income for its fiscal third quarter. This equates to a 170% improve from the earlier yr.
Nvidia inventory (NVDA) returned to the $486 worth degree on November 13, roughly $12 in need of its $502 all-time excessive. Total, this marks a virtually 250% improve from the beginning of 2023.
Nvidia NVDA Inventory Worth Chart 1W. Supply: TradingView