Nvidia H200 chip rental costs rise 160% since January

Summary

Nvidia's H200 chip rental rates have surged approximately 160% in 2024, according to a report from a16z. This increase reflects strong demand for high-memory GPUs, which are essential for large-language-model inference, rather than a change in Nvidia's pricing. The H200, along with other models such as the B200, H100, and RTX PRO 6000, has seen significant rental rate increases, indicating tight capacity in the market.

Analysis