Why I Buy and Accumulate NVIDIA Every Month

If you subscribe using the subscribe button, you can receive rich news updates every day.

Leaving comments and emojis is a huge encouragement. Sharing it would be even better!

• ByteDance, the operator of TikTok, purchased about 100,000 units of A100 and H800 (a nerfed version of the H100) at about $10,000 per unit
  • A100, H100, etc., are product names of high-performance computing GPUs made by NVIDIA
  • Technically, they shouldn't have been able to buy them after restrictions on Chinese companies took effect last September... but apparently, they just received what was ordered in August
• So, what about NVIDIA's latest GPU, the H100?
  • Its performance is better than any existing AI computing unit
  • One H100 GPU is plugged into one rack → one rack consumes 3,300W of electricity
  • The price is also outrageous: tens of thousands of dollars per unit (market price...)
  • Nevertheless, there are so many orders for H100s that supply simply cannot meet demand
• The only thing that could be considered an alternative right now is the TPU, but in reality, there are no substitutes
• Even if an alternative emerges, will it deliver performance on par with NVIDIA? Almost impossible
• As AI becomes more widespread, computations grow more complex, and model sizes scale up, the GPU shortage will continue to occur

NVIDIANVIDIA H100 Tensor Core GPUNVIDIA H100 Tensor Core GPUs securely accelerate workloads across enterprises, from exascale HPC to trillion-parameter AI models.www.nvidia.com ↗

Tom's HardwareChina's ByteDance Has Gobbled Up $1 Billion of Nvidia GPUs for AI This YearChinese companies are frantically pre-ordering GPUs before government sanctions fully kick inwww.tomshardware.com ↗