To feed its massive computational throughput, the NVIDIA A100 GPU has 40 GB of high-speed HBM2 memory with a class-leading 1.6 TB/sec of memory bandwidth – a 73% increase compared to Tesla V100.

Tesla's In-House Supercomputer Taps NVIDIA A100 GPUs For 1.8 ExaFLOPs Of Performance by Paul Lilly — Tuesday, June 22, 2021, 02:30 PM EDT Comments ...

Normally we'd see NVIDIA dub it the Tesla A100 -- just like the Volta-based Tesla V100, but nope -- now we might know why.

Although Nvidia A100 and H100 GPU chips are the dominant chips in the AI field at this stage, Tesla's self-developed AI training and inference chips may reduce its dependence on traditional chip ...