April 18, 2024

Valley Post

Read Latest News on Sports, Business, Entertainment, Blogs and Opinions from leading columnists.

You have no idea how many graphics cards are required to run ChatGPT

You have no idea how many graphics cards are required to run ChatGPT

Yes, as strange as it may seem at first glance, since the chat It’s not a video game, its operation depends in part on graphics cards and in fact… a lot of them!

In detail, recent years in IT have seen GPUs being used to speed up more and more processes, as they can perform very well in applications that can be parallelized, such as workloads. artificial intelligence. Somehow, h nvidia It is expected to benefit greatly from the trend, as Trendforce points out.

Specifically, the research firm did the calculations and estimated that the latest version of ChatGPT was needed At least 20,000 graphics cards And of course not simple models for the general consumer, but GPUs of 5 petaflops performance. In fact, there are many opportunities to dramatically increase this number of cards in the future, as OpenAI becomes more popular, exceeds 30,000.

More specifically, the trendforce pointing to:

In the case of the Generative Pre-Training Adapter (GPT) that forms the basis of ChatGPT, the number of training parameters used to develop this model has increased from about 120 million in 2018 to nearly 180 billion in 2020. According to an estimate by TrendForce, the number of GPUs that The GPT model needs to process training data in 2020 about 20,000. From now on, the number of GPUs needed to commercialize the GPT (or ChatGPT) model is expected to exceed 30,000.

Note that these estimates use NVIDIA’s A100 as the basis for the calculations. Therefore, with generative AI becoming a trend, the demand for GPUs is expected to increase exponentially and thus benefit the relevant supply chain participants. NVIDIA, for example, is likely to benefit the most from developing generative AI. DGX A100, a global platform for AI workloads, provides 5 petaflops, and has become almost the best choice for big data analysis and AI acceleration.

See also  Diablo 2: Resurrected Patch 2.4 works with balance changes and bug fixes

Follow Unboxholics.com at www.unboxholics.com
google news
To be the first to know the latest news about technology, video games, movies and series. Follow Unboxholics.com at www.unboxholics.com FacebookAnd TwitterAnd
InstagramAnd Spotify
And Tik Tok.