At the GTC conference on March 18, Nvidia CEO Jensen Huang announced an exciting plan to increase DeepSeek's artificial intelligence processing speed by 30 times with the newly launched software Dynamo. The move is Nvidia's response to market turmoil caused by DeepSeek's R1 artificial intelligence program. DeepSeek's technology is able to significantly reduce the amount of computation required for each query, leading investors to express concerns about Nvidia's future prospects.
Nvidia's Dynamo software can allocate AI inference tasks to up to 1,000 GPUs in parallel processing, greatly improving query throughput. Huang Renxun said that using the new Blackwell chip, Dynamo is able to provide 30 times the processing power under the same architecture. This capability improvement allows AI data centers to process more tokens per second, thereby increasing overall revenue.
Specifically, Dynamo software can increase processing per second at a price of $1 per million tokens. This means that service providers can choose to process more customers' queries at the same time, or provide stronger services to a single user, thus charging higher fees. Nvidia calls this high-performance AI service the "AI factory."
To further enhance DeepSeek's performance, Nvidia has also released the tweaked DeepSeek R1 version on HuggingFace. This version uses fewer computed bit counts, namely "FP4", which greatly improves performance without significantly reducing model accuracy.
In addition to Dynamo, Nvidia has also launched the latest version of the Blackwell chip "Ultra", which improves memory capacity and overall performance. In addition, Nvidia has officially released the DGX Spark, a small personal computer for AI developers, and updated the configuration of the DGX Station desktop computer.
At this conference, Nvidia also presented several other new products and collaboration projects, including improved network switches and software models for medical robots, demonstrating Nvidia's continued innovation capabilities in the fields of AI and computing.
Key points:
Nvidia launches Dynamo software, which increases the processing speed of DeepSeek AI by 30 times.
Through Dynamo, service providers can handle customer queries more efficiently and increase revenue.
The new version of Blackwell chip "Ultra" and DGX Spark computers were also officially released at the conference.