Natural language processing

ByteDance reportedly trains new AI model on Huawei chips instead of Nvidia

ByteDance reportedly trains new AI model on Huawei chips instead of Nvidia



summary
Summary

  • Added Reuters report on Bytedance buying Huawei chips

Update September 30, 2024:

ByteDance is set to become a major customer of Huawei, according to Reuters sources. The Chinese parent company of TikTok is allegedly planning to train a new AI model using mainly Huawei chips. However, this new model is expected to be less powerful and complex than the existing Doubao model. A ByteDance spokesperson denied plans for a new model.

ByteDance has reportedly ordered over 100,000 Huawei Ascend 910B chips but received fewer than 30,000 by July. The limited availability and lower computing power compared to Nvidia chips available in China have delayed the model’s development.

ByteDance is also the largest buyer of Nvidia’s H20 AI chip adapted for China and Microsoft’s biggest customer in Asia for Nvidia chips through the cloud. Reuters reports that ByteDance spent $2 billion on Nvidia chips last year.

Ad

The Chinese government has issued a directive encouraging Chinese AI companies to prioritize the use of domestic chips.

Original article from September 29, 2024:

Huawei takes on Nvidia in China’s AI chip market with new Ascend 910C processor

Huawei is rolling out its new Ascend 910C processor to compete with Nvidia in China’s AI chip market.

The company has begun sending samples to major Chinese server makers for testing, according to sources who spoke to the South China Morning Post.

The Ascend 910C builds on Huawei’s previous 910B chip. Huawei plans to offer it to large Chinese internet companies that have been key Nvidia customers.

Recommendation

The move comes as US export restrictions limit Nvidia’s ability to sell its most advanced GPUs in China. Analysts believe the earlier Ascend 910B chip matches or slightly exceeds the AI performance of Nvidia’s A100 GPU.

Huawei claims its Ascend chips were used to train about half of China’s 70 most powerful large language models last year. Chinese tech giant Baidu reportedly ordered 1,600 Ascend 910B chips worth $62 million, preparing for potential future limits on Nvidia purchases.

China must become less dependent on US chips

Huawei appears to be developing a strategy to bolster China’s domestic AI industry and reduce reliance on US chips. The company is trying to sell the chips bundled with other components like networking and storage solutions, according to a source.

Additionally, Huawei has formed a group of Chinese chipmakers aiming to produce high-bandwidth memory chips for AI by 2026 as an alternative to Nvidia’s offerings.

However, Nvidia’s slimmed-down H20 chip specifically for China is also selling well after a slow start, according to an SCMP source, in part because Chinese AI companies are interested in Nvidia’s technical support and maintenance services. Nvidia is expected to ship more than one million H20 GPUs in China this year, generating sales of around $12 billion.

While it’s unclear whether Huawei can seriously challenge Nvidia’s market position, with its much more powerful Blackwell chips already in the starting blocks, the competition is likely to drive AI development in China and reduce the country’s reliance on US technology.

ByteDance reportedly trains new AI model on Huawei chips instead of Nvidia

Source link