Advertisement
China Telecom develops country’s first MoE models trained entirely on Huawei’s AI chips
The state-owned telecoms network operator trains its TeleChat3 models on Huawei’s Ascend 910B chips
2-MIN READ2-MIN
15
Listen

State-owned China Telecom has developed the country’s first artificial intelligence models with the innovative Mixture-of-Experts (MoE) architecture that are trained entirely on advanced chips from Huawei Technologies.
This marked the first time a Chinese developer publicly validated the feasibility of using only Huawei chips to train AI models with MoE architecture, which has become widely adopted because of its ability to deliver high performance with fewer computational resources.
The TeleChat3 models – ranging from 105 billion to trillions of parameters – were trained on Huawei’s Ascend 910B chips and its open-source deep learning AI framework MindSpore, according to a technical paper published last month by China Telecom’s Institute of Artificial Intelligence (TeleAI).
The Huawei stack was able to meet the “severe demands” of training large-scale MoE models across many different sizes, TeleAI researchers said.
Select Voice
Select Speed
1x
AI-generated voice