ByteDance Begins Training a 10-Trillion-Parameter AI Model, Approaching Anthropic’s Scale

icon MarsBit
Share
AI summary iconSummary
ByteDance has begun pre-training a massive AI model with up to 10 trillion parameters, according to reports in AI and crypto news. If completed at the upper limit, the model would surpass Kimi K3 by more than three times and rival Anthropic’s rumored 8-trillion-parameter Mythos 5. The pre-training phase is expected to last 3 to 6 months, followed by additional training. CEO Zhang Yiming has championed in-house research, aiming to compete in the global AI race. Crypto news outlets have highlighted this move as a major development in the tech sector.

According to Beating Monitor, the Financial Times, citing three informed sources, reported that ByteDance has begun pre-training a large model with up to 10 trillion parameters. The project is still in its early stages, and the final scale has not been determined. If trained to the upper limit, it would exceed Kimi K3 by more than three times, becoming the largest model by parameter count known to be developed by a Chinese team. ByteDance is now directly pushing its model size into the vicinity of Anthropic’s flagship models. Although Anthropic has never disclosed the parameter count for Mythos 5, the Financial Times cited industry estimates suggesting Mythos 5 is around 8 trillion parameters and Fable 5 around 5 trillion. If ByteDance’s new model reaches 10 trillion parameters, it would at least enter the same parameter scale as America’s most advanced closed-source models. The model is currently in the pre-training phase (training the model’s foundational capabilities on massive datasets). The Financial Times noted that this phase typically takes three to six months, followed by additional post-training before a release is possible. More parameters do not necessarily equate to stronger performance; final capabilities depend on architecture, training data, and training methods. Zhang Yiming recently made it clear internally at Seed that he opposes distilling competitors’ models and has instructed his team to accept short-term lagging behind while pursuing world-leading status through independent R&D. This new model, with up to 10 trillion parameters, represents ByteDance’s most aggressive bet on scale to date.

Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.