Moonshot AI's Kimi K3.1 Pro opens with 2.8 trillion parameters, topping open model rankings.

iconMetaEra
Share
AI summary iconSummary
Moonshot AI's Kimi K3.1 Pro now leads the open model rankings on Agent Arena, featuring 2.8 trillion parameters and a 1 million token context window. The model’s 5.1% performance improvement in work, programming, and chat tasks is backed by on-chain data indicating strong open interest. Despite a 5.6TB weight file, it achieved a score of 65.7% on Terminal-Bench4.0, narrowing the gap with leading closed-source models.
Today, Moonshot AI open-sourced the Kimi K3.1Pro model weights, ranking first among open models on the Agent Arena leaderboard with a net improvement score of +5.1%, leading in productivity, programming, and chat tasks. The model employs a 2.8 trillion parameter mixture-of-experts architecture, supports a 1 million token context window, and has been optimized across multiple domains through reinforcement learning. Although the original weights are 5.6 TB in size, making local deployment challenging, it achieved a score of 65.7% on terminal agent benchmarks, approaching the performance of top-tier closed-source models.

Article author, source: AIBase

On November 5, in accordance with a commitment made on October 24, Moonshot AI officially released the model weights of Kimi K3.1Pro on the Hugging Face platform. With this official open-sourcing of the weights, the model has performed exceptionally well on the Agent Arena leaderboard operated by Arena, ranking first among all open-weight models, 13th overall among all evaluated models, and securing the top position in all three core categories: productivity, programming, and chat.

Rigorous evaluation based on real long-term conversations

Unlike traditional pairwise blind tests, Agent Arena features a unique evaluation method. Instead of relying on users to vote between two responses, it deeply analyzes real user-agent conversations to automatically extract multiple key signals, including explicit user confirmations, praise and complaints, correction instructions, and Shell command execution errors. Based on this, the leaderboard scientifically estimates the net improvement rate of each model relative to the average using a randomized inference method called "causal tracing."

This impressive ranking for Kimi K3.1Pro is built on over 17,500 real-world, long-term agent task conversations from users worldwide. Its overall net improvement rate reaches +5.1%, a significant 4.2 percentage point increase compared to the +0.9% of its predecessor, K3 (Max).

From the specific sub-indicators, all core capabilities have undergone comprehensive evolution:

Bash Reliability: A dramatic increase from -4.5% (ranked 13th) in the previous generation to +7.9%, now ranking first among all open models.

Praise vs Complaint (User Satisfaction Metric): Steadily improved from +1.3% to +7.7%.

Steerability (direction adjustment and correction capability): Increased by +6.5%, ranking highest among open models.

Confirmed Success (Task Completion Confidence): Increased by +3.9%, ranking fourth among open models.

Architectural innovation and optimal parameter design

In terms of technical architecture, Kimi K3.1Pro employs a Mixture of Experts (MoE) architecture, with a total of 2.8 trillion parameters, activating approximately 104 billion parameters during a single inference, and supporting an ultra-long context window of about 1 million tokens.

Compared to its predecessor, the K3, the K3.1Pro has undergone extensive training via collaborative reinforcement learning, covering hundreds of downstream application domains. Additionally, it innovatively replaces some full attention layers with gated sparse attention layers, effectively reducing computational overhead for long-context modeling while maintaining strong performance.

EndSide Deployment Reality and Terminal Agent Benchmark

Although the model weights have been successfully released to the open-source community, there remains a practical hardware barrier between “downloadable” and “locally runnable.” The weight files, stored at BF16 precision, amount to approximately 5.6 TB for 2.8 trillion parameters; even with INT4 quantization, around 1.4 TB of GPU memory is still required, making local deployment on consumer-grade single GPUs essentially infeasible.

On the authoritative Terminal-Bench4.0 benchmark, K3.1Pro achieved a score of 65.7%. This result not only surpasses GPT-6Astra’s 58.2%, but is also within less than 1 percentage point of Claude Opus 5.5’s 66.4%. With the full open-sourcing of these weights, Moonshot is injecting fresh energy into the global open-source large model ecosystem through continuous technical sharing.

Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.