Kimi K3 performance test shows Claude Code costs 9 times more than Kimi Code

iconChainthink
Share
AI summary iconSummary
New token listings brought fresh performance data as Composio tested Kimi K3 with Kimi Code, Hermes, and Claude Code on 28 identical tasks. Completion rates were similar—22, 21, and 20—but token usage and costs differed significantly. Kimi Code used 61,000 tokens per task at $0.22, while Claude Code used 340,000 tokens at $2. Another study showed that replacing the runtime framework reduced token usage by 38% and costs by 41%. Token launch news underscores efficiency improvements in AI agent infrastructure.

ChainThink reports that on July 30, AI agent infrastructure company Composio connected the same Kimi K3 model to Kimi Code, Hermes, and Claude Code to execute 28 identical tasks.

The number of completed operational frameworks are 22, 21, and 20, respectively, with minimal differences, but significant variations in token usage and costs.

Test results show that the median token counts for single tasks for Kimi Code, Hermes, and Claude Code are 61,000, 67,000, and 340,000, respectively;

Composio estimates that the average cost per task is approximately $0.22, $0.28, and $2. Individual tasks can vary by up to 30 times in token usage.

In terms of speed, the median time for a single task was 179 seconds for Hermes, 297 seconds for Kimi Code, and 348 seconds for Claude Code.

Another study by Writer also showed that, after replacing only the execution framework across 22 enterprise tasks and six models, token usage decreased by 38%, per-task cost dropped by 41%, processing time was reduced by 44%, and completion quality remained largely unchanged.

Source:Show original
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.