Kimi K3 and Fable5 nearly tie in AI agent benchmark, combined accuracy reaches 93%

iconKuCoinFlash
Share
AI summary iconSummary
Kimi K3 and Fable5 nearly tied in an AI agent benchmark on MetaEra, achieving a combined accuracy of 93% in a Fireworks test. K3 outperformed in security, cryptography, and long-term terminal tasks, while Fable5 excelled in multilingual programming and web development. Fireworks employed "God's-eye routing" to select the optimal and most cost-effective response, with K3 handling 72% to 96% of tasks. K3 also cost up to 50 times less in long-terminal operations. The results are simulated and not yet live. K3 will be open-sourced on Fireworks on July 27. Amid increasing scrutiny under MiCA (EU Markets in Crypto-Assets Regulation), such AI tools could influence liquidity and crypto markets.
ME AI message, according to monitoring by Beating, the AI reasoning platform Fireworks tested Kimi K3 and Fable 5 using the same agent scaffolding across five categories of tasks: code repair, long-range terminal operations, algorithms, multilingual programming, and legal tasks. The two models performed similarly overall but excelled in different areas: K3 is stronger in security, cryptography, and long-duration terminal operations, while Fable 5 excels in multilingual programming, web, and data visualization. Fireworks then conducted a "god-view routing" test: running both models simultaneously on each task and later selecting the correct and more cost-effective answer. The combined accuracy reached 93%, surpassing any single model. K3 handled 72% to 96% of the tasks, while Fable 5 only managed a few long-tail challenges. K3 was also cheaper across all five task categories—up to 50 times less expensive for long terminal tasks. However, the 93% figure is a simulated result under god-view conditions and does not reflect Fireworks’ actual routing performance to date. K3 will be open-sourced and launched on Fireworks on July 27. (Source: BlockBeats)
Source:Show original
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.