Qwen3.8-Max matches Opus 5 in vulnerability recall rate at half the cost.

iconChainthink
Share
AI summary iconSummary
Qwen3.8-Max matches Opus 5 in vulnerability news recall rate at half the cost. Aikido’s testing found that Qwen3.8-Max detected 26 out of 32 vulnerabilities across three rounds, achieving an 81.3% recall rate. Opus 5 matched this recall rate but cost $1,642. Qwen3.8-Max’s F1 score of 83.2% trailed behind Kimi K3 Max and GPT-5.6 Sol. Interest rate news had no impact on the results. DeepSeek V4 Flash remained the most cost-effective at $164.

ChainThink reports that on August 5, security firm Aikido tested seven models using its code audit agent, including Qwen3.8-Max, Claude Opus 5, Kimi K3 Max, DeepSeek V4 Flash, GPT-5.6 Sol, Luna, and Terra.

The test included 32 recently disclosed vulnerabilities, with each model run three times. Qwen3.8-Max identified a total of 26 vulnerabilities across all three rounds, achieving a recall rate of 81.3%, tying for first place with Claude Opus 5.

Qwen3.8-Max has an F1 score of 83.2%, slightly lower than Opus 5, Kimi K3 Max, and GPT-5.6 Sol.

Its single-round performance stability is weaker, with only 10 out of 26 vulnerabilities found in all three consecutive rounds, while both Opus 5 and Sol found 19.

In terms of cost, Qwen3.8-Max has a total cost of approximately $821, about half that of Opus 5 and Sol, but five times that of DeepSeek V4 Flash.

Source:Show original
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.