Posts
avatar

32% hallucination rate on a research tool people use to make trades. That was Research v1.5. @SurfAI just shipped Research 2.0 on May 19 and brought it down to 8%. The number that actually matters more is report logic consistency: 55% to 94%. In v1.5, more than 4 in 10 outputs contradicted themselves somewhere in the same report. That is not a minor quality issue. That is a product that actively misleads users who read the whole thing. The rebuild fixed the orchestration layer from scratch, not just the model. What data gets pulled, how many sources get cross-referenced, how the answer gets structured. 37 new API endpoints added across prediction markets, institutional capital flows, DeFi comparisons, and Hyperliquid coverage going back to genesis. The Polymarket and Kalshi integration is the one I find genuinely interesting. v1.5 could not answer a single prediction market question. v2.0 can now scan 30 days of 5-minute BTC markets and flag probability reversals in the final 60 seconds before settlement. That is a specific, actionable edge that did not exist two weeks ago. What I want to see next is whether the 8% hallucination rate holds when the portfolio personalization layer ships. Connecting user positions and trading style to the research agent adds a lot of surface area for the model to go wrong in ways that matter more than generic errors.

This content is for informational and educational purposes only. It may include third-party insights, sponsored content, or promotional material for which the creator may receive compensation. Nothing in this feed constitutes investment advice or a guarantee of returns. You are solely responsible for your own investment decisions. Always conduct your own research and exercise caution before trading. We do not guarantee the accuracy of third-party information and are not liable for any losses incurred. Past performance is not indicative of future results. Please refer to our Community Terms and Risk Disclosure Statement for details.

avatarPost your reply

Comment