Pokee AI Launches 28B Model with 10M Token Context, 10x Longer Than Mainstream Models

iconKuCoinFlash
Share
AI summary iconSummary
AI and crypto news outlet MetaEra reports that Pokee AI has launched its 28B model, Pokee-Isaac, featuring a 10 million token context window—ten times longer than most models. Developed by former Meta lead Zhu Zheqing, it scores 95 on 256K–4M token tests and 93.3 at 10 million tokens. The company, founded in 2024, raised $12 million in seed funding from Point72 Ventures, Qualcomm Ventures, and Samsung NEXT. New token listings may benefit from such AI advancements.
ME AI News, according to monitoring by Beating, AI agent startup Pokee AI has released Pokee-Isaac 28B. With only 28 billion parameters, the model boasts a context window of up to 10 million tokens. Current mainstream models typically max out at around 1 million tokens, making Isaac nearly 10 times longer. In Pokee’s internal tests, Isaac maintained scores around 95 across RULER long-text evaluations from 256,000 to 4 million tokens. Even at the full 10-million-token limit, it still scored 93.3. None of the five other benchmark models returned usable results beyond 2 million tokens. Pokee attributes its ultra-long context capability to its proprietary “non-pure decoder-only architecture,” meaning it does not fully rely on the standard decoder-only structure used by most large models. However, the technical report does not disclose specifics about the architecture, attention mechanism, or memory optimization methods, leaving external observers unable to determine exactly how it achieves this. Pokee AI was founded in 2024 by Zhu Zheqing, former head of applied reinforcement learning at Meta. The company previously secured $12 million in seed funding led by Point72 Ventures, with participation from Qualcomm Ventures and Samsung NEXT. (Source: MLion)
Source:Show original
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.