Pokee AI Launches 28B-Parameter Model with 10M Token Context Window

iconChainthink
Share
AI summary iconSummary
AI and crypto news broke on August 5 as Pokee AI unveiled the 28B-parameter Pokee-Isaac model with a 10 million token context window. Internal tests showed Isaac scoring 95 on RULER tests ranging from 256K to 4M tokens and 93.3 at full capacity, while other models failed beyond 2M tokens. The company employs a proprietary non-pure decoder-only architecture. Founded in 2024 by Zhu Zheqing, former head of Meta’s ARRL, Pokee raised $12 million in seed funding from Point72 Ventures, Qualcomm Ventures, and Samsung NEXT. New token listings may benefit from such AI advancements.

ChainThink reports that on August 5, AI Agent startup Pokee AI launched Pokee-Isaac 28B, a model with 28 billion parameters and a context window of 10 million tokens—nearly ten times the typical 1 million token limit of mainstream models.

According to its own testing, Isaac maintained a score of around 95 throughout the RULER long-context test range from 256,000 to 4,000,000 tokens, and still scored 93.3 when pushed to 10,000,000 tokens.

The other five benchmark models did not return usable results starting from 2 million tokens.

Pokee attributes this capability to its proprietary "non-pure decoder-only architecture," but the technical report does not disclose the specific architecture, attention mechanism, or memory management scheme, leaving the implementation method unclear to outsiders.

Pokee AI was founded in 2024 by Zhu Zheqing, former head of applied reinforcement learning at Meta. The company raised a $12 million seed round led by Point72 Ventures, with participation from Qualcomm Ventures, Samsung NEXT, and others.

Source:Show original
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.