HomeTechnologyDeep Cogito emerges from stealth with hybrid AI 'reasoning' models

Deep Cogito emerges from stealth with hybrid AI ‘reasoning’ models

[ad_1]

A new company, Deep Cogito, has emerged from stealth with a family of openly available AI models that can be switched between โ€œreasoningโ€ and non-reasoning modes.

Reasoning models like OpenAIโ€™s o1 have shown great promise in domains like math and physics, thanks to their ability to effectively fact-check themselves by working through complex problems step by step. This reasoning comes at a cost, however: higher computing and latency. Thatโ€™s why labs like Anthropic are pursuing โ€œhybridโ€ model architectures that combine reasoning components with standard, non-reasoning elements. Hybrid models can quickly answer simple questions while spending additional time considering more challenging queries.

All of Deep Cogitoโ€™s models, called Cogito 1, are hybrid models. Cogito claims that they outperform the best open models of the same size, including models from Meta and Chinese AI startup DeepSeek.

โ€œEach model can answer directly [โ€ฆ] or self-reflect before answering (like reasoning models),โ€ the company explained in a blog post. โ€œ[All] were developed by a small team in approximately 75 days.โ€

The Cogito 1 models range from 3 billion parameters to 70 billion parameters, and Cogito says that models ranging up to 671 billion parameters will join them in the coming weeks and months. Parameters roughly correspond to a modelโ€™s problem-solving skills, with more parameters generally being better.

Cogito 1 wasnโ€™t developed from scratch, to be clear. Deep Cogito built on top of Metaโ€™s open Llama and Alibabaโ€™s Qwen models to create its own. The company says that it applied novel training approaches to boost the base modelsโ€™ performance and enable toggleable reasoning.

According to the results of Cogitoโ€™s internal benchmarking, the largest Cogito 1 model, Cogito 70B, with reasoning outperforms DeepSeekโ€™s R1 reasoning model on a few mathematics and language evaluations. Cogito 70B with reasoning disabled also eclipses Metaโ€™s recently released Llama 4 Scout model on LiveBench, a general-purpose AI test.

Every Cogito 1 model is available for download or use via APIs on cloud providers Fireworks AI and Together AI.

Deep Cogito
Cogito 1โ€™s performance compared to other popular openly available AI models,Image Credits:Deep Cogito

โ€œCurrently, weโ€™re still in the early stages of [our] scaling curve, having used only a fraction of compute typically reserved for traditional large language model post/continued training,โ€ wrote Cogito in its blog post. โ€œMoving forward, weโ€™re investigating complementary post-training approaches for self-improvement.โ€

According to filings with California State, San Francisco-based Deep Cogito was founded in June 2024. The companyโ€™s LinkedIn page lists two co-founders, Drishan Arora and Dhruv Malhotra. Malhotra was previously a product manager at Google AI lab DeepMind, where he worked on generative search technology. Arora was a senior software engineer at Google.

Deep Cogito, whose backers include South Park Commons, according to Pitchbook, ambitiously aims to build โ€œgeneral superintelligence.โ€ The companyโ€™s founders understand the phrase to mean AI that can perform tasks better than most humans and โ€œuncover entirely new capabilities we have yet to imagine.โ€

[ad_2]

Source link

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments