Alex Dimakis

@alexdimakis.bsky.social

UC Berkeley Professor working on AI. Co-Director: National AI Institute on the Foundations of Machine Learning (IFML). http://BespokeLabs.ai cofounder

We are excited to release the OpenThinker2 reasoning models and data: 1. Outperforms DeepSeekR1-32B in reasoning. 2. Fully open source, open weights and open data (1M samples). 3. Post-trained only with SFT. RL post-training will likely further improve performance. github.com/open-thought...

GitHub - open-thoughts/open-thoughts: Fully open data curation for reasoning models

Fully open data curation for reasoning models. Contribute to open-thoughts/open-thoughts development by creating an account on GitHub.

github.com

What if we had the data that DeepSeek-R1 was post-trained on? We announce Open Thoughts, an effort to create such open reasoning datasets. Using our data we trained Open Thinker 7B an open data model with performance very close to DeepSeekR1-7B distill. (1/n)

Bild

The Berkeley Sky computing lab just trained a GPT-o1 level reasoning model, spending only $450 to create the instruction dataset. The data is 17K math and coding problems solved step by step. They created this dataset by prompting QwQ at $450 cost. Q: Impossible without distilling a bigger model?

Bild

AI monoliths vs Unix Philosophy: The case for small specialized AI models. Current thinking is that AGI is coming, and one gigantic model will be able to solve everything. Current Agents are mostly prompts on one big model and prompt engineering is used for executing complex processes. (1/n)

Bild