Meta took the lead of this charge with Muse Spark Open, which is now the strongest American-made open model by quite some ...

I’ve often been surprised when I hear from top researchers in industry that they think AI will be better than them at their ...

Audio playback is not supported on your browser. Please upgrade. We’re in an era where a few organizations are using thousands of concurrent agents to improve their ...

Audio playback is not supported on your browser. Please upgrade. I’ve had one too many discussions on the cyber risks of open models — where someone assumes that ...

The recent run of cyberattacks by in-development frontier models has got me thinking a lot about how our current incentive systems are not well suited for such fast technological transitions. The two ...

New talk! Forecasting the Alpaca moment for reasoning models and why the new style of RL training is a far bigger deal than the emergence of RLHF. When models such as Alpaca, Vicuña, Dolly, etc. were ...

Audio playback is not supported on your browser. Please upgrade. Distillation has been one of the most frequent topics of discussion in the broader US-China and ...

The question I still get the most is "Why does reinforcement learning from human feedback (RLHF) work?" Until last week, my answer was still "no one knows." We are starting to get some answers. RLHF ...

Audio playback is not supported on your browser. Please upgrade. ‘Distillation attacks’ is a horrible term for what is happening right now. Yes, some Chinese labs ...

Housekeeping: No voiceover for this post as I’m traveling. The oldest comparison people try to make is how what’s happening with open models compares to foundational open-source software projects like ...

Hey all! I’ve been prepping for some public-audience and policy-facing writing on open models, so I figured I would share my research materials. There’s lots of wonderful stuff in here. This is my ...