Mistral has released a preview of ML4, internally nicknamed “Le Chonk.” Yes, that is actually what they call it. The model has 1 trillion parameters, although only 49 billion are active at a time. Mistral…
Aleph Alpha has released Kolibri-1, an open-weight Mixture-of-Experts model for English and German. It has 78.1B total parameters, but only 3.46B of them are active for each token. For a model focused on just two…
Ai2 has released AstaBrief 8B, an open-weights model designed to take research questions and scientific sources and turn them into cited reports. But unlike a normal chatbot, AstaBrief isn't a multipurpose model. It has a…
Cloudflare has released Clef and Clef-flash, its first open-source decision models. Both models are available on Cloudflare Workers AI, while their weights are also available publicly under the Apache 2.0 license, meaning developers can download…