Kolibri Origin
Research
Aleph Alpha details how architecture choices drive LLM cost, with Kolibri as reference
Aleph Alpha has published a research blog post that works out how core architecture choices in autoregressive language models determine training and serving cost. The…
ModelsAleph Alpha releases Kolibri, an open-weight 78B model for regulated sectors
Aleph Alpha has released Kolibri, an English-German Mixture-of-Experts Transformer with 78B total parameters and 3B active, under the Apache 2.0 license. According to…