#mixtral

1 articles

01 ·Model Families·★ MEMBER·9 min read The Mistral Family from Scratch — Europe's Small-and-Strong Bet How a Paris startup made 'small but strong' work: the sliding-window attention behind Mistral 7B, the sparse mixture of experts behind Mixtral, the Codestral code line, and the licence policy that started at Apache 2.0 and then wandered — explained from no prior knowledge.