Mixtral open source LLM by Mistral AI

My understanding is that Mixtral uses a Mixture of Experts architecture of some sort.