Research Engineer - Tokenizer & Protocols

Job description preview

From Mistral AI’s original posting

ABOUT MISTRAL Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. ABOUT THE ROLE Between a conversation and a model sit the formats and tokenizers that every part of our stack relies on. You will help own them, and the tooling around them, so that training, evaluation and production all speak exactly the same language. You will work across the entire stack, spanning pretraining, post-training and deployment, and your decisions will reach every model we ship. WHAT YOU WILL DO - Design, build and maintain core libraries for tokenization and model interfaces. - Evolve our formats and…