Mistral: Codestral Mamba

A 7.3B parameter Mamba-based model designed for code and reasoning tasks. - Linear time inference, allowing for theoretically infinite sequence lengths - 256k token context window - Optimized for quick responses, especially beneficial for code productivity - Performs comparably to state-of-the-art transformer models in code and reasoning tasks - Available under the Apache 2.0 license for free...

Codestral Mamba has a 256,000 token context window.

Mistral Large 4, Mistral Medium 3.5, Mistral Small 4 and 17 more are other text models from Mistral AI.

Codestral Mamba was released on July 19, 2024. Its knowledge cutoff is March 31, 2024.