Mistral AI launched a new content moderation API, addressing the increasing concerns of AI safety and content filtering. This strategic move solidifies the position of the French AI start-up against OpenAI and other AI giants.

Powered by a fine-tuned version of Mistral’s Ministral 8B model, the new moderation service is designed to detect potentially harmful content across nine different categories, including sexual content, hate speech, violence, dangerous activities, and personally identifiable information. The API offers both raw text and conversational content analysis capabilities.

Announcing the release, Mistral’s team stated, “Safety plays a key role in making AI useful… At Mistral AI, we believe that system-level guardrails are critical to protecting downstream deployments.”

The moderation API is already being used in Mistral’s own Le Chat platform and supports 11 languages, including Arabic, Chinese, English, French, German, Italian, Japanese, Korean, Portuguese, Russian, and Spanish. This multilingual capability provides Mistral an edge over some competitors whose moderation tools primarily focus on English content.

The moderation API is now available through Mistral’s cloud platform, with pricing based on usage. The company has confirmed that it will continue to improve the system’s accuracy and expand its capabilities based on customer feedback and evolving safety requirements.