Multilingual AI verification: why every translation is a separate claim
New benchmarks and EU rules show multilingual AI output must be verified per language. What does that mean for professionals with sensitive data?
You must now verify AI output separately for each language it appears in, and document which models, source texts and verification steps you used for each one. A single English-language check does not represent the reliability of the same system in other languages.
The prompt is an analysis of 14 August 2026 of multilingual AI verification and hallucination detection, which argues that the same AI models perform differently across languages and that verification architecture must account for language-specific failure modes. The concrete case is fact-checking benchmarks across eleven languages, which show that models are often markedly less accurate in low-resource languages and that techniques improving performance in one language can degrade it in another. In our assessment, this means that if you deploy AI for translation or multilingual content generation in sensitive contexts—legal documents, medical information, policy statements—you cannot treat verification as a single step. You must design your workflow to catch language-specific errors and be able to demonstrate which verification steps you completed for each language before the output entered a file or reached an audience.
Why does the same model perform worse in some languages?
Large language models trained on multilingual data face a structural problem: languages are not equally represented in training corpora, and the quality of that data varies. Low-resource languages—those with less training material available—see higher error rates. The problem is not solved by making the model larger or by adding more languages to its training set. In fact, models with broader language support display on average higher hallucination rates overall. Techniques such as retrieval-augmented generation and better task structuring, which improve performance in high-resource languages, do not help uniformly across the board. What works in English may disappoint in another language entirely.
What specific errors appear in multilingual AI translations?
Translation models produce distinct failure modes that do not disappear through scale alone:
- Wrong-language output — the model responds in a language other than the one requested.
- Instruction detachment — the model adds content that does not appear in the source text.
- Source detachment — the model omits content from the source text without justification.
- Language mismatch in training data — noise and inconsistency in multilingual corpora introduce erroneous output.
- Hallucination persistence across scale — larger models do not reliably eliminate these error patterns.
One erroneous translation claim in a low-resource language can lead to wrong decisions in a legal file, a medical package insert or a policy document. That is not a language slip; it is an assertion that factually deviates from the source.
How should you structure verification for multilingual output?
One concrete approach is to use a pivot language: translate claims from other languages into English, then verify them in English. This produced good results in recent benchmarking work, including for low-resource languages. The downside is that the pivot step is itself a translation, with all the risks that entails. If you check via English, you can introduce new errors precisely at the point where the source text is converted. The choice of pivot language, the models used and their limitations must be visibly recorded. Otherwise you cannot trace whether a rejected or approved claim rests on the source text or on an intermediate translation.
You must be able to demonstrate the following for each multilingual output before it enters a file or reaches an audience:
- Record which source passages were used — document the original text that the translation or verification was based on.
- Document which languages and models were deployed — name the specific models and language routes used in processing.
- Log all verification steps completed — record whether multilingual fact-checking, cross-model review, or human review took place.
- Show the pivot language, if one was used — if verification went through an intermediate language, make that visible in your audit trail.
- Retain evidence of corrections and differences — keep records of where models disagreed or where output was amended before use.
What does EU law now require you to show?
The EU AI Act Article 50 and related transparency obligations now make AI-generated translations a compliance question, not only a quality matter. AI translations of text are in principle exempt from labelling, unless the translation makes substantively far-reaching changes. However, organisations must be able to demonstrate when and how AI was used in a translation process. This means a translation is no longer a fleeting intermediate product. It is something whose origin and processing you must be able to show to a regulator or auditor.
In Europe, multilingual AI translation therefore sits at the intersection of accuracy, auditability and legal obligation. You cannot treat it as a black box. You must design your workflow to make the chain visible: which source text, which language route, which verification steps, which model choices, and where human review occurred.
Tooling can make that visibility possible and can route tasks through selected models whilst recording which verification steps were completed and where models disagreed. It can also pre-process sensitive documents by replacing sensitive values with synthetic equivalents before AI processing, so that only anonymised content is sent to external systems. What tooling cannot do is guarantee correctness or eliminate hallucinations. The professional final judgement—whether to use a translation, whether to send it onward, whether to flag it for human review—remains yours.
Sources: This article draws on reporting and guidance from arXiv, ACL Anthology and Laratranslate.
Written by
Tobias Lindqvist
Adversarial machine learning and the security properties of retrieval systems.