OmniAlign: A Unified Multilingual Aligner for Word and Sentence Alignment

arXiv:2608.184742026-08-20

One small model that matches words and lines up sentences across languages, no matter the text length

Aligning parallel text across languages usually needs separate tools for word-level matching and sentence-level matching, and most of them break down on long documents. OmniAlign does both jobs with a single lightweight 0.3B-parameter model, covering eleven major languages and inputs up to 8,192 tokens long. A four-stage training pipeline lets it keep both fine-grained word accuracy and strong sentence-level representations.

METAL MEDIA explanatory visual

One small model that matches words and lines up sentences across languages, no matter the text length

01Existing tools specialize in either word alignment or sentence alignment, and most word aligners degrade sharply or simply can't handle inputs beyond 512 tokens
02OmniAlign builds on the mGTE encoder: it derives word alignments from similarity matrices between contextualized token embeddings, and gets document-level sentence alignments (including one-to-many and many-to-many matches) from sentence embeddings plus dynamic programming
03Training runs through four stages: continued pre-training, self-supervised learning, supervised fine-tuning on human-annotated data, and knowledge distillation from a strong multilingual teacher model (LaBSE)
04It ranks first on 4 and second on 3 of nine word-alignment language pairs, and first on 4 and second on 2 of seven sentence-alignment language pairs, while also generalizing well to language pairs it was never trained on
05On long text (1,850 tokens), its error rate rises only mildly from 8.5% to 12.6%, unlike other methods whose performance collapses

An explanatory diagram made by METAL MEDIA, not a figure supplied by the paper's authors.

What they did

Existing tools specialize in either word alignment or sentence alignment, and most word aligners degrade sharply or simply can't handle inputs beyond 512 tokens
OmniAlign builds on the mGTE encoder: it derives word alignments from similarity matrices between contextualized token embeddings, and gets document-level sentence alignments (including one-to-many and many-to-many matches) from sentence embeddings plus dynamic programming
Training runs through four stages: continued pre-training, self-supervised learning, supervised fine-tuning on human-annotated data, and knowledge distillation from a strong multilingual teacher model (LaBSE)
It ranks first on 4 and second on 3 of nine word-alignment language pairs, and first on 4 and second on 2 of seven sentence-alignment language pairs, while also generalizing well to language pairs it was never trained on
On long text (1,850 tokens), its error rate rises only mildly from 8.5% to 12.6%, unlike other methods whose performance collapses

Table 1: This report compares OmniAlign with a range of existing state-of-the-art sequence alignment methods. The symbol “–” indicates that the capability is independent of the specific model choice.
Methods	Multilingual	Long Text	Word Alignment	Sentence Alignment
FastAlign (8)			✓
GIZA++ (22)			✓
SimAlign (26)	✓		✓
AwesomeAlign (7)	✓		✓
AccAlign (34)	✓		✓
WSPAlign (35)	✓		✓
BinaryAlign (14)			✓
Gale-Church (10)		✓		✓
BleuAlign (27)	✓	-		✓
VecAlign (29)	✓	-		✓
BertAlign (15)	✓	-		✓
SentAlign (28)	✓	-		✓
CrocoAlign (19)	✓	-		✓
OmniAlign	✓	✓	✓	✓

Table 2: Supported Languages Evaluated
Languages	ISO 639-1	Languages	ISO 639-1	Languages	ISO 639-1
Chinese	zh	Spanish	es	Italian	it
English	en	Japanese	ja	Korean	ko
French	fr	Russian	ru	German	de
Portuguese	pt	Romanian	ro

Figure 2: Overall architecture of OmniAlign, including the sequence alignment model (left) and the multi-stage training pipeline (right).

Table 3: Statistics of the word alignment dataset, where "Avg. Tokens" denotes the statistics for the English source text in the test set.
	zh-en	de-en	fr-en	ro-en	ja-en	es-en	pt-en	ru-en	it-en
Train Sents	40.7K	300	300	150	653	105	105	90	103
Test Sents	450	208	147	98	582	245	245	210	243
Avg. Tokens	37	21	16	30	27	19	19	13	19

Table 4: AER of the test set under different word alignment methods. Lower AER indicates better performance. For each language pair, the best result is bolded and the second-best one is underlined.
Methods	zh-en	de-en	fr-en	ro-en	ja-en	es-en	pt-en	ru-en	it-en
FastAlign (8)	38.1	27.0	10.5	27.0	51.1	-	-	-	-
GIZA++ (22)	35.1	20.6	5.9	26.4	48.0	-	-	-	-
SimAlign (26)	21.6	16.6	7.5	22.3	46.6	14.2	14.1	15.4	17.7
AwesomeAlign (7)	13.3	13.3	3.8	18.7	37.4	12.0	12.7	13.5	15.7
AccAlign (34)	11.5	12.1	2.8	16.9	36.8	11.1	12.1	12.5	14.3
WSPAlign (Bilingual) (35)	13.1	11.1	2.8	10.1	19.3	-	-	-	-
WSPAlign (Multilingual) (35)	22.3	20.0	12.8	26.4	45.8	13.4	12.3	13.1	17.1
BinaryAlign (Bilingual) (14)	4.8	7.8	1.9	7.4	14.3	-	-	-	-
OmniAlign (ours)	8.5	11.0	2.7	16.7	29.6	10.7	11.9	12.1	14.1

Table 5: F1 scores of OmniAlign and sentence alignment baseline methods across language pairs. For each language pair, the best result is bolded and the second-best one is underlined.
Algorithm	en-zh	en-es	en-it	en-de	en-fr	en-ru	de-fr
Gale–Church (10)	0.682	0.900	0.977	0.897	0.838	0.911	0.680
BleuAlign (27)	0.782	0.819	0.901	0.806	0.757	0.791	0.770
VecAlign (29)	0.957	0.892	0.956	0.869	0.880	0.921	0.902
BertAlign (15)	0.969	0.897	0.984	0.900	0.909	0.938	0.939
SentAlign (28)	0.968	0.872	0.978	0.892	0.903	0.920	0.932
CrocoAlign (19)	0.660	0.696	0.864	0.804	0.788	0.783	0.714
OmniAlign (Ours)	0.970	0.906	0.978	0.913	0.912	0.935	0.922

Table 6: Ablation study on word and sentence alignment performance under different training strategies and embedding models.
Model	zh-en	de-en	fr-en
Additive Training Stages
mGTE-MLM-Base	43.0	28.3	14.5
mGTE-MLM-Base + S.1	19.6	16.4	5.8
mGTE-MLM-Base + S.1 + S.2	14.3	12.8	3.4
mGTE-MLM-Base + S.1 + S.2 + S.3	8.5	11.0	2.7
Subtractive Training Stages
OmniAlign w/o S.3	14.3	12.8	3.4
OmniAlign w/o S.2	8.6	11.1	2.7
OmniAlign w/o S.1	8.7	11.5	2.9
OmniAlign	8.5	11.0	2.7

(a) Word alignment AER (%). Lower is better. Within each block, the best result is bolded and the second-best one is underlined.
Model	zh-en	de-en	fr-en
Additive Training Stages
mGTE-MLM-Base	43.0	28.3	14.5
mGTE-MLM-Base + S.1	19.6	16.4	5.8
mGTE-MLM-Base + S.1 + S.2	14.3	12.8	3.4
mGTE-MLM-Base + S.1 + S.2 + S.3	8.5	11.0	2.7
Subtractive Training Stages
OmniAlign w/o S.3	14.3	12.8	3.4
OmniAlign w/o S.2	8.6	11.1	2.7
OmniAlign w/o S.1	8.7	11.5	2.9
OmniAlign	8.5	11.0	2.7

(b) Sentence alignment F1 scores. Higher is better. For each language pair, the best result is bolded and the second-best one is underlined.
Method	#Params	Emb. Dim.	en-zh	en-es	en-it
DP + LaBSE	0.47B	768	0.972	0.904	0.979
DP + multilingual-e5-large-instructE99 9 https://huggingface.co/intfloat/multilingual-e5-large-instruct	0.56B	1024	0.895	0.899	0.972
DP + bge-m31010 10 https://huggingface.co/BAAI/bge-m3	0.57B	1024	0.933	0.910	0.978
DP + Qwen3-Embedding-0.6B1111 11 https://huggingface.co/Qwen/Qwen3-Embedding-0.6B	0.6B	1024	0.939	0.905	0.971
DP + Qwen3-Embedding-8B1212 12 https://huggingface.co/Qwen/Qwen3-Embedding-8B	8B	4096	0.935	0.908	0.975
DP + gte-multilingual-base1313 13 https://huggingface.co/Alibaba-NLP/gte-multilingual-base	0.31B	768	0.927	0.908	0.973
DP + OmniAlign (w/o S.4)	0.31B	768	0.716	0.872	0.966
DP + OmniAlign (distilled from LaBSE)	0.31B	768	0.970	0.906	0.978

Table 7: Word alignment AER (%) at different layers for various base models. Within each model group, the best result is bolded.
Model	Layer	zh-en	de-en	fr-en
mBERT	6	20.5	19.4	6.5
7	19.0	16.6	5.6
8	18.1	15.2	5.4
mGTE-MLM-Base	6	54.8	33.7	18.0
7	43.0	28.3	14.5
8	47.5	30.1	16.0
mGTE-MLM-Base + S.1	6	28.4	21.2	6.9
7	19.6	16.4	5.8
8	22.8	19.1	6.4

Table 8: Word alignment performance under increasing input lengths. The zh-en-n setting denotes long-text inputs constructed by concatenating n samples from the original zh-en test set. Notably, zh–en–50 reaches 1,850 tokens.
Model	zh-en-1	zh-en-3	zh-en-5	zh-en-10	zh-en-20	zh-en-50
Awesome-Align	13.3	13.9	15.1	24.8	–	–
ACC-Align	11.5	12.5	15.8	28.1	–	–
BinaryAlign (Bilingual)	4.8	9.6	22.8	–	–	–
OmniAlign (Ours)	8.5	8.6	8.6	9.2	10.5	12.6

Table 9: Alignment performance of OmniAlign and baselines on unseen language pairs
Test Set	AccAlign	BinaryAlign	OmniAlign
bg-en	11.0	11.99	10.6
da-en	7.1	8.45	7.1
et-en	15.2	15.67	14.4
hu-en	18.7	16.93	19.1
nl-en	4.6	5.14	4.5
sl-en	14.9	16.85	14.7

Table 10: Case studies of OmniAlign and other sequence alignment methods. Blue indicates correct alignments, red denotes incorrect alignments, and black marks segments with no alignment.
Scenario 1: Word Alignment
Example #1	He had to repeatedly traverse the inner palace’s chambers, yet each attempt ended in failure.
Testing Points	“failure”.
OmniAlign	他得不断地一再地穿过内宫里的屋子；可是他一直没有成功。
OmniAlign w/o S.1	他得不断地一再地穿过内宫里的屋子；可是他一直没有成功。
Example #2	已知有血液疾病及尿酸性肾结石的患者不推荐使用本品，二岁以下儿童不得服用。
Testing Points	有; 二岁
OmniAlign	This product is not recommended for patients with known blood disorders or uric acid kidney stones, and it should not be taken by children under the age of two.
BinaryAlign	This product is not recommended for patients with known blood disorders or uric acid kidney stones, and it should not be taken by children under the age of two.
Example #3	I recently returned to d2 after several year, now I’m windering: Where do you guys sell/buy your stuff? Do you just make a game “O xxx N yyy” and hope for the best? Or are there a website that’s more efficient?
Testing Points	returned; windering
OmniAlign	时隔多年，我又重新开始玩《暗黑破坏神2》（DiabloII），现在我想知道：大家都是在哪里进行物品交易的？是通过自己创建名为“OxxxNyyy”的游戏房间来交易，然后听天由命吗？还是有更高效的交易网站？
BinaryAlign	时隔多年，我又重新开始玩《暗黑破坏神2》（DiabloII），现在我想知道：大家都是在哪里进行物品交易的？是通过自己创建名为“OxxxNyyy”的游戏房间来交易，然后听天由命吗？还是有更高效的交易网站？
Example #4	在技术演进的脉络中，预训练模型的出现无疑是里程碑式的突破。以 BERT、GPT、T5 等为代表的模型通过在海量无标注文本上进行自监督学习，习得语言的深层语义表示和语法结构，极大地提升了下游任务的性能上限。这些模型基于 Transformer 架构的多头注意力机制，能够捕捉文本中的长距离依赖关系和上下文关联，为文本分类、情感分析、机器翻译、问答系统等经典任务提供了强大的通用能力。近年来，多语言预训练模型（如 XLM-R、mT5、LaBSE）进一步打破了语言壁垒，通过对数百种语言的联合训练，实现了跨语言文本的理解与生成，为全球化信息传播和跨文化交流提供了技术支撑。在产业应用层面，NLP 技术已渗透到金融、医疗、教育、传媒等多个领域，催生了一系列创新产品和服务。在金融行业，智能客服系统能够基于用户的自然语言查询快速提供账户咨询、业务办理等服务，平均响应时间缩短至秒级，客户满意度提升 30% 以上；风险控制模型通过分析企业年报、新闻舆情等文本数据，精准识别信用风险和市场波动信号，帮助金融机构降低不良贷款率。在医疗领域，医学文本分析系统可自动提取电子病历中的关键信息（如病症、用药史、检查结果），辅助医生进行诊断决策，减少误诊率；多语言医疗翻译工具则为跨境医疗合作提供了语言保障，使不同国家的医护人员能够高效协作。在教育领域，智能写作辅助系统能够实时检测文本中的语法错误、逻辑漏洞，并提供优化建议，帮助学生提升写作能力；个性化学习平台通过分析学生的学习行为和文本交互数据，精准推送适配的学习资源，实现 “因材施教” 的教育理念。
Testing Points	(Bert、GPT、T5); (多头注意力机制); (文本分类、情感分析、机器翻译、问答系统); (XLM-R、mT5、LaBSE); (创新产品和服务); (智能客服系统); (风险控制模型); (多语言医疗翻译工具); (实时检测); (学习行为和文本交互数据); (教育理念)
OmniAlign	In the context of technological evolution, the emergence of pre-trained models is undoubtedly a milestone breakthrough. Represented by BERT, GPT, T5, and other models, they acquire deep semantic representations and syntactic structures of language through self-supervised learning on massive unlabeled text, greatly raising the performance ceiling of downstream tasks. Based on the multi-head attention mechanism of the Transformer architecture, these models can capture long-distance dependencies and contextual correlations in text, providing powerful general capabilities for classic tasks such as text classification, sentiment analysis, machine translation, and question-answering systems. In recent years, multilingual pre-trained models (e.g., XLM-R, mT5, LaBSE) have further broken down language barriers. Through joint training on hundreds of languages, they have realized the understanding and generation of cross-lingual text, providing technical support for global information dissemination and cross-cultural communication. At the industrial application level, NLP technology has penetrated into multiple fields such as finance, healthcare, education, and media, spawning a series of innovative products and services. In the financial industry, intelligent customer service systems can quickly provide account consultations, business processing, and other services based on users’ natural language queries, reducing the average response time to seconds and increasing customer satisfaction by more than 30%; risk control models accurately identify credit risks and market fluctuation signals by analyzing text data such as corporate annual reports and news public opinion, helping financial institutions reduce the non-performing loan ratio. In the healthcare field, medical text analysis systems can automatically extract key information from electronic medical records (such as symptoms, medication history, and examination results) to assist doctors in diagnostic decisions and reduce the misdiagnosis rate; multilingual medical translation tools provide language guarantees for cross-border medical cooperation, enabling medical staff from different countries to collaborate efficiently. In the education field, intelligent writing assistance systems can real-time detect grammatical errors and logical flaws in text, and provide optimization suggestions to help students improve their writing skills; personalized learning platforms accurately push adaptive learning resources by analyzing students’ learning behaviors and text interaction data, realizing the educational concept of "teaching students in accordance with their aptitude".
BinaryAlign	In the context of technological evolution, the emergence of pre-trained models is undoubtedly a milestone breakthrough. Represented by BERT, GPT, T5, and other models, they acquire deep semantic representations and syntactic structures of language through self-supervised learning on massive unlabeled text, greatly raising the performance ceiling of downstream tasks. Based on the multi-head attention mechanism of the Transformer architecture, these models can capture long-distance dependencies and contextual correlations in text, providing powerful general capabilities for classic tasks such as text classification, sentiment analysis, machine translation, and question-answering systems. In recent years, multilingual pre-trained models (e.g., XLM-R, mT5, LaBSE) have further broken down language barriers. Through joint training on hundreds of languages, they have realized the understanding and generation of cross-lingual text, providing technical support for global information dissemination and cross-cultural communication. At the industrial application level, NLP technology has penetrated into multiple fields such as finance, healthcare, education, and media, spawning a series of innovative products and services. In the financial industry, intelligent customer service systems can quickly provide account consultations, business processing, and other services based on users’ natural language queries, reducing the average response time to seconds and increasing customer satisfaction by more than 30%; risk control models accurately identify credit risks and market fluctuation signals by analyzing text data such as corporate annual reports and news public opinion, helping financial institutions reduce the non-performing loan ratio. In the healthcare field, medical text analysis systems can automatically extract key information from electronic medical records (such as symptoms, medication history, and examination results) to assist doctors in diagnostic decisions and reduce the misdiagnosis rate; multilingual medical translation tools provide language guarantees for cross-border medical cooperation, enabling medical staff from different countries to collaborate efficiently. In the education field, intelligent writing assistance systems can real-time detect grammatical errors and logical flaws in text, and provide optimization suggestions to help students improve their writing skills; personalized learning platforms accurately push adaptive learning resources by analyzing students’ learning behaviors and text interaction data, realizing the educational concept of "teaching students in accordance with their aptitude".
Scenario 2: Sentence Alignment
Example #1	Source (1) Their Australian born captain, the world’s top-ranked match racer Peter Gilmour, lived in Japan for three years to satisfy the Cup’s crew-nationality rules. (2) Syndicate head Tatsumitsu Yamasaki, chairman of spice giant S&B Foods, is hungry for a win. Target (1) 该船队的船长为世界顶尖帆船赛选手皮得·吉尔摩。 (2) 为了达到杯赛在船员国籍方面的各项要求，这位出生在澳大利亚的选手在日本居住了3年。 (3) 山崎达光是一家财团的总裁兼调味品行业的巨人S&B食品株式会社董事会主席。 (4) 他渴望日本船队能够获得胜利。
OmniAlign	[(1)]:[(1), (2)]; [(2)]:[(3), (4)]
BertAlign	[(1)]:[(1), (2)]; [(2)]:[(3)]; []:[(4)]
Example #2	Source (1) Then came the hard part: getting people to want to see the thing. (2) Here’s how they did it, from whisper to buzz to big box-office noise, in only 21 steps. Target (1) 随后进入最艰苦的宣传炒作阶段。 (2) 下面就是他们的宣传炒作步骤：刚开始知者甚少，随后观众渐增，最后票房炙手可热。 (3) 这一成绩的取得仅需21步：。
OmniAlign	[(1)]:[(1), (2)]; [(2)]:[(2), (3)]
BertAlign	[(1), (2)]:[(1), (2), (3)]
Example #3	Source (1) The situation in Japan has to change. " (2) At Nissan, it already has. Target (1) 这种形势必须改变。 (2) 在日产，这种变革已经开始。
OmniAlign	[(1)]:[(1)]; [(2)]:[(2)]
BertAlign	[(1), (2)]:[(1), (2)]
Example #4	Source (1) 就在这种情况下，我想起十五队的队医陈清扬是北医大毕业的大夫，对针头和勾针大概还能分清，所以我去找她看病。 (2) 看完病回来，不到半个小时，她就追到我屋里来，要我证明她不是破鞋。 Target (1) Under the circumstances, I recalled that the doctor at the fifteenth team, Chen Qingyang, had graduated from Beijing Medical School. (2) Maybe she would be able to tell the difference between a hypodermic and a crotchet needle. (3) So I went to see her. (4) Not half an hour after my visit, she chased after me to my room, wanting me to prove that she wasn’t damaged goods.
OmniAlign	[(1)]:[(1), (2), (3)]; [(2)]:[(4)]
BertAlign	[(1)]:[(1), (2)]; [(2)]:[(3), (4)]

Why it matters

Word and sentence alignment underpin practical tasks like building parallel corpora, creating translation memories for computer-assisted translation, and transferring annotations across languages, but practitioners have typically needed separate systems for each granularity. A single lightweight model that handles multiple languages, long documents, and both alignment levels can cut down on the complexity and cost of maintaining multiple tools.

Terms in this paper

word alignment · finding which word in one language corresponds to which word in another
sentence alignment · finding which sentence(s) in one language document correspond to which sentence(s) in another, including one-to-many matches
encoder-only model · a transformer architecture specialized for turning text into context-aware vector representations, rather than generating text
dynamic programming · an algorithmic technique for efficiently finding the optimal path among many possible choices
knowledge distillation · training a smaller student model to mimic a larger, stronger teacher model's outputs
AER (Alignment Error Rate) · a metric measuring how far a word alignment result is from the correct answer; lower is better

Original abstract (English)

Cross-lingual sequence alignment is fundamental for building and exploiting parallel corpora, spanning mappings from documents and sentences down to words and subwords. Existing tools, however, typically specialize in a single granularity, so practitioners often need separate systems for word- and sentence-level alignment---especially in multilingual and long-text settings. We present OmniAlign, a unified multilingual aligner that supports both word-level and sentence-level alignment with a single lightweight model. Built on an encoder-only backbone with strong long-context modeling, OmniAlign induces word alignments from contextualized token similarity matrices, and obtains document-level $m$--$n$ sentence alignments via sentence embeddings combined with dynamic programming. To balance fine-grained alignment accuracy and sentence-representation quality, we use a four-stage training pipeline: alignment-oriented continued pre-training, self-supervised learning, supervised fine-tuning on human annotations, and sentence-embedding distillation from a strong multilingual teacher. Experiments show that OmniAlign achieves highly competitive performance on both word- and sentence-alignment benchmarks and generalizes well to unseen language pairs. Surprisingly, later-stage supervised fine-tuning on short texts further improves alignment quality while retaining the long-context understanding acquired in earlier training, keeping the model robust on long-text word alignment. \normalsize {\color{blue}\textbf{Code}: https://github.com/MilkDargon/OmniAlign}\par {\color{blue}\textbf{Model}: https://huggingface.co/WPS-Qingqiu/OmniAlign}

Authors · Mengpeng Yang, Jingxu Yang, Chao Chen, Tian Xia, Yabo Sun, Qiang Liu

Read on arXiv

Latest papers

All papers →

Latest from METAL MEDIA

Figures: Mengpeng Yang et al., arXiv:2608.18474, CC BY 4.0