컴백부터 K-뷰티까지 — K-컬쳐의 모든 것을 메일로 받아보세요메일로 받아보기

METAL MEDIA

단어 하나하나 매칭부터 문서 속 문장 짝짓기까지, 한 모델로 다 하는 다국어 정렬기

arXiv:2608.184742026-08-20

OmniAlign: A Unified Multilingual Aligner for Word and Sentence Alignment

단어 하나하나 매칭부터 문서 속 문장 짝짓기까지, 한 모델로 다 하는 다국어 정렬기

두 언어 문장을 나란히 놓고 어떤 단어가 어떤 단어에 대응하는지, 어떤 문장이 어떤 문장에 대응하는지 찾아내는 작업은 지금까지 각각 다른 도구가 필요했다. OmniAlign은 하나의 가벼운 모델(0.3B 파라미터)로 단어 정렬과 문장 정렬을 모두 해내며, 11개 주요 언어와 최대 8192토큰 길이의 긴 텍스트까지 지원한다. 4단계 학습 과정을 통해 단어 단위 정확도와 문장 단위 의미 표현력을 동시에 확보했다.

METAL MEDIA 해설 도표

단어 하나하나 매칭부터 문서 속 문장 짝짓기까지, 한 모델로 다 하는 다국어 정렬기

  1. 01기존 도구들은 단어 정렬 또는 문장 정렬 중 하나에만 특화되어 있고, 512토큰 넘는 긴 텍스트에서는 성능이 크게 떨어졌다
  2. 02OmniAlign은 mGTE라는 인코더 기반 모델을 바탕으로, 문맥화된 토큰 임베딩끼리의 유사도 행렬에서 단어 정렬을, 문장 임베딩과 동적계획법(다이내믹 프로그래밍)으로 문서 전체의 문장 정렬(1대1은 물론 여러 문장 대 여러 문장까지)을 뽑아낸다
  3. 03학습은 계속 사전학습, 자기지도학습, 사람이 직접 라벨링한 데이터로 지도 미세조정, 강력한 다국어 교사 모델(LaBSE)로부터의 지식 증류, 이렇게 4단계로 진행된다
  4. 049개 언어쌍 단어 정렬 벤치마크에서 4개 1위·3개 2위, 7개 언어쌍 문장 정렬 벤치마크에서 4개 1위·2개 2위를 기록했으며, 학습에 쓰지 않은 언어쌍에서도 성능이 준수하게 나왔다
  5. 05긴 텍스트(1850토큰)에서도 오류율이 8.5%에서 12.6%로만 소폭 상승해, 다른 방법들이 급격히 무너지는 것과 대조적이었다
METAL MEDIA이 원문을 바탕으로 재구성한 해설 도표이며, 논문 저자의 원문 figure가 아닙니다.

무엇을 했나

  1. 기존 도구들은 단어 정렬 또는 문장 정렬 중 하나에만 특화되어 있고, 512토큰 넘는 긴 텍스트에서는 성능이 크게 떨어졌다
  2. OmniAlign은 mGTE라는 인코더 기반 모델을 바탕으로, 문맥화된 토큰 임베딩끼리의 유사도 행렬에서 단어 정렬을, 문장 임베딩과 동적계획법(다이내믹 프로그래밍)으로 문서 전체의 문장 정렬(1대1은 물론 여러 문장 대 여러 문장까지)을 뽑아낸다
  3. 학습은 계속 사전학습, 자기지도학습, 사람이 직접 라벨링한 데이터로 지도 미세조정, 강력한 다국어 교사 모델(LaBSE)로부터의 지식 증류, 이렇게 4단계로 진행된다
  4. 9개 언어쌍 단어 정렬 벤치마크에서 4개 1위·3개 2위, 7개 언어쌍 문장 정렬 벤치마크에서 4개 1위·2개 2위를 기록했으며, 학습에 쓰지 않은 언어쌍에서도 성능이 준수하게 나왔다
  5. 긴 텍스트(1850토큰)에서도 오류율이 8.5%에서 12.6%로만 소폭 상승해, 다른 방법들이 급격히 무너지는 것과 대조적이었다
Figure 1: Sequence Alignment Diagram.
Figure 1: Sequence Alignment Diagram.
Table 1: This report compares OmniAlign with a range of existing state-of-the-art sequence alignment methods. The symbol “–” indicates that the capability is independent of the specific model choice.
MethodsMultilingualLong TextWord AlignmentSentence Alignment
FastAlign (8)
GIZA++ (22)
SimAlign (26)
AwesomeAlign (7)
AccAlign (34)
WSPAlign (35)
BinaryAlign (14)
Gale-Church (10)
BleuAlign (27)-
VecAlign (29)-
BertAlign (15)-
SentAlign (28)-
CrocoAlign (19)-
OmniAlign
(b) Sentence Alignment Example.
(b) Sentence Alignment Example.
Table 2: Supported Languages Evaluated
LanguagesISO 639-1LanguagesISO 639-1LanguagesISO 639-1
ChinesezhSpanishesItalianit
EnglishenJapanesejaKoreanko
FrenchfrRussianruGermande
PortugueseptRomanianro
Figure 2: Overall architecture of OmniAlign, including the sequence alignment model (left) and the multi-stage training pipeline (right).
Figure 2: Overall architecture of OmniAlign, including the sequence alignment model (left) and the multi-stage training pipeline (right).
Table 3: Statistics of the word alignment dataset, where "Avg. Tokens" denotes the statistics for the English source text in the test set.
zh-ende-enfr-enro-enja-enes-enpt-enru-enit-en
Train Sents40.7K30030015065310510590103
Test Sents45020814798582245245210243
Avg. Tokens372116302719191319
Table 4: AER of the test set under different word alignment methods. Lower AER indicates better performance. For each language pair, the best result is bolded and the second-best one is underlined.
Methodszh-ende-enfr-enro-enja-enes-enpt-enru-enit-en
FastAlign (8)38.127.010.527.051.1----
GIZA++ (22)35.120.65.926.448.0----
SimAlign (26)21.616.67.522.346.614.214.115.417.7
AwesomeAlign (7)13.313.33.818.737.412.012.713.515.7
AccAlign (34)11.512.12.816.936.811.112.112.514.3
WSPAlign (Bilingual) (35)13.111.12.810.119.3----
WSPAlign (Multilingual) (35)22.320.012.826.445.813.412.313.117.1
BinaryAlign (Bilingual) (14)4.87.81.97.414.3----
OmniAlign (ours)8.511.02.716.729.610.711.912.114.1
Table 5: F1 scores of OmniAlign and sentence alignment baseline methods across language pairs. For each language pair, the best result is bolded and the second-best one is underlined.
Algorithmen-zhen-esen-iten-deen-fren-rude-fr
Gale–Church (10)0.6820.9000.9770.8970.8380.9110.680
BleuAlign (27)0.7820.8190.9010.8060.7570.7910.770
VecAlign (29)0.9570.8920.9560.8690.8800.9210.902
BertAlign (15)0.9690.8970.9840.9000.9090.9380.939
SentAlign (28)0.9680.8720.9780.8920.9030.9200.932
CrocoAlign (19)0.6600.6960.8640.8040.7880.7830.714
OmniAlign (Ours)0.9700.9060.9780.9130.9120.9350.922
Table 6: Ablation study on word and sentence alignment performance under different training strategies and embedding models.
Modelzh-ende-enfr-en
Additive Training Stages
mGTE-MLM-Base43.028.314.5
mGTE-MLM-Base + S.119.616.45.8
mGTE-MLM-Base + S.1 + S.214.312.83.4
mGTE-MLM-Base + S.1 + S.2 + S.38.511.02.7
Subtractive Training Stages
OmniAlign w/o S.314.312.83.4
OmniAlign w/o S.28.611.12.7
OmniAlign w/o S.18.711.52.9
OmniAlign8.511.02.7
(a) Word alignment AER (%). Lower is better. Within each block, the best result is bolded and the second-best one is underlined.
Modelzh-ende-enfr-en
Additive Training Stages
mGTE-MLM-Base43.028.314.5
mGTE-MLM-Base + S.119.616.45.8
mGTE-MLM-Base + S.1 + S.214.312.83.4
mGTE-MLM-Base + S.1 + S.2 + S.38.511.02.7
Subtractive Training Stages
OmniAlign w/o S.314.312.83.4
OmniAlign w/o S.28.611.12.7
OmniAlign w/o S.18.711.52.9
OmniAlign8.511.02.7
(b) Sentence alignment F1 scores. Higher is better. For each language pair, the best result is bolded and the second-best one is underlined.
Method#ParamsEmb. Dim.en-zhen-esen-it
DP + LaBSE0.47B7680.9720.9040.979
DP + multilingual-e5-large-instructE99 9 https://huggingface.co/intfloat/multilingual-e5-large-instruct0.56B10240.8950.8990.972
DP + bge-m31010 10 https://huggingface.co/BAAI/bge-m30.57B10240.9330.9100.978
DP + Qwen3-Embedding-0.6B1111 11 https://huggingface.co/Qwen/Qwen3-Embedding-0.6B0.6B10240.9390.9050.971
DP + Qwen3-Embedding-8B1212 12 https://huggingface.co/Qwen/Qwen3-Embedding-8B8B40960.9350.9080.975
DP + gte-multilingual-base1313 13 https://huggingface.co/Alibaba-NLP/gte-multilingual-base0.31B7680.9270.9080.973
DP + OmniAlign (w/o S.4)0.31B7680.7160.8720.966
DP + OmniAlign (distilled from LaBSE)0.31B7680.9700.9060.978
Table 7: Word alignment AER (%) at different layers for various base models. Within each model group, the best result is bolded.
ModelLayerzh-ende-enfr-en
mBERT620.519.46.5
719.016.65.6
818.115.25.4
mGTE-MLM-Base654.833.718.0
743.028.314.5
847.530.116.0
mGTE-MLM-Base + S.1628.421.26.9
719.616.45.8
822.819.16.4
Table 8: Word alignment performance under increasing input lengths. The zh-en-n setting denotes long-text inputs constructed by concatenating n samples from the original zh-en test set. Notably, zh–en–50 reaches 1,850 tokens.
Modelzh-en-1zh-en-3zh-en-5zh-en-10zh-en-20zh-en-50
Awesome-Align13.313.915.124.8
ACC-Align11.512.515.828.1
BinaryAlign (Bilingual)4.89.622.8
OmniAlign (Ours)8.58.68.69.210.512.6
Table 9: Alignment performance of OmniAlign and baselines on unseen language pairs
Test SetAccAlignBinaryAlignOmniAlign
bg-en11.011.9910.6
da-en7.18.457.1
et-en15.215.6714.4
hu-en18.716.9319.1
nl-en4.65.144.5
sl-en14.916.8514.7
Table 10: Case studies of OmniAlign and other sequence alignment methods. Blue indicates correct alignments, red denotes incorrect alignments, and black marks segments with no alignment.
Scenario 1: Word Alignment
Example #1He had to repeatedly traverse the inner palace’s chambers, yet each attempt ended in failure.
Testing Points“failure”.
OmniAlign他得不断地一再地穿过内宫里的屋子;可是他一直没有成功。
OmniAlign w/o S.1他得不断地一再地穿过内宫里的屋子;可是他一直没有成功。
Example #2已知有血液疾病及尿酸性肾结石的患者不推荐使用本品,二岁以下儿童不得服用。
Testing Points有; 二岁
OmniAlignThis product is not recommended for patients with known blood disorders or uric acid kidney stones, and it should not be taken by children under the age of two.
BinaryAlignThis product is not recommended for patients with known blood disorders or uric acid kidney stones, and it should not be taken by children under the age of two.
Example #3I recently returned to d2 after several year, now I’m windering: Where do you guys sell/buy your stuff? Do you just make a game “O xxx N yyy” and hope for the best? Or are there a website that’s more efficient?
Testing Pointsreturned; windering
OmniAlign时隔多年,我又 重新开始玩《暗黑破坏神2》(DiabloII),现在我 想知道:大家都是在哪里进行物品交易的?是通过自己创建名为“OxxxNyyy”的游戏房间来交易,然后听天由命吗?还是有更高效的交易网站?
BinaryAlign时隔多年,我又重新开始玩《暗黑破坏神2》(DiabloII),现在我想知道:大家都是在哪里进行物品交易的?是通过自己创建名为“OxxxNyyy”的游戏房间来交易,然后听天由命吗?还是有更高效的交易网站?
Example #4在技术演进的脉络中,预训练模型的出现无疑是里程碑式的突破。以 BERT、GPT、T5 等为代表的模型通过在海量无标注文本上进行自监督学习,习得语言的深层语义表示和语法结构,极大地提升了下游任务的性能上限。这些模型基于 Transformer 架构的多头注意力机制,能够捕捉文本中的长距离依赖关系和上下文关联,为文本分类、情感分析、机器翻译、问答系统等经典任务提供了强大的通用能力。近年来,多语言预训练模型(如 XLM-R、mT5、LaBSE)进一步打破了语言壁垒,通过对数百种语言的联合训练,实现了跨语言文本的理解与生成,为全球化信息传播和跨文化交流提供了技术支撑。在产业应用层面,NLP 技术已渗透到金融、医疗、教育、传媒等多个领域,催生了一系列创新产品和服务。在金融行业,智能客服系统能够基于用户的自然语言查询快速提供账户咨询、业务办理等服务,平均响应时间缩短至秒级,客户满意度提升 30% 以上;风险控制模型通过分析企业年报、新闻舆情等文本数据,精准识别信用风险和市场波动信号,帮助金融机构降低不良贷款率。在医疗领域,医学文本分析系统可自动提取电子病历中的关键信息(如病症、用药史、检查结果),辅助医生进行诊断决策,减少误诊率;多语言医疗翻译工具则为跨境医疗合作提供了语言保障,使不同国家的医护人员能够高效协作。在教育领域,智能写作辅助系统能够实时检测文本中的语法错误、逻辑漏洞,并提供优化建议,帮助学生提升写作能力;个性化学习平台通过分析学生的学习行为和文本交互数据,精准推送适配的学习资源,实现 “因材施教” 的 教育理念。
Testing Points(Bert、GPT、T5); (多头注意力机制); (文本分类、情感分析、机器翻译、问答系统); (XLM-R、mT5、LaBSE); (创新产品和服务); (智能客服系统); (风险控制模型); (多语言医疗翻译工具); (实时检测); (学习行为和文本交互数据); (教育理念)
OmniAlignIn the context of technological evolution, the emergence of pre-trained models is undoubtedly a milestone breakthrough. Represented by BERT, GPT, T5, and other models, they acquire deep semantic representations and syntactic structures of language through self-supervised learning on massive unlabeled text, greatly raising the performance ceiling of downstream tasks. Based on the multi-head attention mechanism of the Transformer architecture, these models can capture long-distance dependencies and contextual correlations in text, providing powerful general capabilities for classic tasks such as text classification, sentiment analysis, machine translation, and question-answering systems. In recent years, multilingual pre-trained models (e.g., XLM-R, mT5, LaBSE) have further broken down language barriers. Through joint training on hundreds of languages, they have realized the understanding and generation of cross-lingual text, providing technical support for global information dissemination and cross-cultural communication. At the industrial application level, NLP technology has penetrated into multiple fields such as finance, healthcare, education, and media, spawning a series of innovative products and services. In the financial industry, intelligent customer service systems can quickly provide account consultations, business processing, and other services based on users’ natural language queries, reducing the average response time to seconds and increasing customer satisfaction by more than 30%; risk control models accurately identify credit risks and market fluctuation signals by analyzing text data such as corporate annual reports and news public opinion, helping financial institutions reduce the non-performing loan ratio. In the healthcare field, medical text analysis systems can automatically extract key information from electronic medical records (such as symptoms, medication history, and examination results) to assist doctors in diagnostic decisions and reduce the misdiagnosis rate; multilingual medical translation tools provide language guarantees for cross-border medical cooperation, enabling medical staff from different countries to collaborate efficiently. In the education field, intelligent writing assistance systems can real-time detect grammatical errors and logical flaws in text, and provide optimization suggestions to help students improve their writing skills; personalized learning platforms accurately push adaptive learning resources by analyzing students’ learning behaviors and text interaction data, realizing the educational concept of "teaching students in accordance with their aptitude".
BinaryAlignIn the context of technological evolution, the emergence of pre-trained models is undoubtedly a milestone breakthrough. Represented by BERT, GPT, T5, and other models, they acquire deep semantic representations and syntactic structures of language through self-supervised learning on massive unlabeled text, greatly raising the performance ceiling of downstream tasks. Based on the multi-head attention mechanism of the Transformer architecture, these models can capture long-distance dependencies and contextual correlations in text, providing powerful general capabilities for classic tasks such as text classification, sentiment analysis, machine translation, and question-answering systems. In recent years, multilingual pre-trained models (e.g., XLM-R, mT5, LaBSE) have further broken down language barriers. Through joint training on hundreds of languages, they have realized the understanding and generation of cross-lingual text, providing technical support for global information dissemination and cross-cultural communication. At the industrial application level, NLP technology has penetrated into multiple fields such as finance, healthcare, education, and media, spawning a series of innovative products and services. In the financial industry, intelligent customer service systems can quickly provide account consultations, business processing, and other services based on users’ natural language queries, reducing the average response time to seconds and increasing customer satisfaction by more than 30%; risk control models accurately identify credit risks and market fluctuation signals by analyzing text data such as corporate annual reports and news public opinion, helping financial institutions reduce the non-performing loan ratio. In the healthcare field, medical text analysis systems can automatically extract key information from electronic medical records (such as symptoms, medication history, and examination results) to assist doctors in diagnostic decisions and reduce the misdiagnosis rate; multilingual medical translation tools provide language guarantees for cross-border medical cooperation, enabling medical staff from different countries to collaborate efficiently. In the education field, intelligent writing assistance systems can real-time detect grammatical errors and logical flaws in text, and provide optimization suggestions to help students improve their writing skills; personalized learning platforms accurately push adaptive learning resources by analyzing students’ learning behaviors and text interaction data, realizing the educational concept of "teaching students in accordance with their aptitude".
Scenario 2: Sentence Alignment
Example #1Source (1) Their Australian born captain, the world’s top-ranked match racer Peter Gilmour, lived in Japan for three years to satisfy the Cup’s crew-nationality rules. (2) Syndicate head Tatsumitsu Yamasaki, chairman of spice giant S&B Foods, is hungry for a win. Target (1) 该船队的船长为世界顶尖帆船赛选手皮得·吉尔摩。 (2) 为了达到杯赛在船员国籍方面的各项要求,这位出生在澳大利亚的选手在日本居住了3年。 (3) 山崎达光是一家财团的总裁兼调味品行业的巨人S&B食品株式会社董事会主席。 (4) 他渴望日本船队能够获得胜利。
OmniAlign[(1)]:[(1), (2)]; [(2)]:[(3), (4)]
BertAlign[(1)]:[(1), (2)]; [(2)]:[(3)]; []:[(4)]
Example #2Source (1) Then came the hard part: getting people to want to see the thing. (2) Here’s how they did it, from whisper to buzz to big box-office noise, in only 21 steps. Target (1) 随后进入最艰苦的宣传炒作阶段。 (2) 下面就是他们的宣传炒作步骤:刚开始知者甚少,随后观众渐增,最后票房炙手可热。 (3) 这一成绩的取得仅需21步:。
OmniAlign[(1)]:[(1), (2)]; [(2)]:[(2), (3)]
BertAlign[(1), (2)]:[(1), (2), (3)]
Example #3Source (1) The situation in Japan has to change. " (2) At Nissan, it already has. Target (1) 这种形势必须改变。 (2) 在日产,这种变革已经开始。
OmniAlign[(1)]:[(1)]; [(2)]:[(2)]
BertAlign[(1), (2)]:[(1), (2)]
Example #4Source (1) 就在这种情况下,我想起十五队的队医陈清扬是北医大毕业的大夫,对针头和勾针大概还能分清,所以我去找她看病。 (2) 看完病回来,不到半个小时,她就追到我屋里来,要我证明她不是破鞋。 Target (1) Under the circumstances, I recalled that the doctor at the fifteenth team, Chen Qingyang, had graduated from Beijing Medical School. (2) Maybe she would be able to tell the difference between a hypodermic and a crotchet needle. (3) So I went to see her. (4) Not half an hour after my visit, she chased after me to my room, wanting me to prove that she wasn’t damaged goods.
OmniAlign[(1)]:[(1), (2), (3)]; [(2)]:[(4)]
BertAlign[(1)]:[(1), (2)]; [(2)]:[(3), (4)]

왜 중요한가

번역 말뭉치 구축, 컴퓨터 보조 번역의 번역 메모리 생성, 언어 간 정보 이전 등 실무에서 단어·문장 정렬은 필수 기반 작업인데, 지금까지는 용도별로 서로 다른 도구를 유지해야 했다. 하나의 가벼운 모델로 다국어·장문·양쪽 단위 정렬을 모두 처리할 수 있다면 시스템 유지 비용과 복잡도를 크게 줄일 수 있다.

이 논문의 용어

  • 단어 정렬(word alignment) · 서로 다른 언어 문장에서 어떤 단어가 어떤 단어에 대응하는지 찾는 작업
  • 문장 정렬(sentence alignment) · 두 언어 문서에서 어떤 문장(들)이 어떤 문장(들)과 대응하는지 찾는 작업, 한 문장이 여러 문장과 대응하는 경우도 포함
  • 인코더 전용 모델(encoder-only) · 입력 문장을 문맥을 반영한 벡터로 변환하는 데 특화된 트랜스포머 구조, 문장을 생성하지 않고 이해에 집중
  • 동적계획법(dynamic programming) · 여러 선택지 중 최적 경로를 효율적으로 찾는 알고리즘 기법
  • 지식 증류(knowledge distillation) · 크고 성능 좋은 교사 모델의 출력을 학생 모델이 따라 배우게 하여 작은 모델도 비슷한 능력을 갖추게 하는 학습법
  • AER(Alignment Error Rate) · 단어 정렬 결과가 정답과 얼마나 다른지 나타내는 오류율, 낮을수록 좋음

저자 · Mengpeng Yang, Jingxu Yang, Chao Chen, Tian Xia, Yabo Sun, Qiang Liu

arXiv에서 원문 보기

최신 논문

논문 전체 보기 →

METAL MEDIA 최신 기사

그림 출처: Mengpeng Yang et al., arXiv:2608.18474, CC BY 4.0