Everything K-culture — comebacks to K-beauty, straight to your inboxGet it in your inbox

METAL MEDIA

Language Models for Portuguese: A Systematic Mapping Study

arXiv:2608.181382026-08-20

A full map of 46 Portuguese-language AI models, built for the first time

Researchers at UNICAMP (Brazil) systematically surveyed 46 language models for Portuguese published between 2020 and August 2025. They catalogued each model's base model, architecture, training data, license, and whether code, data, and weights were released, then traced how the models descended from one another in a phylogenetic tree. The study also found major gaps, such as very few papers discussing ethical considerations or limitations.

METAL MEDIA explanatory visual

A full map of 46 Portuguese-language AI models, built for the first time

  1. 01Using a systematic mapping method combined with snowballing (tracing citations forward and backward from known papers), the team scanned academic papers, technical reports, and model repository documentation to find 46 models
  2. 02Searches across Scopus, IEEEXplore, Web of Science, and arXiv returned 519 papers; after deduplication and screening, 32 models were found first, then snowballing added 14 more for a total of 46
  3. 03Each model was classified by base model (BERT, T5, GPT, Llama, Mistral, Gemma, Phi, Qwen, etc.), purpose (general or domain-specific, including legal, medical, finance, Twitter, government, and oil-and-gas), parameter count, license, and training data
  4. 04Scoring documentation quality across 11 criteria, the average score was 7.5 out of 11; the weakest areas were describing ethical considerations (0.07), qualitative result analysis (0.14), and study limitations (0.28)
  5. 05Brazil led with 35 models and Portugal followed with 10; among institutions, Brazilian public universities USP (7 models) and UNICAMP (6 models) led, followed by the company Maritaca AI (5 models)
An explanatory diagram made by METAL MEDIA, not a figure supplied by the paper's authors.

What they did

  1. Using a systematic mapping method combined with snowballing (tracing citations forward and backward from known papers), the team scanned academic papers, technical reports, and model repository documentation to find 46 models
  2. Searches across Scopus, IEEEXplore, Web of Science, and arXiv returned 519 papers; after deduplication and screening, 32 models were found first, then snowballing added 14 more for a total of 46
  3. Each model was classified by base model (BERT, T5, GPT, Llama, Mistral, Gemma, Phi, Qwen, etc.), purpose (general or domain-specific, including legal, medical, finance, Twitter, government, and oil-and-gas), parameter count, license, and training data
  4. Scoring documentation quality across 11 criteria, the average score was 7.5 out of 11; the weakest areas were describing ethical considerations (0.07), qualitative result analysis (0.14), and study limitations (0.28)
  5. Brazil led with 35 models and Portugal followed with 10; among institutions, Brazilian public universities USP (7 models) and UNICAMP (6 models) led, followed by the company Maritaca AI (5 models)

Why it matters

For a language like Portuguese that has traditionally had fewer resources than English, information about its AI models was scattered across papers, technical reports, and repositories, making the field hard to grasp as a whole. This survey gives developers and researchers working on Portuguese AI a clear map of what exists and where the gaps are.

Terms in this paper

  • snowballing · a literature search method that follows citations backward and forward from known relevant papers to find more
  • systematic mapping study · a research method that surveys and classifies literature on a topic using a defined, repeatable procedure
  • phylogeny · a tree-like diagram showing which models were built from which earlier models
  • Model Card · a document that summarizes a model's architecture, training data, and usage

Original abstract (English)

In recent years, the rapid development of language models has transformed the field of Natural Language Processing through a wide range of applications. However, the development of language models has not progressed uniformly across all languages. In the case of the Portuguese language, there has recently been a growing effort by academia and companies to develop language models and create data resources for Portuguese. These efforts have resulted in the rise of an increasingly diverse ecosystem of language models for Portuguese. However, information on these models remains dispersed in scientific publications, technical reports, model repositories, and project documentation. This survey presents a systematic mapping study of language models developed for Portuguese, providing a comprehensive overview of the current state of the field. We map a total of 46 models, characterizing them by various aspects, including base model, architecture, computational resources, training datasets, licensing, code availability, data, and model weights. Furthermore, we analyzed the evolution and relationships among these models through a phylogenetic perspective, identified current research gaps and opportunities, and discussed future directions for the development of language models for Portuguese.

Authors · Jhessica Silva, Carlos Caetano, Helena Maia, Breno Bernard Nicolau de Fran\c{c}a, Sandra Avila, Helio Pedrini

Read on arXiv

Latest papers

All papers →

Latest from METAL MEDIA