Pedro Carvalho Brom

dblp:385/1153 · DBLP profile ↗
← Back
5ranked-venue papers
0as first author
5since 2021 · last 2025
0000-0002-1288-7695ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Applied, interdisciplinary, general and emerging computing · 5 · 5 since 2021
YearPublicationVenuePosition
2025 IMMBA: Integrated Mixed Models with Bootstrap Analysis - A Statistical Framework for Robust LLM Evaluation
Vinícius Di Oliveira, Pedro Carvalho Brom, Weigang Li 0001
WEBIST2
2025 Collective Intelligence with Large Language Models for the Review of Public Service Descriptions on Gov.br
Rafael Marconi Ramos, Pedro Carvalho Brom, João Gabriel de Moraes Souza, Weigang Li 0001, Vinícius Di Oliveira, Silvia Araújo dos Reis, José Francisco Salm Junior, Vérica Freitas, Herbert Kimura, Daniel Oliveira Cajueiro, Gladston Luiz da Silva, Victor Rafael R. Celestino
WEBIST2
2025 Paradox of poetic intent in back-translation: evaluating the quality of large language models in Chinese translation
abstract
Large language models (LLMs) excel in multilingual translation tasks, yet often struggle with culturally and semantically rich Chinese texts. This study introduces the framework of back-translation (BT) powered by LLMs, or LLM-BT, to evaluate Chinese → intermediate language → Chinese translation quality across five LLMs and three traditional systems. We construct a diverse corpus containing scientific abstracts, historical paradoxes, and literary metaphors, reflecting the complexity of Chinese at the lexical and semantic levels. Using our modular NLPMetrics system, including bilingual evaluation understudy (BLEU), character F-score (CHRF), translation edit rate (TER), and semantic similarity (SS), we find that LLMs outperform traditional tools in cultural and literary tasks. However, the results of this study uncover a high-dimensional behavioral phenomenon, the paradox of poetic intent, where surface fluency is preserved, but metaphorical or emotional depth is lost. Additionally, some models exhibit verbatim BT, suggesting a form of data-driven quasi-self-awareness, particularly under repeated or cross-model evaluation. To address BLEU’s limitations for Chinese, we propose a Jieba-segmentation BLEU variant that incorporates word-frequency and n -gram weighting, improving sensitivity to lexical segmentation and term consistency. Supplementary tests show that in certain semantic dimensions, LLM outputs approach the fidelity of human poetic translations, despite lacking a deeper metaphorical intent. Overall, this study reframes traditional fidelity vs. fluency evaluation into a richer, multi-layered analysis of LLM behavior, offering a transparent framework that contributes to explainable artificial intelligence and identifies new research pathways in cultural natural language processing and multilingual LLM alignment.
Weigang Li 0001, Pedro Carvalho Brom
Frontiers Inf. Technol. Electron. Eng.2
2024 Implementing AI for Enhanced Public Services Gov.br: A Methodology for the Brazilian Federal Government
Maísa Kely de Melo, Silvia Araújo dos Reis, Vinícius Di Oliveira, Allan Victor Almeida Faria, Ricardo de Lima, Weigang Li 0001, José Francisco Salm Junior, João Gabriel de Moraes Souza, Vérica Freitas, Pedro Carvalho Brom, Herbert Kimura, Daniel Oliveira Cajueiro, Gladston Luiz da Silva, Victor Rafael R. Celestino
WEBIST10
2024 SLIM-RAFT: A Novel Fine-Tuning Approach to Improve Cross-Linguistic Performance for Mercosur Common Nomenclature
Vinícius Di Oliveira, Yuri Façanha Bezerra, Weigang Li 0001, Pedro Carvalho Brom, Victor Rafael R. Celestino
WEBIST4