Logo image
Multiword Expression aware Neural Machine Translation
Conference proceeding   Open access   Peer reviewed

Multiword Expression aware Neural Machine Translation

Andrea Zaninello and A Birch
Proceedings of the Twelfth Language Resources and Evaluation Conference, pp.3816-3825
2020
Handle:
https://hdl.handle.net/10863/50905

Abstract

Multiword Expressions (MWEs) are a frequently occurring phenomenon found in all natural languages that is of great importance to linguistic theory, natural language processing applications, and machine translation systems. Neural Machine Translation (NMT) architectures do not handle these expressions well and previous studies have rarely addressed MWEs in this framework. In this work, we show that annotation and data augmentation, using external linguistic resources, can improve both translation of MWEs that occur in the source, and the generation of MWEs on the target, and increase performance by up to 5.09 BLEU points on MWE test sets. We also devise a MWE score to specifically assess the quality of MWE translation which agrees with human evaluation. We make available the MWE score implementation {--} along with MWE-annotated training sets and corpus-based lists of MWEs {--} for reproduction and extension.
pdf
2020.lrec-1.471DownloadView
Open Access
url
https://aclanthology.org/2020.lrec-1.471/View

Details

Metrics

1 Record Views
Logo image