Volume 6, Issue 4 (12-2024)
kurmanj 2024, 6(4): 1-5 |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Sadeghzadeh Yazdi F, Hashemi M R. Machine Translation Evaluation Research in Persian-English Language Pair: A Non-Statistical Meta-Analysis. kurmanj 2024; 6 (4) :1-5
URL: http://kurmanj.srpub.org/article-2-231-en.html
URL: http://kurmanj.srpub.org/article-2-231-en.html
1- Department of English Language and Literature, Ferdowsi University of Mashhad, Iran , sadeghizadeh@fum.ac.ir
2- Department of English Language and Literature, Ferdowsi University of Mashhad, Iran
2- Department of English Language and Literature, Ferdowsi University of Mashhad, Iran
Abstract: (240 Views)
It seems an established fact that machine translation has proved its unique utility capacities for global communication. However, evaluating the quality and performance of MT has been and still is a challenge, especially in Persian-English language pairs. Against this background this article examines the current state of research on machine translation evaluation of such pairs. The study reviewed research on evaluating Persian-English MT published since the so-called “neural turn”, searching academic databases using keywords, using a coding framework based on strengths, weaknesses, challenges, and limitations of MT systems, and categorizing information like identified weaknesses and proposed improvements. The results reported in this study include: a) a lack of systematic research due to limited industrial developers in Iran, b) academic disinterest, and c) a need for tailored metrics. Finally, the results will be discussed and suggestions will be provided and areas for future research will be mentioned.
Keywords: Translation accuracy, Translation adequacy, Neural machine translation, Machine translation evaluation
Humanities: Research |
Subject:
English language
Received: 2024/07/13 | Revised: 2024/11/27 | Accepted: 2024/12/18 | Published: 2024/12/25
Received: 2024/07/13 | Revised: 2024/11/27 | Accepted: 2024/12/18 | Published: 2024/12/25
References
1. Koehn P. Statistical machine translation. Cambridge ; New York: Cambridge University Press; 2010. 433 p.
2. Hutchins WJ. Machine Translation: A Brief History. In: Concise History of the Language Sciences Internet.. Elsevier; 1995 cited 2022 Oct 2.. p. 431-45. Available from: https://linkinghub.elsevier.com/retrieve/pii/B9780080425801500660 [DOI:10.1016/B978-0-08-042580-1.50066-0]
3. Oladosu J, Esan A, Adeyanju I, Adegoke B, Olaniyan O, Omodunbi B. Approaches to Machine Translation: A Review. FUOYE J Eng Technol Internet.. 2016 Sep 30 cited 2023 Aug 9.;1(1). Available from: https://journal.engineering.fuoye.edu.ng/index.php/engineer/article/view/26 [DOI:10.46792/fuoyejet.v1i1.26]
4. Olive JP, Christianson C, McCary J, editors. Handbook of natural language processing and machine translation: DARPA global autonomous language exploitation. New York: Springer; 2011. 936 p. [DOI:10.1007/978-1-4419-7713-7]
5. Nunes Vieira L. Post-Editing of Machine Translation. In 2019. p. 319-35. [DOI:10.4324/9781315311258-19]
6. Sanchez-Torron M, Koehn P. Machine Translation Quality and Post-Editor Productivity. In: Conferences of the Association for Machine Translation in the Americas: MT Researchers' Track Internet.. Austin, TX, USA: The Association for Machine Translation in the Americas; 2016 cited 2023 Aug 27.. p. 16-26. Available from: https://aclanthology.org/2016.amta-researchers.2
7. Alvarez S, Oliver A, Badia T. Quantitative Analysis of Post-Editing Effort Indicators for NMT. In: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation Internet.. Lisboa, Portugal: European Association for Machine Translation; 2020 cited 2023 Aug 26.. p. 411-20.Available from:
https://aclanthology.org/2020.eamt-1.44
8. Koehn P. Neural Machine Translation Internet.. 1st ed. Cambridge University Press; 2020 cited 2023 Feb 13..Available from:
https://www.cambridge.org/core/product/identifier/9781108608480/type/book
9. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is All you Need. In: Advances in Neural Information Processing Systems Internet.. Curran Associates, Inc.; 2017 cited 2023 Aug 10.. Available from: https://proceedings.neurips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html
10. Marie B, Fujita A, Rubino R. Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers Internet.. arXiv; 2021 cited 2023 Dec 6.. Available from: http://arxiv.org/abs/2106.15195
11. Absalan SMJ. Comparing the output quality of Bing, Abadis and Farazin translation machines according to Dugast's model. Kerman Institute of Higher Education; 2020.
12. Ashrafi A. Investigation of Two Types of Machines Translations Google and Targman in Five Scientific Disciplines based on BLEU Model. 2022 Dec 4;9.
Send email to the article author
| Rights and permissions | |
 |
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |