MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki

Timothee Mickus; Stig-Arne Grönroos; Joseph Attieh; Michele Boggia; Ona De Gibert; Shaoxiong Ji; Niki Andreas Loppi; Alessandro Raganato; Raúl Vázquez; Jörg Tiedemann

MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki

Timothee Mickus, Stig-Arne Grönroos, Joseph Attieh, Michele Boggia, Ona De Gibert, Shaoxiong Ji, Niki Andreas Loppi, Alessandro Raganato, Raúl Vázquez, Jörg Tiedemann

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussa › Konferenssiartikkeli › Tieteellinen › vertaisarvioitu

Abstrakti

NLP in the age of monolithic large language models is approaching its limits in terms of size and information that can be handled. The trend goes to modularization, a necessary step into the direction of designing smaller sub-networks and components with specialized functionality. In this paper, we present the MAMMOTH toolkit: a framework designed for training massively multilingual modular machine translation systems at scale, initially derived from OpenNMT-py and then adapted to ensure efficient training across computation clusters.We showcase its efficiency across clusters of A100 and V100 NVIDIA GPUs, and discuss our design philosophy and plans for future information.The toolkit is publicly available online at https://github.com/Helsinki-NLP/mammoth.

Alkuperäiskieli	englanti
Otsikko	Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics : System Demonstrations
Toimittajat	Nikolaos Aletras, Orphee De Clercq
Sivumäärä	10
Julkaisupaikka	Kerrville
Kustantaja	The Association for Computational Linguistics
Julkaisupäivä	1 maalisk. 2024
Sivut	127-136
ISBN (elektroninen)	979-8-89176-091-2
Tila	Julkaistu - 1 maalisk. 2024
OKM-julkaisutyyppi	A4 Artikkeli konferenssijulkaisuussa
Tapahtuma	The 18th Conference of the European Chapter of the Association for Computational Linguistics - St. Julians, Malta Kesto: 17 maalisk. 2024 → 22 maalisk. 2024 Konferenssinumero: 18

Tieteenalat

6121 Kielitieteet
113 Tietojenkäsittely- ja informaatiotieteet

Pääsy asiakirjaan

2024.eacl-demo.14Lopullinen julkaistu versio, 713 KBLisenssi: CC BY

https://aclanthology.org/2024.eacl-demo.14Lisenssi: CC BY

FoTran: Found in Translation - Natural Language Understanding with Cross-Lingual Grounding
Tiedemann, J. (Projektinjohtaja), Attieh, J. (osallistuja), Aulamo, M. (osallistuja), Celikkanat, H. (osallistuja), De Gibert Bonet, O. (osallistuja), Grönroos, S.-A. (osallistuja), Mickus, T. (osallistuja), Raganato, A. (osallistuja), Scherrer, Y. (osallistuja), Silfverberg, M. (osallistuja), Sjöblom, E. I. (osallistuja), Talman, A. (osallistuja), Vazquez , R. (osallistuja), Virpioja, S. P. (osallistuja), Yli-Jyrä, A. (osallistuja), Zosa, E. (osallistuja), Celikkanat, H. (Osallistuja), Raganato, A. (Osallistuja), Silfverberg, M. (Osallistuja), Sulubacak, U. (Osallistuja) & Vazquez , R. (Osallistuja)
01/09/2018 → 31/03/2024
Projekti: EU Horizon 2020: European Research Council: Consolidator Grant (H2020-ERC-COG)

Siteeraa tätä

Mickus, T., Grönroos, S.-A., Attieh, J., Boggia, M., De Gibert, O., Ji, S., Loppi, N. A., Raganato, A., Vázquez, R., & Tiedemann, J. (2024). MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki. teoksessa N. Aletras, & O. De Clercq (Toimittajat), Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations (Sivut 127-136). The Association for Computational Linguistics. https://aclanthology.org/2024.eacl-demo.14

Mickus, Timothee ; Grönroos, Stig-Arne ; Attieh, Joseph et al. / MAMMOTH : Massively Multilingual Modular Open Translation @ Helsinki. Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations. Toimittaja / Nikolaos Aletras ; Orphee De Clercq. Kerrville : The Association for Computational Linguistics, 2024. Sivut 127-136

@inproceedings{3988190b9f05430b81415b392b8dae86,

title = "MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki",

abstract = "NLP in the age of monolithic large language models is approaching its limits in terms of size and information that can be handled. The trend goes to modularization, a necessary step into the direction of designing smaller sub-networks and components with specialized functionality. In this paper, we present the MAMMOTH toolkit: a framework designed for training massively multilingual modular machine translation systems at scale, initially derived from OpenNMT-py and then adapted to ensure efficient training across computation clusters.We showcase its efficiency across clusters of A100 and V100 NVIDIA GPUs, and discuss our design philosophy and plans for future information.The toolkit is publicly available online at https://github.com/Helsinki-NLP/mammoth.",

keywords = "6121 Languages, 113 Computer and information sciences",

author = "Timothee Mickus and Stig-Arne Gr{\"o}nroos and Joseph Attieh and Michele Boggia and {De Gibert}, Ona and Shaoxiong Ji and Loppi, {Niki Andreas} and Alessandro Raganato and Ra{\'u}l V{\'a}zquez and J{\"o}rg Tiedemann",

year = "2024",

month = mar,

day = "1",

language = "English",

pages = "127--136",

editor = "Nikolaos Aletras and {De Clercq}, Orphee",

booktitle = "Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics",

publisher = "The Association for Computational Linguistics",

address = "United States",

note = "Conference of the European Chapter of the<br/>Association for Computational Linguistics, EACL 2024 ; Conference date: 17-03-2024 Through 22-03-2024",

}

Mickus, T , Grönroos, S-A , Attieh, J, Boggia, M, De Gibert, O , Ji, S, Loppi, NA, Raganato, A , Vázquez, R & Tiedemann, J 2024, MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki. julkaisussa N Aletras & O De Clercq (toim), Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations. The Association for Computational Linguistics, Kerrville, Sivut 127-136, The 18th Conference of the European Chapter of the Association for Computational Linguistics, St. Julians, Malta, 17/03/2024. <https://aclanthology.org/2024.eacl-demo.14>

MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki. / Mickus, Timothee ; Grönroos, Stig-Arne ; Attieh, Joseph et al.
Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations. toim. / Nikolaos Aletras; Orphee De Clercq. Kerrville: The Association for Computational Linguistics, 2024. s. 127-136.

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussa › Konferenssiartikkeli › Tieteellinen › vertaisarvioitu

TY - GEN

T1 - MAMMOTH

T2 - Conference of the European Chapter of the<br/>Association for Computational Linguistics

AU - Mickus, Timothee

AU - Grönroos, Stig-Arne

AU - Attieh, Joseph

AU - Boggia, Michele

AU - De Gibert, Ona

AU - Ji, Shaoxiong

AU - Loppi, Niki Andreas

AU - Raganato, Alessandro

AU - Vázquez, Raúl

AU - Tiedemann, Jörg

N1 - Conference code: 18

PY - 2024/3/1

Y1 - 2024/3/1

N2 - NLP in the age of monolithic large language models is approaching its limits in terms of size and information that can be handled. The trend goes to modularization, a necessary step into the direction of designing smaller sub-networks and components with specialized functionality. In this paper, we present the MAMMOTH toolkit: a framework designed for training massively multilingual modular machine translation systems at scale, initially derived from OpenNMT-py and then adapted to ensure efficient training across computation clusters.We showcase its efficiency across clusters of A100 and V100 NVIDIA GPUs, and discuss our design philosophy and plans for future information.The toolkit is publicly available online at https://github.com/Helsinki-NLP/mammoth.

AB - NLP in the age of monolithic large language models is approaching its limits in terms of size and information that can be handled. The trend goes to modularization, a necessary step into the direction of designing smaller sub-networks and components with specialized functionality. In this paper, we present the MAMMOTH toolkit: a framework designed for training massively multilingual modular machine translation systems at scale, initially derived from OpenNMT-py and then adapted to ensure efficient training across computation clusters.We showcase its efficiency across clusters of A100 and V100 NVIDIA GPUs, and discuss our design philosophy and plans for future information.The toolkit is publicly available online at https://github.com/Helsinki-NLP/mammoth.

KW - 6121 Languages

KW - 113 Computer and information sciences

M3 - Conference contribution

SP - 127

EP - 136

BT - Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics

A2 - Aletras, Nikolaos

A2 - De Clercq, Orphee

PB - The Association for Computational Linguistics

CY - Kerrville

Y2 - 17 March 2024 through 22 March 2024

ER -

Mickus T , Grönroos SA , Attieh J, Boggia M, De Gibert O , Ji S et al. MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki. julkaisussa Aletras N, De Clercq O, toimittajat, Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations. Kerrville: The Association for Computational Linguistics. 2024. s. 127-136

MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki

Abstrakti

Tieteenalat

Pääsy asiakirjaan

Projektit

FoTran: Found in Translation - Natural Language Understanding with Cross-Lingual Grounding

Siteeraa tätä