Constraint Grammar As a Hand-Crafted Transformer

Forskningsoutput: KonferensbidragKonferenspapperPeer review

Sammanfattning

The differences between the rule-based NLP such as CG and the deep neural networks, such as the Transformer (Vaswani et al., 2017) are so striking that it is really hard to see any relevant conceptual links between them. However, this paper sketches a thought experiment that assumes an equivalent input-output behaviour by both systems and aligns certain structural aspects of the computation behind a practical Constraint Grammar with the computation structure of Transformer. Based on this scene, several findings are presented that state some functional similarities in the computation graphs of the systems.
Bidragets översatta titelRajoitekielioppi käsintehtynä Transformer-verkkona
Originalspråkengelska
StatusPublicerad - 2019
MoE-publikationstypEj behörig
EvenemangNoDaLiDa 2019 workshop on Constraint Grammar - Methods, Tools, and Applications - University of Turku, Turku, Finland
Varaktighet: 30 sep. 201930 sep. 2019
https://visl.sdu.dk/nodalida2019.html

Workshop

WorkshopNoDaLiDa 2019 workshop on Constraint Grammar - Methods, Tools, and Applications
Förkortad titelCG 2019
Land/TerritoriumFinland
OrtTurku
Period30/09/201930/09/2019
Internetadress

Vetenskapsgrenar

  • 113 Data- och informationsvetenskap
  • 6121 Språkvetenskaper

Citera det här