Argument Classification with BERT plus Contextual, Structural and Syntactic Features as Text

Autoři: Jérémie Cabessa
Rok vydání: 2023
Typ publikace: Konferenční příspěvek (mezinárodní konf.)
Periodikum: Neural Information Processing. 29th International Conference, ICONIP 2022, Proceedings, Part VII
Projekty: AppNeCo: Aproximativní neurovýpočty
Bibliografická citace: MUSHTAQ, U., CABESSA, Jérémie. Argument Classification with BERT plus Contextual, Structural and Syntactic Features as Text. In: TANVEER, M., AGARWAL, A., OZAWA, S., EKBAL, A., JATOWT, A., eds. Neural Information Processing. 29th International Conference, ICONIP 2022, Proceedings, Part VII. Singapore: Springer, 2023, S. 622-633. Communications in Computer and Information Science, 1794. ISBN 978-981991647-4. ISSN 1865-0929
Dostupné z: doi:10.1007/978-981-99-1639-9_52.
DOI: 10.1007/978-981-99-1639-9_52
ID: 562585
Online záznam: Zobrazit online záznam

Abstrakt

In Argument Mining (AM), the integral sub-task of argument component classification refers to the classification of argument components as claims or premises. In this context, the content of the component alone does not actually suffice to accurately predict its corresponding class. In fact, additional lexical, contextual, and structural features are needed. Here, we propose a unified model for argument component classification based on BERT and inspired by the new prompting NLP paradigm. Our model incorporates the component itself together with contextual, structural and syntactic features – given as text – instead of the usual numerical form. This new technique enables BERT to build a customized and enriched representation of the component. We evaluate our model on three datasets that reflect a diversity of written and spoken discourses. We achieve state-of-art results on two datasets and 95% of the best results on the third. Our approach shows that BERT is capable of exploiting non-textual information given in a textual form.