Currently browsing: Items authored or edited by Jacopo Amidei https://orcid.org/0000-0002-8846-252X

Amidei, J.; Ertola-Biraben, R. C. and Montagna, F. (2022). Conservative expansions of substructural logics. In: Galatos, Nikolaos and Terui, Kazushige eds. Hiroakira Ono on Substructural Logics. Outstanding Contributions to Logic, 23. Springer, pp. 339–368.

Amidei, Jacopo; Piwek, Paul and Stoyanchev, Svetlana (2021). QTMM2012c+: A Queryable Empirically- Grounded Resource of Dialogue with Argumentation. In: 5th Workshop on Advances in Argumentation in Artificial Intelligence, 29 Nov 2021, Online event.

• Download Published Version (PDF / 723kB)

Amidei, Jacopo (2021). Evaluating the Evaluators: Subjective Bias and Consistency in Human Evaluation of Natural Language Generation. PhD thesis The Open University.

• Download Final Version (PDF / 2MB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2020). Identifying Annotator Bias: A new IRT-based method for bias identification. In: Proceedings of The 28th International Conference on Computational Linguistics (COLING), 8-13 Dec 2020, Barcelona, Spain, pp. 4787–4797.

• Download Accepted Manuscript (PDF / 346kB)

Amidei, Jacopo; Andrews, Uri; Pianigiani, Duccio; San Mauro, Luca and Sorbi, Andrea (2019). Trial and error mathematics: Dialectical systems and completions of theories. Journal of Logic and Computation, 29(1) pp. 157–184.

• Download Accepted Manuscript (PDF / 528kB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2019). Agreement is overrated: A plea for correlation to assess human evaluation reliability. In: Proceedings of the 12th International Conference on Natural Language Generation, 29 Oct - 1 Nov 2019, Tokyo, Japan.

• Download Published Version (PDF / 543kB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2019). The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations. In: Proceedings of the 12th International Conference on Natural Language Generation, 29 Oct - 1 Nov 2019, Tokyo, Japan.

• Download Published Version (PDF / 354kB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2018). Evaluation methodologies in Automatic Question Generation 2013-2018. In: Proceedings of The 11th International Natural Language Generation Conference, 5-8 Nov 2018, Tilburg, The Netherlands, pp. 307–317.

• Download Published Version (PDF / 267kB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2018). Rethinking the Agreement in Human Evaluation Tasks. In: Proceedings of the 27th International Conference on Computational Linguistics, 20-26 Aug 2018, Santa Fe, New Mexico, pp. 3318–3329.

• Download Published Version (PDF / 170kB)