Natural Language Engineering

Table of Contents - 2002 - Volume 8, Issue 04  


Evaluating lexical resources using SENSEVAL 1

NICOLETTA CALZOLARI a1, CLAUDIA SORIA a1, FRANCESCA BERTAGNA a1 and FRANCESCO BARSOTTI a2
a1 Istituto di Linguistica Computazionale-CNR, Via Moruzzi 1, 56100 Pisa, Italy e-mail: glottolo@ilc.cnr.it, claudia.soria@ilc.cnr.it, francesca.bertagna@ilc.cnr.it
a2 Università di Pisa, Via S. Maria 36, 56100 Pisa, Italy e-mail: francesco.barsotti@ilc.cnr.it

Abstract

The aim of our paper is twofold: to introduce some general reflections on the task of lexical semantic annotation and the adequacy of existing lexical-semantic reference resources, while giving an overall description of the Italian lexical sample task for the SENSEVAL-2 experiment. We suggest how the SENSEVAL exercise (and comparison between the two editions of the experiment) can be employed to evaluate the lexical reference resources used for annotation. We conclude with a few general remarks on the gap between the lexicon, a partially decontextualised object, and the corpus, where context plays a significant role.

(Received November 12 2001)
(Revised July 13 2002)


Footnotes

1 We would like to thank Adam Kilgarriff for all his help, two anonymous referees for their comments and also Paolo Allegrini and Roldano Cattoni for their assistance.