Title
An empirical approach to temporal reference resolution
Abstract
Scheduling dialogs, during which people negotiate the times of appointments, are common in everyday life. This paper reports the results of an in-depth empirical investigation of resolving explicit temporal references in scheduling dialogs. There are four phases of this work: data annotation and evaluation, model development, system implementation and evaluation, and model evaluation and analysis. The system and model were developed primarily on one set of data, and then applied later to a much more complex data set, to assess the generalizability of the model for the task being performed. Many different types of empirical methods are applied to pinpoint the strengths and weaknesses of the approach. Detailed annotation instructions were developed and an intercoder reliability study was performed, showing that naive annotators can reliably perform the targeted annotations. A fully automatic system has been developed and evaluated on unseen test data, with good results on both data sets. We adopt a pure realization of a recency-based focus model to identify precisely when it is and is not adequate for the task being addressed. In addition to system results, an in-depth evaluation of the model itself is presented, based on detailed manual annotations. The results are that few errors occur specifically due to the model of focus being used, and the set of anaphoric relations defined in the model are low in ambiguity for both data sets.
Year
DOI
Venue
1997
10.1613/jair.523
Clinical Orthopaedics and Related Research
Keywords
DocType
Volume
empirical approach,recency-based focus model,complex data,data annotation,model evaluation,system implementation,temporal reference resolution,model development,automatic system,in-depth evaluation,unseen test data
Journal
9
Issue
ISSN
Citations 
1
1076-9757
27
PageRank 
References 
Authors
7.73
20
4
Name
Order
Citations
PageRank
Janyce Wiebe16357700.59
Thomas P. O'hara221154.81
Thorsten Öhrström-sandgren3278.06
Kenneth J. Mckeever43712.82