UHH>Informatik>NatS>CDG Web>InternalPages>EssentialReading>ParserEvaluation (17 Oct 2012, UnknownUser) Print version
Parser Evaluation
- Bibentries
- Sources
- See also
- Comments
- Dekang Lin (1995): A Dependency-based method for Evaluating Broad-Coverage.
- T. Briscoe and J. Carroll and A. Sanfilippo (1993): Parser evaluation: A survey and a new proposal.
- Sandra Kübler and Heike Telljohann (2002): Towards a Dependency-Based Evaluation for Partial Parsing.
- Simon Clematide (2002) Selektive Evaluation von robusten Parsern (Konvens 2002)
Bibentries
- [KüblerTelljohann02]
- Sandra Kübler and Heike Telljohann. Towards a dependency-based evaluation for partial parsin, 2002. [ .ps.gz ]
- [Clematide02]
- Simon Clematide. Selektive evaluation von robusten parsern, 2002. Konvens 2002. [ .pdf ]
- [Lin95]
-
Dekang Lin.
A dependency-based method for evaluating broad-coverage parsers.
In IJCAI, pages 1420--1427, Montreal, Canada, 1995.
[ .ps.gz ]
Abstract: With the emergence of broad-coverage parsers, quantitative evaluation of parsers becomes increasingly more important. We propose a dependency-based method for evaluating broad-coverage parsers. The method offers several advantages over previous methods that are based on phrase boundaries. The error count score we propose here is not only more intuitively meaningful than other scores, but also more relevant to semantic interpretation. We will also present an algorithm for transforming...",
- [BriscoeEtal93]
- T. Briscoe, J. Carroll, and A. Sanfilippo. Parser evaluation: A survey and a new proposal. In In Proceedings First Conference on Linguistic Resources, pages 447--455, Granada, 1993. [ .ps.gz ]
Total: 4
Sources
- Publications of the SFB 441: http://www.sfb441.uni-tuebingen.de/a1/pub-engl.html
- Citeseer query parser evaluation
- Efficiency in Large-scale Parsing Systems - Parser Comparison: papers available
See also
Comments
Dekang Lin (1995): A Dependency-based method for Evaluating Broad-Coverage.
- claim: in general parsers should be converted to dependecy trees in order to establish a more "intuively meaningful" evaluation measure
- converting constituency trees to dependency trees is presented, so that a uniform evaluation method is applicable for dependency and constituency grammars
- normalization of dependency trees allows to eliminate inconsistencies among different parse trees
T. Briscoe and J. Carroll and A. Sanfilippo (1993): Parser evaluation: A survey and a new proposal.
see also: citeseerSandra Kübler and Heike Telljohann (2002): Towards a Dependency-Based Evaluation for Partial Parsing.
- TüBa-D: "a treebank containing all information to convert trees into dependency structures reliably and linguistically motivated"
Simon Clematide (2002) Selektive Evaluation von robusten Parsern (Konvens 2002)
- Normalisation of PS-trees and extraction of particular linguistic information, namely
- tagging quality for selected categories
- pp-attachment
- subject recognition
- Evaluation results for the Gojol-Parser and LoPar (Schmid 2002)
- Navigation
 |
|
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding Foswiki? Send feedback