Message Understanding Conference (MUC) 7

Description

Message Understanding Conference (MUC) 7 was produced by Linguistic Data Consortium (LDC) catalog number LDC2001T02 and ISBN 1-58563-205-8. In the 1990s, the MUC evaluations have funded the development of metrics and statistical algorithms to support government evaluations of emerging information extraction technologies. Additional information from NIST can be found at http://www.itl.nist.gov/iaui/894.02/related_projects/muc.

The following list shows the correspondence between versions of the IE task Vefinition and stages of the MUC-7 evaluation.

The dryrun and formalrun have different domains; the dryrun (and training) consists of aircrashes scenarios and the formalrun consists of missile launches scenarios. The final version updates especially the Template Relations portion of the guidelines.

Normally for each scenario two datasets are provided: training and test. When the evaluation cycle begins, the labe l for the scenario dataset is training then the corresponding test dataset for that same scenario is used for the dryrun testing. For the formal run, a formal training set is given out 4 weeks before the test answers are due in. The formal test is given out one week before the test answers are due. After the entire evaluation and meeting have been held, final edits are made if necessary

Features

• URL: http://www.itl.nist.gov/iaui/894.02/related_projects/muc
• LDC: http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2001T02
• Data Type: text
• Data Source(s): newswire
• Project(s): MUC, TIDES
• Application(s): message understanding
• Language(s): English
• Distribution: download
• Membership Year(s): 2001
• Non-member Price: US$100
• Non-member License: yes

see also: MucSixCorpus, MucSixAddonCorpus

-- MichaelDaum -- 11 Nov 2003