+ Heise Experiments

Description

All the version numbers used here are only meaningfull for the evaluation in order to distinguish them here. The version numbers are never reflected in the CVS or anywhere else. The experiments here use the following settings:

• TreeTagger using multitagging, parameter -z200
• tag normalization: unknown tags are ignored, remaining tags propabilities are normalized so that they still sum up to 1.0
• a timelimit of 3 minutes
• no chunking information is added

Grammars

• HeiseGrammar v0.9: This is the last grammar with OBL levels in use. (download)
• HeiseGrammar v0.10: This is the first grammar with non-local constraints in it replacing all the previous OBL levels. (download)

Results

version	flavour	structural recall %	labelled recall %	lexical recall %	total time	solution time	soft time
0.9	frobbing combined	75.26	70.48	64.13	2 d 6 h 17 m 24 s 670 ms	1 d 16 h 14 m 23 s 250 ms	1 d 4 h 23 m 15 s 880 ms
0.9	frobbing dynamic	78.91	74.39	68.63	1 d 9 h 20 m 3 s 420 ms	1 d 2 h 15 m 410 ms	15 h 17 m 21 s 350 ms
0.10	frobbing combined	77.94	73.47	67.15	2 d 3 h 53 m 23 s 10 ms	1 d 10 h 18 m 18 s 560 ms	11 h 35 m 41 s 590 ms
0.10	frobbing dynamic	75.41	70.81	64.84	1 d 6 h 14 m 28 s 440 ms	23 h 30 m 31 s 710 ms	13 h 36 m 46 s 170 ms

-- MichaelDaum - 05 Dec 2002