Session "Evaluation"

• Notes taken by Kris

• Evaluation:
  • there is more than user studies
  • effectiveness vs. joy-of-use
• Quantitative vs. qualitative methods, a mix of methods is likely ideal
• Spoken Dialog Challenge
  • Let's Go bus information system (Pittsburgh): corpus-based system
  • one option for comparative evaluations
• influences of expectations on evaluation
• influences of participant sampling, difficulty of representative participant selection
• http://www.cs.uta.fi/~tko/Tutkimus/hci/spi/reports/SESDSUSM.pdf