ACL RD-TEC 1.0 Summarization of H90-1022
Paper Title:
DEVELOPING AN EVALUATION METHODOLOGY FOR SPOKEN LANGUAGE SYSTEMS
DEVELOPING AN EVALUATION METHODOLOGY FOR SPOKEN LANGUAGE SYSTEMS
Authors: Madeleine Bates and Sean Boisen and John Makhoul
Primarily assigned technology terms:
- atis
- automatic evaluation
- black-box evaluation
- classification
- comparative evaluation
- data collection
- database
- databases
- evaluation framework
- evaluation process
- evaluation system
- glass-box
- glass-box evaluation
- information system
- interfaces
- language processing
- matching
- natural language processing
- nl system
- nl understanding
- processing
- quantification
- reading
- recognition
- recognition systems
- speech recognition
- speech recognition systems
- speech understanding
- spoken language systems
- subjective evaluation
- user interface
Other assigned terms:
- ambiguity
- approach
- community
- dialogues
- discourse
- evaluation methodology
- fact
- intelligence
- interpretation
- linguistic
- lisp
- meaning
- meanings
- measure
- method
- methodology
- natural language
- negation
- nist
- process
- queries
- query
- sentence
- sentences
- spoken language
- style
- terms
- test data
- test set
- text
- training
- training data
- training set
- understanding
- user
- user interaction
- words
