ACL RD-TEC 1.0 Summarization of A92-1023
Paper Title:
A PRACTICAL METHODOLOGY FOR THE EVALUATION OF SPOKEN LANGUAGE SYSTEMS
A PRACTICAL METHODOLOGY FOR THE EVALUATION OF SPOKEN LANGUAGE SYSTEMS
Authors: Sean Boisen and Madeleine Bates
Primarily assigned technology terms:
- algorithm
- approximation
- atis
- automatic evaluation
- blind testing
- comparative evaluation
- computing
- data collection
- database
- database interface
- database query system
- decoding
- evaluation framework
- hardware
- information system
- interfaces
- matching
- message understanding
- nl system
- query system
- question-answering
- recognition
- relational database
- scoring
- speech recognition
- speech systems
- speech understanding
- spoken language systems
- subjective evaluation
- user interface
Other assigned terms:
- ambiguity
- annotator
- annotators
- approach
- case
- characters
- community
- corpora
- database query
- dialogues
- document
- duration
- error rate
- evaluation architecture
- evaluation data
- evaluation methodology
- evaluations
- fact
- implementation
- intelligence
- interpretation
- intersystem comparison
- likelihood
- linguistic
- logical form
- mapping
- maximal answer
- meaning
- meanings
- measure
- measures
- message
- message understanding conferences
- method
- methodology
- modifier
- muc-3
- names
- natural language
- nist
- portability
- precision
- priori
- probability
- queries
- query
- reference answer
- relation
- representations
- scoring metric
- semantic
- semantic representation
- spoken language
- structural ambiguity
- syntactic constraints
- syntax
- technology
- term
- terms
- test corpora
- test corpus
- test data
- test set
- text
- training
- training data
- training material
- training set
- understanding
- user
- wh-question
- word
