ACL RD-TEC 1.0 Summarization of H92-1006
Paper Title:
SUBJECT-BASED EVALUATION MEASURES FOR INTERACTIVE SPOKEN LANGUAGE SYSTEMS
SUBJECT-BASED EVALUATION MEASURES FOR INTERACTIVE SPOKEN LANGUAGE SYSTEMS
Authors: Patti Price and Lynette Hirschman and Elizabeth Shriberg and Elizabeth Wade
Primarily assigned technology terms:
- atis
- classification
- complementary evaluation
- data analysis
- data collection
- database
- database access
- evaluation procedure
- hardware
- interactive dialogue
- language understanding
- learning
- logfile evaluation
- matching
- measuring
- natural language understanding
- natural-language understanding
- problem solving
- prolog
- pruning
- recognition
- recognition system
- recognition system \
- recognizer
- reporting
- resource management
- response generation
- software sharing
- speech recognition
- speech recognition evaluation
- speech recognition system
- spoken language system
- spoken language systems
- spoken language understanding
- template matcher
- user interface
Other assigned terms:
- annotation
- approach
- benchmark
- benchmark system
- canned corpus
- case
- clarification dialogue
- coherence
- community
- conversation
- correlation
- data structures
- diagnostic error
- dialogue context
- dialogues
- duration
- error rate
- evaluation measures
- evaluation methodology
- evaluation metrics
- evaluation paradigm
- evaluations
- generation
- hypotheses
- interpretation
- lisp
- maximal answer
- measure
- measures
- mechanisms
- message
- method
- methodology
- natural language
- natural-language
- opinions
- portability
- predictive power
- procedure
- queries
- query
- questionnaire
- recognition evaluation
- sentence
- sentences
- spoken input
- spoken language
- system response
- technology
- transcriptions
- understanding
- user
- user satisfaction
- utterance
- vocabulary
- word
- word error rate
