ACL RD-TEC 1.0 Summarization of E97-1035
Paper Title:
PARADISE: A FRAMEWORK FOR EVALUATING SPOKEN DIALOGUE AGENTS
PARADISE: A FRAMEWORK FOR EVALUATING SPOKEN DIALOGUE AGENTS
Authors: Marilyn A. Walker and Diane J. Litman and Candace A. Kamm and Alicia Abella
Primarily assigned technology terms:
- database
- dialogue modeling
- dialogue processing
- dialogue system
- discourse segment tagging
- evaluation framework
- identification
- information access
- information access dialogues
- information exchange
- instantiation
- language processing
- linear regression
- measuring
- modeling
- natural language processing
- normalization
- predictor
- processing
- recognition
- regression
- repair
- score normalization
- segment tagging
- speech recognition
- spoken dialogue
- spoken dialogue agent
- tagging
- validation
Other assigned terms:
- abbreviations
- approach
- attribute-value pairs
- background noise
- case
- chance agreement
- coefficient
- concept
- confusion matrix
- cooperative strategy
- correlation
- decision theory
- dialogue agent
- dialogue behavior
- dialogue corpus
- dialogue interaction
- dialogue research
- dialogue strategies
- dialogue strategy
- dialogue structure
- dialogue system evaluation
- dialogues
- discourse
- discourse segment
- discourse structure
- distribution
- estimation
- evaluation function
- explicit confirmation
- fact
- general evaluation framework
- implicit confirmation
- information flow
- kappa
- kappa coefficient
- knowledge
- measure
- measures
- method
- methodology
- names
- natural language
- noise
- performance evaluation
- prior distribution
- query
- reference answer
- segments
- standard deviation
- statistical significance
- subdialogue
- system evaluation
- tagging scheme
- tags
- task performance
- term
- terms
- theories
- theory
- tone
- transformation
- usability
- user
- user satisfaction
- utterance
- wh-question
- word
