ACL RD-TEC 1.0 Summarization of W05-0901
Paper Title:
A METHODOLOGY FOR EXTRINSIC EVALUATION OF TEXT SUMMARIZATION: DOES ROUGE CORRELATE?
A METHODOLOGY FOR EXTRINSIC EVALUATION OF TEXT SUMMARIZATION: DOES ROUGE CORRELATE?
Authors: Bonnie Dorr and Christof Monz and Stacy President and Richard Schwartz and David Zajic
Primarily assigned technology terms:
- automatic evaluation
- automatic summarization
- browser
- computational linguistics
- detection and tracking
- document presentation
- document summarization
- document understanding
- document-presentation
- extrinsic evaluation
- gisting
- gisting evaluation
- information retrieval
- internet
- intrinsic evaluation
- machine translation
- machine translation evaluation
- measuring
- noise reduction
- partitioning
- predictor
- question answering
- reading
- relevance assessment
- relevance-prediction
- scoring
- search
- search engine
- searching
- selection method
- statistical analysis
- summarization
- summarization systems
- text summarization
- the document understanding
- topic detection
- topic detection and tracking
- translation evaluation
- web browser
Other assigned terms:
- agreement rate
- agreement score
- annotators
- approach
- association for computational linguistics
- background knowledge
- broadcast news
- characters
- coherence
- correlation
- correlations
- data consortium
- data set
- document
- document text
- evaluation measure
- evaluation measures
- evaluation methodology
- evaluation metric
- evaluations
- event description
- events
- experimental results
- extrinsic evaluation measures
- fact
- gold standard
- human judgments
- human performance
- hypotheses
- hypothesis
- interannotator agreement
- kappa
- knowledge
- linguistic
- linguistic data
- linguistic data consortium
- linguistics
- mapping
- meaning
- meanings
- measure
- measures
- method
- methodology
- n-gram
- n-grams
- noise
- process
- research and development
- standard deviation
- statistical significance
- statistics
- style
- task performance
- tdt corpus
- technique
- technologies
- text
- text documents
- transcribed speech
- understanding
- user
- word
- word choice
- words
