ACL RD-TEC 1.0 Summarization of W04-1003
Paper Title:
THE EFFECTS OF HUMAN VARIATION IN DUC SUMMARIZATION EVALUATION
THE EFFECTS OF HUMAN VARIATION IN DUC SUMMARIZATION EVALUATION
Authors: Donna Harman and Paul Over
Primarily assigned technology terms:
- automatic evaluation
- automatic summarization
- automatic text summarization
- document summarization
- extrinsic evaluation
- information detection
- information retrieval
- information retrieval task
- intrinsic evaluation
- language processing
- learning
- learning algorithms
- machine learning
- machine learning algorithms
- measuring
- multi-document summarization
- natural language processing
- processing
- ranking
- relevance assessment
- scoring
- single document summarization
- summarization
- summarization evaluation
- summarization systems
- text retrieval
- text summarization
- text summarization evaluation
Other assigned terms:
- abbreviations
- bias
- case
- community
- correlation
- correlations
- data set
- data sets
- discourse
- document
- document set
- document sets
- evaluations
- human judgments
- human performance
- hypothesis
- interpretation
- meaning
- measure
- measures
- methodology
- n-gram
- n-grams
- natural language
- nist
- noise
- null hypothesis
- probability
- process
- retrieval task
- scoring model
- sentence
- sentence boundaries
- sentences
- statistics
- style
- summarization content units
- summarization quality
- system-produced summary
- terms
- test data
- test set
- text
- toolkit
- training
- training data
- unigram
- word
- word choice
- words
