ACL RD-TEC 1.0 Summarization of P05-1035
Paper Title:
QARLA: A FRAMEWORK FOR THE EVALUATION OF TEXT SUMMARIZATION SYSTEMS
QARLA: A FRAMEWORK FOR THE EVALUATION OF TEXT SUMMARIZATION SYSTEMS
Authors: Enrique Amigó and Julio Gonzalo and Anselmo Peñas and Felisa Verdejo
Primarily assigned technology terms:
- automatic evaluation
- automatic summarisation
- automatic summarization
- comparative evaluation
- computing
- document retrieval
- evaluation framework
- grouping
- information retrieval
- information synthesis
- lemmatization
- machine translation
- measuring
- multi-document summarisation
- pearson correlation
- qarla evaluation
- ranking
- summarisation
- summarization
- summarization systems
- synthesis
- text summarisation
- text summarization
- weighting
Other assigned terms:
- analogy
- annotation
- approach
- bleu
- case
- concept
- correlation
- correlations
- document
- estimation
- euclidean distance
- evaluation measures
- evaluation metric
- feature
- generalisation
- gold standard
- human performance
- hypothesis
- linear combination
- manual annotation
- measure
- measures
- methodology
- n-gram
- nist
- predictive power
- probabilistic framework
- probabilistic measure
- probabilities
- probability
- quantifier
- relation
- retrieval task
- rouge measure
- scrambling
- sentence
- sentences
- similarity measure
- similarity metric
- similarity metrics
- statistical significance
- system evaluation
- terms
- test set
- text
- topics
- unigram
- vocabulary
- word
- word frequencies
- words
