ACL RD-TEC 1.0 Summarization of N04-1019
Paper Title:
EVALUATING CONTENT SELECTION IN SUMMARIZATION: THE PYRAMID METHOD
EVALUATING CONTENT SELECTION IN SUMMARIZATION: THE PYRAMID METHOD
Authors: Ani Nenkova and Rebecca Passonneau
Primarily assigned technology terms:
- approximation
- automatic method
- bleu method
- coding
- computing
- content selection
- coreference annotation
- data representation
- document understanding
- evaluation procedure
- learning
- machine translation
- matching
- multidocument summarization
- ranking
- scoring
- semantic matching
- summarization
- summarization evaluation
- summarizer
- summary evaluation
- the document understanding
- weighting
Other assigned terms:
- annotation
- annotation effort
- annotation layer
- annotation process
- annotation task
- annotator
- annotators
- approach
- bleu
- case
- chance agreement
- coefficient
- cognitive
- concept
- constituent structure
- content evaluation
- correlation
- data sets
- discourse
- discourse units
- distance metric
- distribution
- document
- document sets
- evaluation data
- evaluation method
- fact
- generation
- gold standard
- human judgments
- hypothesis
- index
- interannotator reliability
- knowledge
- likelihood
- meaning
- method
- natural language
- nist
- null hypothesis
- opinion
- precision
- probabilities
- probability
- procedure
- process
- relation
- representation language
- semantic
- semantic agreement
- semantic content
- semantic relations
- semantic representation
- semantic representation language
- sentence
- sentences
- statistic
- subsumption
- summarization content units
- term
- terms
- test set
- text
- training
- understanding
- unigram
- user
- word
- words
