ACL RD-TEC 1.0 Summarization of W05-0906
Paper Title:
EVALUATING SUMMARIES AND ANSWERS: TWO SIDES OF THE SAME COIN?
EVALUATING SUMMARIES AND ANSWERS: TWO SIDES OF THE SAME COIN?
Authors: Jimmy Lin and Dina Demner-Fushman
Primarily assigned technology terms:
- acquisition process
- automatic construction
- automatic evaluation
- automatic method
- classification
- computational linguistics
- computer system
- document retrieval
- document retrieval system
- document summarization
- evaluation process
- extrinsic evaluation
- factoid question answering
- fully-automated evaluation
- information retrieval
- information retrieval task
- information synthesis
- knowledge acquisition
- knowledge acquisition process
- knowledge transfer
- language generation
- linguistic analysis
- machine translation
- modeling
- multi-document summarization
- natural language generation
- question answering
- question answering systems
- ranking
- reasoning
- recognising textual entailment
- redundancy detection
- retrieval system
- retrieval systems
- score calculation
- scoring
- scoring system
- semantic analysis
- summarization
- summarization evaluation
- summarization systems
- synthesis
- system-building
- text compression
- traditional document retrieval
Other assigned terms:
- advanced question answering
- approach
- association for computational linguistics
- bleu
- bleu metric
- case
- classification scheme
- co-occurrence
- co-occurrence statistics
- co-occurrences
- coefficient
- community
- convergence
- correlation
- discourse
- discourse structure
- document
- document collections
- entailment
- evaluation measures
- evaluation method
- evaluation metric
- evaluation metrics
- evaluations
- extrinsic evaluation measures
- f-measure
- fact
- factoid question
- framenet
- generation
- human judgment
- human judgments
- human performance
- inferences
- information need
- information retrieval community
- inter-annotator agreement
- kappa
- knowledge
- linguistic
- linguistics
- linguistics research
- mean average precision
- measure
- measures
- method
- n-gram
- named entities
- natural language
- natural language sentence
- nist
- ontologies
- opinion
- parse
- precision
- priori
- procedure
- process
- propbank
- question answering evaluation
- question answering research
- redundant information
- representations
- retrieval task
- segments
- semantic
- sentence
- sentences
- statistics
- subordinate clauses
- system development
- system evaluation
- system performance
- system response
- technique
- terms
- text
- textual entailment
- textual entailment challenge
- understanding
- unigram
- user
- word
- word sense
