ACL RD-TEC 1.0 Summarization of N03-1034
Paper Title:
EVALUATING THE EVALUATION: A CASE STUDY USING THE TREC 2002 QUESTION ANSWERING TRACK
EVALUATING THE EVALUATION: A CASE STUDY USING THE TREC 2002 QUESTION ANSWERING TRACK
Primarily assigned technology terms:
- candidate selection
- comparative evaluation
- document retrieval
- human language
- human language technology
- information retrieval
- language processing
- language processing technology
- language technology
- natural language processing
- processing
- processing technology
- qa system
- question answering
- random selection
- ranking
- retrieval systems
- retrieving
- scoring
- spelling
- technology transfer
- text retrieval
- uniform scoring
Other assigned terms:
- bias
- candidate selection phase
- case
- correlation
- correlations
- distribution
- document
- document collection
- document retrieval evaluation
- english news text
- error rate
- evaluation methodology
- evaluation metric
- evaluation metrics
- evaluation task
- evaluations
- fact
- feature
- feature set
- grammar
- human judgments
- information need
- large corpus
- likelihood
- manual intervention
- measure
- method
- methodology
- names
- natural language
- nist
- noun phrase
- ontology
- opinion
- opinions
- phrase
- precision
- probability
- probability distribution
- procedure
- punctuation
- question answering task
- question type
- question types
- random sample
- scoring metric
- set size
- technologies
- technology
- test collection
- test set
- text
- training
- training set
- words
