ACL RD-TEC 1.0 Summarization of W06-1401
Paper Title:
LESSONS LEARNED FROM LARGE SCALE EVALUATION OF SYSTEMS THAT PRODUCE TEXT: NIGHTMARES AND PLEASANT SURPRISES
LESSONS LEARNED FROM LARGE SCALE EVALUATION OF SYSTEMS THAT PRODUCE TEXT: NIGHTMARES AND PLEASANT SURPRISES
Primarily assigned technology terms:
- automatic evaluation
- computational linguistics
- document understanding
- language generation
- measuring
- natural language generation
- quantitative evaluation
- question answering
- question answering systems
- question-answering
- scoring
- summarization
- summarization systems
- task-based evaluation
- the document understanding
Other assigned terms:
- annotation
- approach
- association for computational linguistics
- community
- document
- document sets
- evaluations
- events
- fact
- feature
- generation
- gold standard
- human performance
- knowledge
- linguistics
- measure
- method
- methodology
- natural language
- nist
- opinions
- paragraph
- paragraph length
- precision
- semantic
- semantic representation
- test data
- text
- topics
- understanding
