ACL RD-TEC 1.0 Summarization of W05-0909
Paper Title:
METEOR: AN AUTOMATIC METRIC FOR MT EVALUATION WITH IMPROVED CORRELATION WITH HUMAN JUDGMENTS
METEOR: AN AUTOMATIC METRIC FOR MT EVALUATION WITH IMPROVED CORRELATION WITH HUMAN JUDGMENTS
Authors: Satanjeev Banerjee and Alon Lavie
Primarily assigned technology terms:
- algorithm
- comparative evaluation
- computational linguistics
- computing
- detection algorithm
- exact matching
- extrinsic evaluation
- level assessment
- machine translation
- machine translation evaluation
- matching
- measuring
- mt system
- mt systems
- pearson correlation
- porter stemmer
- scoring
- scoring function
- sentence translation
- stemmer
- summarization
- synonymy detection
- translation evaluation
- translation system
- translation systems
- unigram matching
- weighting
Other assigned terms:
- approach
- association for computational linguistics
- bigram
- bleu
- bleu metric
- bleu scores
- brevity penalty
- case
- chunk
- chunks
- community
- concept
- correlation
- correlations
- data set
- data sets
- empirical evaluation
- evaluation data
- evaluation measures
- evaluation methodology
- evaluation metric
- evaluation metrics
- evaluations
- experimental results
- extrinsic evaluation measures
- fact
- function words
- grammaticality
- human judgment
- human judgments
- language data
- linguistics
- mapping
- mappings
- maps
- meaning
- meanings
- measure
- measures
- methodology
- mt evaluation
- mt quality
- n-gram
- n-grams
- nist
- noise
- precision
- process
- reference translation
- reference translations
- relation
- segments
- semantic
- semantic relatedness
- sentence
- sentence level
- sentence-by-sentence basis
- sentences
- statistics
- stem
- stems
- synonyms
- synonymy
- synset
- system development
- terms
- test set
- training
- training data
- translation quality
- translation task
- translations
- unigram
- word
- word order
- wordnet
- words