ACL RD-TEC 1.0 Summarization of C04-1072
Paper Title:
ORANGE: A METHOD FOR EVALUATING AUTOMATIC EVALUATION METRICS FOR MACHINE TRANSLATION
ORANGE: A METHOD FOR EVALUATING AUTOMATIC EVALUATION METRICS FOR MACHINE TRANSLATION
Authors: Chin-Yew Lin and Franz Josef Och
Primarily assigned technology terms:
- algorithm
- automatic evaluation
- automatic evaluation method
- automatic machine translation
- bootstrap
- bootstrap resampling
- chinese-english machine translation
- computing
- correlation analysis
- error analysis
- evaluation procedure
- gisting
- gisting evaluation
- machine translation
- machine translation evaluation
- machine translation framework
- machine translation system
- machine translation systems
- machine translation training
- matching
- orange evaluation
- ranking
- resampling
- sampling
- smoothing
- smoothing technique
- smt system
- statistical machine translation
- statistical machine translation system
- translation evaluation
- translation system
- translation systems
- translation training
- weighting
Other assigned terms:
- automatic evaluation metric
- bigram
- bleu
- bleu score
- candidate translation
- case
- co-occurrence
- co-occurrence statistics
- coefficient
- correlation
- correlation coefficient
- data consortium
- development cycle
- diagnostic error
- error rate
- evaluation method
- evaluation metric
- evaluation metrics
- evaluations
- f-measure
- feature
- human involvement
- human judgments
- linguistic
- linguistic data
- linguistic data consortium
- measure
- method
- n-best list
- n-gram
- n-grams
- nist
- oracle
- procedure
- process
- rank order
- reference translation
- reference translations
- sentence
- sentence level
- sentences
- source sentence
- statistics
- system performance
- technique
- terms
- test corpus
- training
- translations
- unigram
- word
- word order
- words
