| tech,5-1-H05-1117,ak | Following recent developments in the <term> | automatic evaluation | </term> of <term> machine translation </term> | #5911 Following recent developments in theautomatic evaluation of machine translation and document summarization, we present a similar approach, implemented in a measure called POURPRE, for automatically evaluating answers to definition questions. | |
| measure(ment),25-1-H05-1117,ak | , implemented in a measure called <term> | POURPRE | </term> , for automatically evaluating answers | #5931 Following recent developments in the automatic evaluation of machine translation and document summarization, we present a similar approach, implemented in a measure calledPOURPRE, for automatically evaluating answers to definition questions. | |
| other,32-1-H05-1117,ak | automatically evaluating answers to <term> | definition questions | </term> . Until now , the only way to assess | #5938 Following recent developments in the automatic evaluation of machine translation and document summarization, we present a similar approach, implemented in a measure called POURPRE, for automatically evaluating answers todefinition questions. | |
| tech,3-3-H05-1117,ak | a system 's response . The lack of <term> | automatic methods for scoring system output | </term> is an impediment to progress in the | #5974 The lack ofautomatic methods for scoring system output is an impediment to progress in the field, which we address with this work. | |
| other,3-4-H05-1117,ak | with this work . Experiments with the <term> | TREC 2003 and TREC 2004 QA tracks | </term> indicate that <term> rankings </term> | #5999 Experiments with theTREC 2003 and TREC 2004 QA tracks indicate that rankings produced by our metric correlate highly with official rankings, and that POURPRE outperforms direct application of existing metrics. | |
| other,12-4-H05-1117,ak | 2004 QA tracks </term> indicate that <term> | rankings | </term> produced by our metric correlate | #6008 Experiments with the TREC 2003 and TREC 2004 QA tracks indicate thatrankings produced by our metric correlate highly with official rankings, and that POURPRE outperforms direct application of existing metrics. | |
| other,21-4-H05-1117,ak | metric correlate highly with official <term> | rankings | </term> , and that <term> POURPRE </term> outperforms | #6017 Experiments with the TREC 2003 and TREC 2004 QA tracks indicate that rankings produced by our metric correlate highly with officialrankings, and that POURPRE outperforms direct application of existing metrics. | |
| measure(ment),25-4-H05-1117,ak | official <term> rankings </term> , and that <term> | POURPRE | </term> outperforms direct application of | #6021 Experiments with the TREC 2003 and TREC 2004 QA tracks indicate that rankings produced by our metric correlate highly with official rankings, and thatPOURPRE outperforms direct application of existing metrics. |
