#19870This paper proposes an automatic, essentially domain-independent means of evaluating Spoken Language Systems (SLS) which combines software we have developed for that purpose (the Comparator ) and a set of specifications for answer expressions (the Common Answer Specification, or CAS).
tool,1-2-H89-2019,ak
</term>
, or
<term>
CAS
</term>
) . The
<term>
Comparator
</term>
checks whether the answer provided
#19891The Comparator checks whether the answer provided by a SLS accords with a canonical answer, returning either true or false.
tool,39-3-H89-2019,ak
</term>
, and the procedures used by the
<term>
Comparator
</term>
. Though some details of the
<term>
#19951The Common Answer Specification determines the syntax of answer expressions, the minimal content that must be included in them, the data to be included in and excluded from test corpora, and the procedures used by the Comparator .