#25859A novel method for adding linguistic annotation to corpora is presented which involves using a statistical POS tagger in conjunction with unsupervised structure finding methods to derive notions ofnoun group, verb group, and so on which is inherently extensible to more sophisticated annotation, and does not require a pre-tagged corpus to fit.
other,11-5-A94-1011,ak
<term>
descriptors
</term>
from individual
<term>
phrases
</term>
rather than from the
<term>
weighted
#25941This leads us to consider the assignment of descriptors from individualphrases rather than from the weighted sum of a word set representation.
other,40-4-A94-1011,ak
descriptors ( keywords )
</term>
than single
<term>
words
</term>
are . This leads us to consider the
#25927One of the distinguishing features of a more linguistically sophisticated representation of documents over a word set based representation of them is that linguistically sophisticated units are more frequently individually good predictors of document descriptors (keywords) than singlewords are.
model,6-6-A94-1011,ak
investigate how sets of individually
<term>
high-precision rules
</term>
can result in a low
<term>
precision
#25960We investigate how sets of individuallyhigh-precision rules can result in a low precision when used together, and develop some theory about these probably-correct rules.
other,8-4-A94-1011,ak
distinguishing features of a more
<term>
linguistically sophisticated representation
</term>
of
<term>
documents
</term>
over a
<term>
#25895One of the distinguishing features of a morelinguistically sophisticated representation of documents over a word set based representation of them is that linguistically sophisticated units are more frequently individually good predictors of document descriptors (keywords) than single words are.
tech,3-1-A94-1011,ak
practical translation use . The use of
<term>
NLP techniques
</term>
for
<term>
document classification
</term>
#25771The use ofNLP techniques for document classification has not produced significant improvements in performance within the standard term weighting statistical assignment paradigm (Fagan 1987; Lewis, 1992bc; Buckley, 1993).
other,22-8-A94-1011,ak
lends some support to the use of more
<term>
linguistically sophisticated representations
</term>
for
<term>
document classification
</term>
#26041It therefore shows that statistical systems can exploit sophisticated representations of documents, and lends some support to the use of morelinguistically sophisticated representations for document classification.
other,33-4-A94-1011,ak
frequently individually good predictors of
<term>
document descriptors ( keywords )
</term>
than single
<term>
words
</term>
are
#25920One of the distinguishing features of a more linguistically sophisticated representation of documents over a word set based representation of them is that linguistically sophisticated units are more frequently individually good predictors ofdocument descriptors ( keywords ) than single words are.
other,12-4-A94-1011,ak
sophisticated representation
</term>
of
<term>
documents
</term>
over a
<term>
word set based representation
#25899One of the distinguishing features of a more linguistically sophisticated representation ofdocuments over a word set based representation of them is that linguistically sophisticated units are more frequently individually good predictors of document descriptors (keywords) than single words are.
tech,21-3-A94-1011,ak
POS tagger
</term>
in conjunction with
<term>
unsupervised structure finding methods
</term>
to derive notions of
<term>
noun group
#25851A novel method for adding linguistic annotation to corpora is presented which involves using a statistical POS tagger in conjunction withunsupervised structure finding methods to derive notions of noun group, verb group, and so on which is inherently extensible to more sophisticated annotation, and does not require a pre-tagged corpus to fit.
measure(ment),13-6-A94-1011,ak
high-precision rules
</term>
can result in a low
<term>
precision
</term>
when used together , and develop
#25967We investigate how sets of individually high-precision rules can result in a lowprecision when used together, and develop some theory about these probably-correct rules.
measure(ment),16-5-A94-1011,ak
phrases
</term>
rather than from the
<term>
weighted sum
</term>
of a
<term>
word set representation
#25946This leads us to consider the assignment of descriptors from individual phrases rather than from theweighted sum of a word set representation.
tech,6-1-A94-1011,ak
use of
<term>
NLP techniques
</term>
for
<term>
document classification
</term>
has not produced significant improvements
#25774The use of NLP techniques fordocument classification has not produced significant improvements in performance within the standard term weighting statistical assignment paradigm (Fagan 1987; Lewis, 1992bc; Buckley, 1993).
other,18-7-A94-1011,ak
particularly suitable for exploiting
<term>
linguistically sophisticated representations
</term>
, and show that a
<term>
statistically
#25999We then proceed to repeat results which show that standard statistical models are not particularly suitable for exploitinglinguistically sophisticated representations, and show that a statistically fitted rule-based model provides significantly improved performance for sophisticated representations.
tech,45-3-A94-1011,ak
inherently extensible to more sophisticated
<term>
annotation
</term>
, and does not require a
<term>
pre-tagged
#25875A novel method for adding linguistic annotation to corpora is presented which involves using a statistical POS tagger in conjunction with unsupervised structure finding methods to derive notions of noun group, verb group, and so on which is inherently extensible to more sophisticatedannotation, and does not require a pre-tagged corpus to fit.
other,8-8-A94-1011,ak
statistical systems
</term>
can exploit
<term>
sophisticated representations
</term>
of
<term>
documents
</term>
, and lends
#26027It therefore shows that statistical systems can exploitsophisticated representations of documents, and lends some support to the use of more linguistically sophisticated representations for document classification.
other,15-4-A94-1011,ak
</term>
of
<term>
documents
</term>
over a
<term>
word set based representation
</term>
of them is that linguistically sophisticated
#25902One of the distinguishing features of a more linguistically sophisticated representation of documents over aword set based representation of them is that linguistically sophisticated units are more frequently individually good predictors of document descriptors (keywords) than single words are.
other,8-5-A94-1011,ak
leads us to consider the assignment of
<term>
descriptors
</term>
from individual
<term>
phrases
</term>
#25938This leads us to consider the assignment ofdescriptors from individual phrases rather than from the weighted sum of a word set representation.
lr,52-3-A94-1011,ak
annotation
</term>
, and does not require a
<term>
pre-tagged corpus
</term>
to fit . One of the distinguishing
#25882A novel method for adding linguistic annotation to corpora is presented which involves using a statistical POS tagger in conjunction with unsupervised structure finding methods to derive notions of noun group, verb group, and so on which is inherently extensible to more sophisticated annotation, and does not require apre-tagged corpus to fit.
other,20-5-A94-1011,ak
from the
<term>
weighted sum
</term>
of a
<term>
word set representation
</term>
. We investigate how sets of individually
#25950This leads us to consider the assignment of descriptors from individual phrases rather than from the weighted sum of aword set representation.