ACL RD-TEC 1.0 Summarization of J93-3001
Paper Title:
EVALUATING MESSAGE UNDERSTANDING SYSTEMS: AN ANALYSIS OF THE THIRD MESSAGE UNDERSTANDING CONFERENCE (MUG-3)
EVALUATING MESSAGE UNDERSTANDING SYSTEMS: AN ANALYSIS OF THE THIRD MESSAGE UNDERSTANDING CONFERENCE (MUG-3)
Authors: Nancy Chinchor and David D. Lewis and Lynette Hirschmant
Primarily assigned technology terms:
- abduction
- acquisition process
- advanced information technology
- algorithm
- analyzer
- approximate randomization test
- approximation
- automated knowledge acquisition
- black-box evaluation
- black-box testing
- bottom-up analysis
- bracketing
- case-based reasoning
- categorization
- chart parsing
- chart parsing mechanism
- class assignment
- classification
- classification system
- classification techniques
- classifier
- classifiers
- computational linguistics
- computing
- conjunction processing
- coupling
- cutoff
- data extraction
- database
- decomposition
- disambiguation
- discourse analysis
- discourse module
- discourse processing
- domain-specific knowledge engineering
- evaluation procedure
- evaluation process
- extraction application
- extraction system
- extraction systems
- full parsing
- glass-box
- glass-box evaluation
- glass-box testing
- hardware
- hybrid control
- hypothesis testing
- identification
- information retrieval
- information technology
- intelligent systems
- knowledge acquisition
- knowledge acquisition process
- knowledge engineering
- language processing
- language understanding
- learner
- learning
- learning methods
- learning techniques
- lexical look-up
- lexical processing
- lexicon development
- lexicon lookup
- linguistic processing
- linguistic techniques
- machine learning
- machine learning methods
- machine translation
- machine translation systems
- matching
- measuring
- message processing
- message understanding
- morphological analysis
- morphological processing
- morphology
- natural language processing
- natural language system
- natural language systems
- natural language understanding
- object-oriented
- object-oriented design
- parser
- parsing
- parsing mechanism
- part-of-speech tagging
- partial match
- partial parsing
- pattern classification
- pattern-matching
- perceptron
- perceptron algorithm
- phrase parsing
- pragmatic processing
- predictor
- preprocessing
- processing
- processing technology
- qualitative evaluation
- quantitative evaluation
- randomization
- randomization test
- reading
- reading comprehension
- reasoning
- reference resolution
- regression
- regression testing
- regularization
- relevance filtering
- reporting
- rescoring
- robust parsing
- scoring
- scoring program
- scoring system
- segmentation
- semantic analysis
- semantic net
- semantic processing
- sense disambiguation
- sentence analysis
- signal detection
- significance testing
- skimmer
- skimming
- spelling
- spelling correction
- spoken language understanding
- statistical hypothesis
- statistical methods
- statistical significance testing
- statistical tagging
- statistical testing
- string matching
- surveillance
- syntactic analysis
- syntactic parsing
- syntactic phrase parsing
- syntactic processing
- syntactic regularization
- system engineering
- system-building
- table lookup
- tagging
- template filling
- template generation
- template-filling
- temporal analysis
- temporal processing
- terminology
- text categorization
- text categorization system
- text classification
- text processing
- text retrieval
- text segmentation
- text understanding
- theorem proving
- tile
- tool development
- translation systems
- understanding technology
- uniform scoring
- word sense disambiguation
Other assigned terms:
- adjunct
- affixes
- approach
- approximate randomization
- axioms
- binary features
- broad-coverage grammar
- canonical form
- case
- case frame
- cluster
- clusters
- community
- comprehension
- concept
- concept hierarchy
- concepts
- content words
- contextual information
- contingency table
- contingency table model
- control strategy
- convergence
- corpora
- cue phrases
- data sets
- debugging
- development set
- dictionary
- discourse
- discourse relations
- discourse segment
- discourse transition
- distribution
- document
- domain knowledge
- domain model
- domain-specific knowledge
- evaluation methodology
- evaluation metrics
- evaluation paradigm
- evaluations
- events
- experimental results
- f-measure
- fact
- factual information
- feature
- finite set
- formal model
- frame
- generation
- grammar
- head noun
- heuristic
- heuristic rules
- heuristics
- human performance
- hypotheses
- hypothesis
- hypothesis test
- indefinite reference
- index
- inflected forms
- input string
- input text
- intention
- interpretation
- interpreter
- keyword
- keyword query
- knowledge
- knowledge acquisition bottleneck
- knowledge base
- lexical knowledge
- lexical semantics
- lexicon
- likelihood
- linguistic
- linguistic phenomena
- linguistic phenomena test
- linguistic phenomenon
- linguistic structure
- linguistic structures
- linguistics
- logical expression
- logical form
- machine-readable dictionary
- mapping
- mappings
- measure
- measures
- mechanisms
- message
- message understanding conference
- message understanding conferences
- method
- methodology
- morphological rules
- muc-3
- muc-3 corpus
- n-gram
- names
- natural language
- negation
- noise
- noun phrase
- noun phrases
- null hypothesis
- organization names
- paragraph
- paragraphs
- parse
- part-of-speech
- partial parses
- passive verb
- phrase
- portability
- precision
- precision measure
- preprocessor
- probability
- probability distribution
- procedure
- process
- processing load
- processing module
- processing time
- pronouns
- proper name
- proper names
- proper noun
- punctuation
- quality control
- query
- random sample
- redundant information
- regular expressions
- relation
- representations
- scoring scheme
- segments
- semantic
- semantic and pragmatic
- semantic case
- semantic grammar
- semantic hierarchy
- semantic information
- semantic knowledge
- semantic preference
- semantic relations
- semantic representation
- semantic rules
- semantic structures
- semantic types
- sentence
- sentences
- signal
- slot
- spoken language
- statistic
- statistical significance
- statistics
- style
- substring
- syntactic class
- syntactic information
- syntactic phrase
- syntactic representation
- syntax
- system architecture
- system development
- system evaluation
- system performance
- system portability
- system response
- technique
- technology
- television
- temporal relations
- terms
- test corpora
- test data
- test set
- text
- text segments
- text type
- theorem
- theory
- tokens
- training
- training corpus
- training data
- training documents
- training material
- training set
- transcripts
- transformation
- treebank
- treebank corpus
- typographical errors
- understanding
- user
- user interaction
- verb
- verb forms
- vocabulary
- word
- word level
- word sense
- words
