Eckhard Bick - VISL

strings ending in or containing '.', '-' or '/' are checked in the lexicon. If
they do not figure there as abbreviations, the string is split up in ordinary
word strings and $-prefixed punctuation marks. In ambiguous cases (e.g.
sentence final abbreviations) a few simple context dependent rules are
used.
hyphenation
hyphenated strings are split up, but the hyphen is retained as a suffixed
marker at the end of the word originally preceding it. After individual
inflexional analysis in the main program hyphenated polylexicals can
thus be "reassembled" later on, and checked against the lexicon.
enclitics
as part of the hyphenation analysis pronominal enclitics are identified,
isolated and morphologically standardised. If followed by inflexional
elements, these are "glued" to the preceding verb (e.g. "dar-lhes-ei" ->
darei- lhes)
text file analysis
next word -> inflexion analysis (includes suffix module), -> prefix
sends all non-$-strings to the main analysis module (punctuation marks,
numbers etc. have been marked $ by the preprocessor)
orthographic variation*
changes oi/ou digraphs, brazilises European Portuguese spelling
accentuation errors*
removes, changes or adds accents in unanalysed words
spelling errors*
corrects a few common errors in unanalysed words, mostly ASCII
problems (e.g. c -> ç, ao -> ão)
propria heuristics
assigns the PROP tag to unanalysed or heavily derivated capitalised
words (restricted after full stop and by certain context sensitive rules
searching for name chains and pre-name contexts.)
non-propria heuristics
assigns word class, inflexional and derivational tags by trying to do
partial analyses of as large as possible a right hand chunk of any
unanalysable word, recognising inflexion morphemes, suffixes and
word class specific endings and attaching them to hypothesised 'xxx'
roots.
local disambiguation
all but the least complex derivational readings are discarded
output
writes the remaining analyses to the _pars file, root, derivation, word
class and inflexion
cohort statistics
ambiguity distribution analysis
- 471 -