Eckhard Bick - VISL

The core of PALMORF is written in C and runs on UNIX or MacOS platforms,
tagging roughly 1000 words a second (preprocessing included). It consists of about
4000 lines of source code (+ most of the ANSI library), some 2000 lines of
grammatical inflexion and derivation rules, and a 75.000 entry electronic lexicon.
Due to the way the lexicon is organised at run time, the program requires some 8 MB
of free RAM. For additional pre- and postprocessing, PALMORF is aided by a
number of smaller filter programs written in Perl.
2.2.2 Program architecture
2.2.2.1 Program modules
Below, the basic "flow chart" structure of the PALMORF program is explained.
Basically, there is a choice between one-word-only direct analysis and file-based 8
running text analysis, the latter featuring preprocessing and heuristics modules where
also polylexicals, abbreviations, orthographic variation and sentence boundaries can
be handled, as well as some simple context dependent heuristics. Both program paths
make use of the same inflexion and derivation modules, that are applied recursively
until an analysis is found, and hereafter, until all analyses of the same or lower
derivational depth are found. A more detailed discussion of the program architecture
of PALMORF can be found in the appendix section.
direct analysis
word form analysis
findword
whole word search
inflexion morpheme
analysis
8 Of course, this version can not only handle files, but - via unix program chaining - also individual chunks of text
entered via the keyboard or an html-form.
prefix
root lexicon search
lexicon organisation
search trees
suffix
analysis
- 17 -
text file analysis
PREPROCESSOR
polylexicals+
capitalisation
numbers
punctuation
abbreviations+
hyphenation+
INPUT
RUNNING TEXT ANALYSIS
word form analysis