<TEI:TOK>

Main Menu


Powered by <TEI:TOK>
Maarten Janssen, 2014-

TEITOK Help Pages

Multi-word Expressions

TEITOK uses a principle of shallow tokenization: tokens are, different from several other corpus projects, standardly taken as anything between two space (or punctuation marks).


Back to index