<TEI:TOK>

Main Menu


Powered by TEITOK
© Maarten Janssen, 2014-

TEITOK Help Pages

Multi-word Expressions

TEITOK uses a principle of shallow tokenization: tokens are, different from several other corpus projects, standardly taken as anything between two space (or punctuation marks).


Back to index