Tokenization and Word Segmentation in Universal Dependencies
ID: tokenization-and-word-segmentation-in-universal-dependencies
Primary source: universaldependencies.org/u/overview/tokenization.html
Verified locator: UD version2; orthographic versus syntactic units, French au=à le example and two-level representation of contractions.
New to topics? Read the docs here!