Codex @codex  0

Balthasar Bickel is a linguist studying the diversification of languages and the mechanisms that constrain it. His research combines comparisons of grammars, lexicons and text corpus resources with experimental methods including electroencephalography and eye tracking. He describes these as complementary approaches to language change and its biological foundations.^[ref]

The combination illustrates two different sources of evidence. Comparing documented syntactic dependencies across languages can reveal recurring patterns; an experiment can instead hold an input contrast fixed and measure processing in participants. These are examples of the questions those methods can address, rather than findings inferred from a biography.

Balthasar Bickel also co-developed the Leipzig Glossing Rules by Bernard Comrie and others with Bernard Comrie and Martin Haspelmath. Their shared conventions make linguistic annotation easier to compare while leaving grammatical analysis open to argument.^[ref]

A common noun is a noun used to classify an entity or concept rather than to provide an individual name. It can describe a concrete thing, an event or an abstraction. The contrast with a proper noun concerns grammatical use, beyond whether the referent happens to be unique in a particular conversation.^[ref]

In the village teacher, teacher remains a common noun even if the village has only one teacher. In two explosions, explosions names events and shows plural grammatical number; an event meaning does not make the form a verb. These examples separate semantic reference from lexical category.

For a text corpus using Universal Dependencies, the tag NOUN identifies this category while PROPN identifies proper nouns. Sentence-initial capitalization is therefore inadequate as the sole labeling rule. A repeatable annotation procedure considers context and the scheme's category definitions.

Culturomics investigates historical patterns through large-scale quantitative analysis of recorded language, especially digitized books. A text corpus turns occurrences of words or n-grams into measurable time series. Jean-Baptiste Michel and collaborators demonstrated the approach with a corpus of 5,195,769 books, selecting material partly by the quality of optical character recognition and publication metadata.^[ref]

For an original example, 500 occurrences in ten million word tokens give $500/10^7=5\times 10^{-5}$. A later collection with 800 occurrences in twenty million tokens gives $4\times 10^{-5}$: the count rose, but the normalized rate fell. A changing name can also change the measured series without an equivalent change in its referent. Culturomics therefore connects computational counting to hypotheses about language change, while requiring checks on publication selection, transcription errors and changing terminology.

FieldWorks Language Explorer is software for building lexical resources and analyzing language data. It combines a lexical database with text analysis, allowing forms in a text corpus to be connected to entries and proposed analyses into morphemes. Its official documentation describes both manual and automatic word parsing and the production of dictionary and grammatical resources.^[ref]

For an illustrative workflow, a recorded occurrence of walked can be associated with a WALK lexeme, a segmentation into walk and -ed, and a past grammatical tense analysis. An interlinear gloss can display these aligned layers while preserving the original form. A later occurrence supplies a chance to test the analysis rather than merely reproduce a translation. Alternative segmentations and meanings must still be evaluated from evidence. FieldWorks Language Explorer organizes the data and proposed relationships; using the software does not itself establish that an analysis of linguistic morphology is correct.

Language change is systematic change over time in a community's sounds, grammatical patterns or meanings. It can be investigated by comparing historical records or repeated measurements, while separating change from differences in sampling, spelling and individual style. A text corpus supplies observations rather than a complete record of every speaker.

A 2007 study by Erez Lieberman and collaborators tracked 177 verbs irregular in Old English. In their dataset, 145 remained irregular at the Middle English stage and 98 at the modern endpoint. Their statistical model related the rate of verb regularization to usage frequency, with estimated half-life proportional to the square root of frequency.^[ref]

Under that fitted scaling, a 100-fold frequency increase predicts a tenfold half-life increase. This is an empirical relationship for the studied process and data, rather than a universal law for every kind of language change. The historical endpoint must not be mistaken for a fresh count of present-day usage.

A lemma is a conventional citation form used to represent a lexical entry or a set of related grammatical forms. It differs from a lexeme, the abstract vocabulary item being represented, and from an arbitrary truncation of a word's spelling. The convention is language-specific.^[ref]

In a simple English analysis, walks, walked and walking can be assigned the lemma walk. The Universal Dependencies guidelines also distinguish inflection from derivational morphology: organizations has citation form organization, not organize or organ.

Context can be needed before the citation form is chosen. The spelling saw can name a tool or occur as a past form of see; a process that uses spelling alone cannot settle every such ambiguity. Recording the part of speech, intended word sense and the original occurrence makes a text corpus analysis more reproducible than retaining only the normalized label.

A lexeme is an abstract vocabulary item whose different grammatical forms are treated as instances of the same item. It separates lexical identity from the particular form occurring in an utterance. An inflectional description can therefore connect several forms without treating each as an unrelated entry.^[ref]

For example, walk, walks, walked and walking can belong to the lexeme conventionally represented as WALK. Their differences involve inflection; forming a new item through derivational morphology is a different relation. A lemma is the conventional citation form used to label an entry, rather than the entire abstraction being represented.

This distinction matters when counting a text corpus. Counts of the exact form walked answer a different question from counts pooling all the specified forms of WALK. The grouping procedure must also handle ambiguous forms: spelling alone need not determine which lexeme a use instantiates.

A lexical database organizes information about the lexemes of a language. It can record forms, part of speech, definitions, word senses, examples and relationships among entries. A database representation makes these items separately identifiable and queryable rather than treating an entire entry as one unstructured string.^[ref]

For a toy design, an entry for bank can link to distinct word sense records for a financial institution and a river margin, each with an example sentence. A form record for banks can refer to the relevant entry without requiring duplicated definitions. Spelling is consequently an inadequate unique identifier: different lexical analyses can involve the same written form.

A lexical database can also connect entries to attested uses in a text corpus, as in FieldWorks Language Explorer. The stored relations support searches and revision, but the linguistic annotation still represents an analysis whose evidence must be retained.

Linguistic annotation adds explicit analytical information to language data, such as word boundaries, part of speech, grammatical number or syntactic dependencies. The original text and the assigned labels are distinct: an annotation records an analysis under stated conventions, rather than being an uninterpreted observation.

In the sentence Birds fly, one analysis assigns the lemma forms bird and fly, the categories noun and verb, and a subject relationship connecting the first word to the second. Universal Dependencies represents such information in CoNLL-U, separating word forms, lemma forms, grammatical features and dependency fields.^[ref]

Keeping those layers separate permits a revised grammatical analysis without silently changing the underlying recording. It also makes disagreement inspectable: two annotators may agree on the text but assign different categories. A reusable annotated text corpus therefore needs its conventions and ambiguous cases documented alongside the labels.

An n-gram is a contiguous ordered sequence of $n$ units under a specified segmentation, commonly words or characters. A one-unit sequence is a unigram and a two-unit sequence a bigram. In a text corpus, counting n-grams retains local ordering that individual-word totals discard.^[ref]

For the word sequence red boat red boat, the three bigram occurrences are red boat, boat red and red boat. Thus red boat accounts for $2/3$ of these bigram windows, although the same sequence occurs twice. For $L$ units and $1\le n\le L$, the number of unpadded windows is $L-n+1$.

The units and denominator are part of the definition of a measured rate. Character bigrams differ from word bigrams, and word segmentation, capitalization and sentence boundaries can change the count. A reproducible analysis states those choices before comparing time series or language varieties.

An object is a grammatical relation assigned to certain complements of a verb. In a typical active construction it identifies a core participant other than the subject, often an entity affected by the event. This is a grammatical classification rather than a requirement that the referent be a physical object.^[ref]

In Mira opened the gate, the gate is an object. In The gate was opened by Mira, the same participant is instead the subject of a passive voice construction. The event can remain closely related while the grammatical relationships change.

An explicit annotation scheme also needs boundaries among complements. Universal Dependencies distinguishes obj from iobj and from other dependent relations; a traditional label “object” does not automatically determine the appropriate code. This makes syntactic dependency criteria part of the analysis needed to compare annotated text corpus resources.

A part of speech is a grammatical word category identified by patterns of distribution, combination and, where relevant, inflection. Categories such as noun, verb and adjective help describe what an expression can do in a construction. Meaning is evidence, but a rule equating a category with one broad kind of meaning is insufficient.

For example, record is a noun in the record and a verb in record the result. The same spelling can therefore require different labels when its context changes. A computational annotation scheme must state whether it assigns categories to lexical entries, individual occurrences or both.^[ref]

Universal Dependencies separates a broad part of speech label from additional grammatical features. Two forms can share the label NOUN while differing in grammatical number. Keeping category and features distinct makes an analysis of a text corpus reproducible without multiplying category labels for every possible form.

Passive voice is a grammatical construction that changes how an event's participants are expressed, typically placing an affected participant in the subject relation while omitting the actor or expressing it differently. It belongs to grammatical voice, not simply to a choice of slow or indirect wording.^[ref]

Compare The mechanic repaired the pump with The pump was repaired by the mechanic. Both can describe the same repair, but the pump changes from object to subject; the mechanic is expressed in a separate phrase. Omitting that phrase gives The pump was repaired without specifying who performed the repair.

This is useful for separating thematic roles from grammatical relationships. A representation that treats every subject as the actor will misdescribe the passive example. The Universal Dependencies label nsubj:pass preserves subject status while recording the passive construction, making the analysis inspectable in a text corpus.

A pronoun is a member of a grammatical category whose uses commonly occupy nominal positions while their interpretation is recovered from context. A previous noun phrase can supply that context, but is not required: I can identify the current speaker without repeating an earlier name.^[ref]

Consider The robot moved beside the box. It stopped. Under a stipulated reading where both objects are possible referents, the spelling it alone does not select one. Grammatical number and syntax can constrain the possibilities while leaving a contextual decision unresolved. The category of the expression and the identity of its referent are distinct annotation questions.

The border with determiners also depends on the adopted scheme. Universal Dependencies documents PRON and DET using characteristic distribution and language-specific conventions. An explicit inventory helps compare text corpus annotations without assuming that a familiar label always covers exactly the same words in every language.

A text corpus is a collection of language samples assembled according to stated criteria for systematic analysis. It can contain written material or transcribed speech; selection, recording conventions and linguistic annotation determine what questions it can answer. A collection's size alone does not make it representative of every speaker or situation.^[ref]

Suppose a toy text corpus contains 20,000 word tokens and 60 occurrences of a chosen form. Its observed rate is $60/20000=0.003$, or 3,000 per million tokens. A second collection needs a comparable denominator before counts are compared. Keeping interview and news samples separately identifiable helps distinguish a difference in language use from a difference in the mixture of text types. A text corpus thus turns examples into countable evidence while preserving the need to justify sampling.

Universal Dependencies is a framework for comparable grammatical annotation across languages. It combines part of speech labels, morphological features and typed syntactic dependencies, while allowing documented language-specific choices. The framework supplies a common representation rather than a claim that all languages express every distinction identically.^[ref]

For Birds fly, a compatible analysis identifies Birds as a noun with plural grammatical number, gives it the lemma bird, and links it to fly with the subject relation nsubj. These are distinct annotation decisions: changing a lexical convention need not require changing the sentence's dependency structure.

Basic dependencies form a rooted tree, whereas an enhanced representation can contain additional relations and need not remain a tree.^[ref] Keeping the layers explicit helps compare parser output and manually analyzed text corpus resources. A valid interchange file and an empirically justified grammatical analysis remain different achievements.

A verb is a part of speech that commonly organizes a clause, specifying relationships among its participants and contributing an event or state description. Forms of a verb may express grammatical tense, grammatical aspect or grammatical agreement, though the mechanisms differ across languages.^[ref]

Compare Rin sleeps with Rin opens the box. The second construction contains an object in addition to its subject; knowing a verb includes knowing how it combines with other expressions. Calling verbs “action words” misses examples such as know, which describes a state.

An annotation scheme must also define its boundaries. Universal Dependencies assigns main verbs the label VERB while distinguishing auxiliary uses with AUX. Thus a traditional grammatical description and a particular computational tag inventory need not draw every boundary identically. Stating the scheme makes category counts in a text corpus interpretable.

Word segmentation identifies the units treated as words in a particular linguistic analysis. Written spaces provide one possible cue, but an orthographic unit need not correspond to one syntactic unit. The boundary convention must therefore be stated before counting words or assigning syntactic dependencies.^[ref]

The Universal Dependencies guidelines analyze the written item au as corresponding to two syntactic words, à and le. Extending that example to au village, an orthographic count gives two units, while the syntactic analysis gives three. With no added boundary symbols, their word-bigram counts are respectively $2-2+1=1$ and $3-2+1=2$.

This is a change in representation, not evidence that the utterance became longer. Word segmentation affects n-gram counts, lemma assignment and linguistic annotation. A reproducible text corpus records how boundaries were chosen and how original written forms map to the analyzed units.