lexical token
Sign in to saveAlso known as token
in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence
In the Vinony graph
Within Vinony's link graph, lexical token connects to lexical analysis.
Vinony files it under Lexical analysis and Printworthy redirects.
Its subject is documented across 6 Wikipedia language editions.
Wikidata facts
- Subclass of
- symbol
Show 1 more fact
- facet of
- natural language processing
via Wikidata · CC0