トークン化
Sign in to saveAlso known as tokenisation
breaking a stream of text up into chunks for analysis or further processing
Wikidata facts
- Subclass of
- information processing
Show 1 more fact
- facet of
- compiler construction
via Wikidata · CC0
Also known as tokenisation
breaking a stream of text up into chunks for analysis or further processing
via Wikidata · CC0