tokenize
verb
No English definition recorded for this entry.
L585774 on Wikidata ↗Wiktionary
Pronunciation: /ˈtoʊ.kən.aɪz/
verb
Etymology: Etymology tree English token Proto-Indo-European *-id- Proto-Indo-European *-yéti Proto-Indo-European *-idyéti Proto-Hellenic *-íďďō Ancient Greek -ῐ́ζω (-ĭ́zō)bor. Late Latin -izōder. Middle French -iserbor. Middle English -isen English -ize English tokenize From token + -ize.
- To reduce to a token or set of tokens by lexical analysis.
- To substitute sensitive data with meaningless placeholders.
- To treat as a token minority.