tokenize
Pronunciation:
/ˈtoʊ.kən.aɪz/verb
Definitions
To reduce to a set of tokens by lexical analysis.
To substitute sensitive data with meaningless placeholders.
To treat as a token minority.
Explore meaning, context, and usage with an online dictionary experience optimized for multilingual workflows.
Try these words
/ˈtoʊ.kən.aɪz/Definitions
To reduce to a set of tokens by lexical analysis.
To substitute sensitive data with meaningless placeholders.
To treat as a token minority.