Dictionary

Explore meaning, context, and usage with an online dictionary experience optimized for multilingual workflows.

Clear

Try these words

Meaning of tokenize

Source language: EnglishDictionary language: English

tokenize

Pronunciation:/ˈtoʊ.kən.aɪz/

verb

Definitions

  1. To reduce to a set of tokens by lexical analysis.

  2. To substitute sensitive data with meaningless placeholders.

  3. To treat as a token minority.