tokenize

动词 v.
中文释义
美 /ˈtoʊ.kən.aɪz/

英文释义

动词 v.
  1. To reduce to a token or set of tokens by lexical analysis. transitive
  2. To substitute sensitive data with meaningless placeholders. transitive
  3. To treat as a token minority. transitive

词形变化

tokenizes present,singular,third-person tokenizing participle,present tokenized participle,past tokenized past tokenise alternative

词汇关系

衍生词
detokenize mistokenize retokenize tokenizable tokenization tokenizer untokenized
相关词
tokenism

词源

Etymology tree
English token
Proto-Indo-European *-id-
Proto-Indo-European *-yéti
Proto-Indo-European *-idyéti
Proto-Hellenic *-íďďō
Ancient Greek -ῐ́ζω (-ĭ́zō)bor.
Late Latin -izōder.
Middle French -iserbor.
Middle English -isen
English -ize
English tokenize
From token + -ize.
0 次浏览 数据来源: Wiktionary