tokenizer

listen to the pronunciation of tokenizer
English - Turkish
Simgeleştirici
English - English
A system that parses an input stream into tokens