<< back

tokenizer

multi-character tokenizer with substitution

inputs

note that whitespace will not be stripped from any fields

list of allowed tokens token bank delimiter ,

text to tokenize

you have unsaved changes

substitution

use substitution map?

autofill?

output

output delimiter