Preprocess

The description of the tokenizer goes here.