Package edu.columbia.cs.ref.tool.tokenizer

Interface Summary
Tokenizer Tokenizer is an interface for objects that are responsible for splitting the text into several tokens.