Uses of Interface
edu.columbia.cs.ref.tool.tokenizer.Tokenizer

Packages that use Tokenizer
edu.columbia.cs.api   
edu.columbia.cs.cg.prdualrank   
edu.columbia.cs.cg.prdualrank.index.analyzer   
edu.columbia.cs.ref.model   
edu.columbia.cs.ref.model.constraint.relationship.impl   
edu.columbia.cs.ref.tool.tagger.entity.impl   
edu.columbia.cs.ref.tool.tagger.entity.impl.resources   
edu.columbia.cs.ref.tool.tokenizer.impl   
 

Uses of Tokenizer in edu.columbia.cs.api
 

Constructors in edu.columbia.cs.api with parameters of type Tokenizer
OpenIEUnsupervisedRelationshipExtractor(SentenceSplitter splitter, Tokenizer tokenizer, POSTagger pos, Chunker chunker)
          Constructor of the Open IE relationship extractor.
OpenIEUnsupervisedRelationshipExtractor(SentenceSplitter splitter, Tokenizer tokenizer, POSTagger pos, Chunker chunker, weka.classifiers.Classifier cla)
          Constructor of the Open IE relationship extractor.
OpenIEUnsupervisedRelationshipExtractor(SentenceSplitter splitter, Tokenizer tokenizer, POSTagger pos, Chunker chunker, weka.classifiers.Classifier cla, double threshold)
          Constructor of the Open IE relationship extractor.
OpenIEUnsupervisedRelationshipExtractor(SentenceSplitter splitter, Tokenizer tokenizer, POSTagger pos, Chunker chunker, double threshold)
          Constructor of the Open IE relationship extractor.
 

Uses of Tokenizer in edu.columbia.cs.cg.prdualrank
 

Constructors in edu.columbia.cs.cg.prdualrank with parameters of type Tokenizer
PRDualRank(PatternExtractor<Document> spe, PatternExtractor<Relationship> epe, SearchEngine se, QueryGenerator<java.lang.String> qg, int k_seed, int minsupport, int k_nolabel, RankFunction<Pattern<Document,TokenizedDocument>> searchpatternRankFunction, RankFunction<Pattern<Relationship,TokenizedDocument>> extractpatternRankFunction, RankFunction<Relationship> tupleRankFunction, Tokenizer tokenizer, RelationshipType rType, TokenBasedAnalyzer myAnalyzer, QueryGenerator<org.apache.lucene.search.Query> forIndexQueryGenerator, QuestCalculator<Document,TokenizedDocument> searchPatternQuestCalculator, QuestCalculator<Relationship,TokenizedDocument> extractionPatternQuestCalculator)
          Instantiates a new pR dual rank.
 

Uses of Tokenizer in edu.columbia.cs.cg.prdualrank.index.analyzer
 

Constructors in edu.columbia.cs.cg.prdualrank.index.analyzer with parameters of type Tokenizer
TokenizerBasedAnalyzer(Tokenizer tokenizer, java.util.Set<java.lang.String> stopWords)
          Instantiates a new tokenizer based analyzer.
 

Uses of Tokenizer in edu.columbia.cs.ref.model
 

Constructors in edu.columbia.cs.ref.model with parameters of type Tokenizer
TokenizedDocument(Document d, Tokenizer tokenizer)
          Constructor of the Document
 

Uses of Tokenizer in edu.columbia.cs.ref.model.constraint.relationship.impl
 

Constructors in edu.columbia.cs.ref.model.constraint.relationship.impl with parameters of type Tokenizer
WordDistanceBetweenEntities(Tokenizer tokenizer, int Maxdistance)
          Instantiates a new word distance between entities.
 

Uses of Tokenizer in edu.columbia.cs.ref.tool.tagger.entity.impl
 

Constructors in edu.columbia.cs.ref.tool.tagger.entity.impl with parameters of type Tokenizer
DictionaryBasedEntityTagger(java.lang.String tag, Dictionary dictionary, Tokenizer tokenizer)
          Instantiates a new dictionary based entity tagger.
 

Uses of Tokenizer in edu.columbia.cs.ref.tool.tagger.entity.impl.resources
 

Methods in edu.columbia.cs.ref.tool.tagger.entity.impl.resources with parameters of type Tokenizer
static com.aliasi.tokenizer.TokenizerFactory InstanceBasedTokenizedFactory.getInstance(Tokenizer tokenizer)
           
 

Constructors in edu.columbia.cs.ref.tool.tagger.entity.impl.resources with parameters of type Tokenizer
InstanceBasedTokenizedFactory(Tokenizer tokenizer)
           
 

Uses of Tokenizer in edu.columbia.cs.ref.tool.tokenizer.impl
 

Classes in edu.columbia.cs.ref.tool.tokenizer.impl that implement Tokenizer
 class OpenNLPTokenizer
          The OpenNLPTokenizer is an implementation of the Tokenizer interface that uses OpenNLP models to split the text into tokens.