Concordia
SentenceTokenizer Member List

This is the complete list of members for SentenceTokenizer, including all inherited members.

SentenceTokenizer(boost::shared_ptr< ConcordiaConfig > config)SentenceTokenizerexplicit
tokenize(const std::string &sentence, bool byWhitespace=false)SentenceTokenizer
~SentenceTokenizer()SentenceTokenizervirtual