• 홈
• TextAnalysis
• Tokenizers

PHP TextAnalysis\Tokenizers 네임스페이스

클래스들

이름	설명
PennTreeBankTokenizer	PennTreeBank Tokenizer Based on http://www.cis.upenn.edu/~treebank/tokenizer.sed
SentenceTokenizer	Tokenize on periods, question marks and exclamations
WhitespaceTokenizer	Description of WhitespaceTokenizer