PHP Interface Camspiers\StatisticalClassifier\Tokenizer\TokenizerInterface

Author: Cam Spiers ([email protected])
Mostrar archivo Open project: camspiers/statistical-classifier Interface Usage Examples

Public Methods

Method Description
tokenize ( string $document ) : array Split document into tokens

Method Details

tokenize() public method

Split document into tokens
public tokenize ( string $document ) : array
$document string The document to split
return array An array of tokens