PHP Interface Camspiers\StatisticalClassifier\Tokenizer\TokenizerInterface

Author: Cam Spiers ([email protected])
Afficher le fichier Open project: camspiers/statistical-classifier Interface Usage Examples

Méthodes publiques

Méthode Description
tokenize ( string $document ) : array Split document into tokens

Method Details

tokenize() public méthode

Split document into tokens
public tokenize ( string $document ) : array
$document string The document to split
Résultat array An array of tokens