nexxes/tokenizer

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP

dev-master 2014-09-08 01:34 UTC

This package is not auto-updated.

Last update: 2024-12-17 02:43:51 UTC


README

Build Status

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP