nexxes/tokenizer

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP

dev-master 2014-09-08 01:34 UTC

This package is not auto-updated.

Last update: 2024-11-05 02:07:59 UTC


README

Build Status

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP