nexxes/tokenizer

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP

dev-master 2014-09-08 01:34 UTC

This package is not auto-updated.

Last update: 2024-04-22 23:41:17 UTC


README

Build Status

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP