nexxes/tokenizer

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP

Installs: 40

Dependents: 2

Suggesters: 0

Security: 0

Stars: 1

Watchers: 1

Forks: 0

pkg:composer/nexxes/tokenizer

dev-master 2014-09-08 01:34 UTC

This package is not auto-updated.

Last update: 2025-10-07 06:32:58 UTC


README

Build Status

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP