Search by

nexxes / tokenizer

dennisbirkholz

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP

Package info

github.com/nexxes/php-tokenizer

pkg:composer/nexxes/tokenizer

Security

Advisories: 0

Aikido package health analysis

Transparency log

Statistics

Installs: 40

Dependents: 2

Suggesters: 0

Stars: 1

dev-master 2014-09-08 01:34 UTC

Requires

  • php: >=5.4.0

Requires (Dev)

None

Suggests

None

Provides

None

Conflicts

None

Replaces

None

LGPL-3.0 267db51f04425f30f646bfb483dae09b67f8dd25

  • Dennis Birkholz, nexxes Informationstechnik GmbH <dennis.birkholz.woop@nexxes.net>

parsertokenizertoken

Published on Packagist.org on 2025-09-09 06:14 UTC

This package is auto-updated.

Last update: 2026-08-19 18:37:33 UTC

README

Build Status

Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP