hippophp/tokenizer

This package is abandoned and no longer maintained. No replacement package was suggested.

Wrapper around token_get_all

Maintainers

Details

github.com/HippoPHP/Tokenizer

Homepage

Source

Issues

Wiki

Installs: 1 122

Dependents: 1

Suggesters: 0

Security: 0

Stars: 8

Watchers: 3

Forks: 0

Open Issues: 2

pkg:composer/hippophp/tokenizer

dev-master / 1.0.x-dev 2017-08-12 11:37 UTC

Requires

  • php: >=5.5.9
  • ext-tokenizer: *

Requires (Dev)

MIT 5c51c0ffad0b1692c7f338e9b2c101050065ab36

tokenizertokenhippophp

This package is auto-updated.

Last update: 2025-04-19 08:04:57 UTC

README

Build Status Code Climate Test Coverage Dependencies

What is Tokenizer?

Tokenizer is a wrapper around the token_get_all function. It's built up of three classes:

  1. Token - Each token returned from token_get_all is wrapped in this.
  2. TokenListIterator - Implements SeekableIterator and Countable with extra methods to allow easy moving through tokens.
  3. Tokenizer - Calls token_get_all on the source, turns each result into a Token representation and returns a TokenListIterator object.

Installation

You can install Tokenizer by adding hippophp/tokenizer to your composer.json file.

License

HippoPHP Tokenizer is licensed under The MIT License (MIT)