Wrapper around token_get_all

dev-master / 1.0.x-dev 2017-08-12 11:37 UTC

This package is auto-updated.

Last update: 2023-11-19 04:55:22 UTC


Build Status Code Climate Test Coverage Dependencies

What is Tokenizer?

Tokenizer is a wrapper around the token_get_all function. It's built up of three classes:

  1. Token - Each token returned from token_get_all is wrapped in this.
  2. TokenListIterator - Implements SeekableIterator and Countable with extra methods to allow easy moving through tokens.
  3. Tokenizer - Calls token_get_all on the source, turns each result into a Token representation and returns a TokenListIterator object.


You can install Tokenizer by adding hippophp/tokenizer to your composer.json file.


HippoPHP Tokenizer is licensed under The MIT License (MIT)