Wrapper around token_get_all
Tokenizer is a wrapper around the
token_get_all function. It's built up of three classes:
Token- Each token returned from
token_get_allis wrapped in this.
Countablewith extra methods to allow easy moving through tokens.
token_get_allon the source, turns each result into a
Tokenrepresentation and returns a
You can install Tokenizer by adding
hippophp/tokenizer to your
HippoPHP Tokenizer is licensed under The MIT License (MIT)