fenom/tokenizer

Stand-alone Fenom's tokenizer

1.0.0 2016-01-19 10:10 UTC

Requires

• php: >=5.3.0
• ext-tokenizer: *

Requires (Dev)

• phpunit/phpunit: *
• satooshi/php-coveralls: dev-master

BSD-3

• Ivan Shalganov

• template
• parser
• tokenizer
• fenom

README

Tokenize everything by tokenizer:

$tokens = new Tokenizer($everything);