vanry/tokenizer

支持 scws, phpanalysis 和 jieba 的中文分词器

dev-master 2021-06-29 03:20 UTC

Requires

• php: ^7.0|^8.0

Requires (Dev)

• ext-scws: *
• fukuball/jieba-php: ^0.33
• lmz/phpanalysis: ^1.0

Suggests

• ext-scws: Required to use the SCWS tokenizer (*).
• fukuball/jieba-php: Required to use the Jieba tokenizer (^0.3).
• lmz/phpanalysis: Required to use the Phpanalysis tokenizer (^1.0).

MIT

• Vanry

• tokenizer