ranvis/robots-txt-processor-test

robots.txt processor feature/behavior test.

dev-master 2022-01-11 12:59 UTC

Requires

• php: >=7.0.0
• ext-yaml: >=2.0.0RC7

Requires (Dev)

• bee4/robots.txt: dev-master
• diggin/diggin-robotrules: dev-master
• m6web/roboxt: dev-master
• ranvis/robots-txt-processor: dev-master
• t1gor/robots-txt-parser: dev-master
• tomverran/robots-txt-checker: dev-master

BSD-2-Clause

• SATO Kentaro

• robots.txt
• testsuite

README

See the feature/behavior test result in wiki.

TODO: describe usage and YAML schema

Note

This project is started as a research of robots.txt parsers to find out which one is best suited for my need. While the test runner can show failing tests on third party modules, A failure doesn't necessarily mean a bug of the module. Since there's no real RFC for robots.txt, there are no correct behaviors for some of notations and each module is more or less implemented in its own right way.