webignition/robots-txt-parser

This package is abandoned and no longer maintained. The author suggests using the webignition/robots-txt-file package instead.

Parser for robots.txt files

Maintainers

Details

github.com/webignition/robots-txt-parser

Homepage

Source

Issues

Installs: 16 810

Dependents: 0

Suggesters: 0

Security: 0

Stars: 8

Watchers: 3

Forks: 1

Open Issues: 0

2.0 2017-05-09 16:52 UTC

MIT 1c6b54e1f2a8da2772de268af5553de124cc2398

  • Jon Cram <jon.woop@webignition.net>

parserrobots.txt

This package is auto-updated.

Last update: 2022-02-01 12:21:04 UTC

README

This parser has been moved into robots-txt-file and this package has now been abandoned.