webignition/robots-txt-parser

parserrobots.txt

Overall: 1 213 installs
This month: 107 installs
Today: 0 installs

Parser for robots.txt files

Maintainer: webignition
Homepage: https://github.com/webignition/robots-txt-parser
Canonical: https://github.com/webignition/robots-txt-parser
Source: https://github.com/webignition/robots-txt-parser/tree/1.0.1
Issues: https://github.com/webignition/robots-txt-parser/issues