webignition/robots-txt-parser

parserrobots.txt

Overall: 1 194 installs
This month: 88 installs
Today: 0 installs

Parser for robots.txt files

Maintainer: webignition
Homepage: https://github.com/webignition/robots-txt-parser
Canonical: https://github.com/webignition/robots-txt-parser
Source: https://github.com/webignition/robots-txt-parser/tree/1.0.1
Issues: https://github.com/webignition/robots-txt-parser/issues