bootjp/crawler

This package is abandoned and no longer maintained. No replacement package was suggested.

Web pages 404 and soft 404 checker

0.0.7 2016-06-05 03:26 UTC

Requires

• guzzlehttp/guzzle: 5.x.x

MIT

• bootjp

README

Now Beta2 Version relese.

• https://github.com/bootjp/crawler/releases

Makeing now...

How To Use

• Use composer
  • You do not know composer?
    • OK, GO to page => https://getcomposer.org/

Introduction

$ curl -s http://getcomposer.org/installer | php
$ php composer.phar install
or
$ composer install

Use Ex.

$ php wrapper.php --url=https://bootjp.me
or
$  php wrapper.php --url=https://bootjp.me --recursion=false

-> https://bootjp.me/ is root on the contents link check

$ php wrapper.php --url=https://bootjp.me --recursion=true

-> https://bootjp.me/ is on the contents link all check

Use docker images

dockerImage is hire -> https://hub.docker.com/r/bootjp/crawler

docker pull bootjp/crawler
docker run bootjp/crawler php wrapper.php --url=https://bootjp.me --recursion=false --auth=username:password

Basic Auth

$ php wrapper.php --url=https://bootjp.me --recursion=false --auth=username:password

LICENSE

日本語での解説記事(ちょっと古い)