umpirsky/centipede-crawler

Crawls all unique links.

0.1.2 2016-06-13 10:09 UTC

This package is not auto-updated.

Last update: 2024-03-30 14:26:36 UTC


README

68747470733a2f2f6661726d322e737461746963666c69636b722e636f6d2f313730392f32353039383532363838345f616534643530343635665f6f5f642e706e67

symfony upgrade fixertwig gettext extractorwisdomcentipedepermissions handlerextraloadgravatarlocurrocountry listtransliterator

Centipede Crawler Build Status

Crawls all unique links.

Usage

$urls = (new Centipede\Crawler('http://dev.umpirsky.com'))->crawl();

Asynchronous

(new Centipede\Crawler('http://dev.umpirsky.com'))->crawl(function ($url, GuzzleHttp\Message\FutureResponse $response) {
    printf('(%d) %s', $response->getStatusCode(), $url);
});