thecargoagency/sitemaps

There is no license information available for the latest version (dev-master) of this package.

Sitemap builder & site crawler

dev-master / 1.0.x-dev 2015-08-28 16:45 UTC

This package is not auto-updated.

Last update: 2024-04-17 07:28:36 UTC


README

Sitemap builder & site crawler

// example
use Goutte\Client;
use Cargo\Sitemap\Fetcher;
use Cargo\Sitemap\Builder;

$client = new Client();

$fetcher = new Fetcher($client);
$fetcher->setMaxUrlNumber(100);
$fetcher->excludeDirectories(['/test-dir']);
$fetcher->excludeFiles(['/sitemap.html']);
$urls = $fetcher->crawl('http://www.example.com');

$builder = new Builder();
echo $builder->output($urls);