ramphor/rake

The spider/crawler framework written in PHP

dev-master 2022-05-22 09:53 UTC

Requires

• php: >=7.1
• guzzlehttp/psr7: ^1.6
• php-http/httplug: ^2.1
• psr/log: ^1.0.1
• ramphor/httplug-guzzle6-adapter: ^2.0.2
• ramphor/php-html-parser: 3.0.1
• ramphor/sql: 1.0.0

MIT

• Ramphor Premium

README

The spider/crawler framework written in PHP

Example code

$rake  = new Rake( 'rake_id', new Your_DB_Driver(), new Your_HTTP_Client() );
$tooth = new Your_Tooth_Class( 'cp_products', $rake );
$feed  = new Sitemap( 'site_map_url' );
$feed->setTooth( $tooth );

$tooth->registerProcessor( new Your_Processor() );
$tooth->setFormat( Tooth::FORMAT_HTML );
$tooth->addFeed( $feed );

$rake->addTooth( $tooth );
$rake->execute();