hotrush/stealer

Async website scrapper tool like scrapy built with reactphp.

0.1.10 2019-10-15 20:30 UTC

Requires

• php: >=7.1
• campo/random-user-agent: ^1.2
• guzzlehttp/guzzle: ^6.0
• josegonzalez/dotenv: ^2.1
• monolog/monolog: ^1.22
• nikic/fast-route: ^1.3
• react/dns: ^0.4
• react/event-loop: ^0.5
• react/http: ^0.8
• react/promise: ~2.5
• react/socket: ^0.8
• react/stream: ^0.7
• symfony/css-selector: ^3.2
• symfony/dom-crawler: ^3.2
• wyrihaximus/react-guzzle-psr7: ^2.0

Requires (Dev)

• phpunit/phpunit: ^7.0

Suggests

• hotrush/stealer-scrapoxy-client: Async scrapoxy client
• pda/pheanstalk: Beanstalkd client for adapter
• react/mysql: Async client for mysql adapter

MIT

• hotrush

README

Stealer

Async website scrapper tool like scrapy built with reactphp. Docs and examples are coming.

TODO

• Higher tests coverage
• Docs and examples
• Add more adapters:
  • https://github.com/jakubkulhan/bunny
  • https://github.com/bzikarsky/react-gearman
  • https://github.com/nrk/predis-async or https://github.com/clue/php-redis-react