Search by

spacespell / laravel-crawler

phoenixgao

Laravel queue based distributed web crawler framework.

Package info

github.com/spacespell/laravel-crawler

pkg:composer/spacespell/laravel-crawler

Security

Advisories: 0

Aikido package health analysis

Transparency log

Statistics

Installs: 22

Dependents: 0

Suggesters: 0

Stars: 2

Open Issues: 0

v0.1.0 2017-10-25 14:53 UTC

Requires

  • php: >=5.5.9

Requires (Dev)

None

Suggests

  • symfony/dom-crawler: Allows you to use DomCrawler component to ease DOM navigation for HTML and XML documents

Provides

None

Conflicts

None

Replaces

None

MIT 25c17bb6a3fe7560fe3dc39f1578dc25840875b9

  • Phoenix Gao <phoenix.woop@spacespell.com>

crawlerlaravel

Published on Packagist.org on 2017-11-30 16:03 UTC

This package is auto-updated.

Last update: 2026-09-11 00:07:23 UTC

README

Queue based web crawler.

Scope

Crawl Job

Parse Job

Parser Factory

Parser

Error Handling

Throttling