crwlr's packages

• PHP

  crwlr/crawler

  Web crawling and scraping library.

  6 154 337

• PHP

  crwlr/crawler-ext-browser

  Extension for the crwlr/crawler package containing steps utilizing a headless browser.

  505 0

• PHP

  crwlr/crwl-extension-utils

  Utils for extension packages for the crwl.io app.

  1 116 0

• PHP

  crwlr/html-2-text

  Convert HTML to formatted plain text.

  4 829 3

• PHP

  crwlr/query-string

  A library for convenient handling of query strings used in HTTP requests.

  1 980 847 18

• PHP

  crwlr/robots-txt

  Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping

  10 171 10

• PHP

  crwlr/schema-org

  Extract schema.org structured data from HTML documents.

  7 532 12

• PHP

  crwlr/url

  Swiss Army knife for URLs.

  40 616 105

• PHP

  crwlr/utils

  Utilities that are needed in multiple crawler packages.

  6 604 2

• PHP

  otsch/ppq

  A very simple PHP queue system to run background tasks.

  876 3

• PHP

  crwlr/crwl-ext-browser

  Extension configurations for integration of crwlr/crawler-ext-browser into the crwl.io app.

  Abandoned! See crwlr/crawler-ext-browser

  205 0