markuspoerschke/extractum

Extract information from web pages.

1.0.3 2021-07-23 08:00 UTC

Requires

• php: ^7.4 || ^8.0
• ext-dom: *
• ext-json: *
• ml/json-ld: ^1.2
• symfony/css-selector: ^5.1
• symfony/dom-crawler: ^5.1
• voku/stop-words: ^2.0

Requires (Dev)

• ergebnis/composer-normalize: ^2.11
• friendsofphp/php-cs-fixer: ^3.0
• phpmd/phpmd: ^2.9
• phpunit/phpunit: ^9.4
• symfony/finder: ^5.1
• symfony/var-dumper: ^5.2
• vimeo/psalm: ^4.1

MIT

• Markus Poerschke

• scraper
• extractor
• readability

README

Extractum is a PHP library that extracts information from web pages.

Getting Started

Installation

composer require markuspoerschke/extractum

Usage

$uri = 'https://www.example.com/';
$html = file_get_contents($uri);

$extractor = new Extractum\Extractor();
$essence = $extractor->extract($html, $uri);

Extracted Information

The extracted information are returned as an object of type Extractum\Essence.

Property	Description
date	The date when the web page was published.
description	Normally the meta description or any other excerpt.
image	The URL to the preview image. Normally defined as a Open Graph attribute.
language	The two character language code of the HTML tag.
links	All links within the main content.
parsedDate	A DateTimeImmutable object if date
text	Unformatted text of the main content. All new lines and not needed spaces are removed.
title	The web pages’s title. This is normally the content of the first h1 tag.

License

This package is released under the MIT license.