aoepeople/crawler

This package is abandoned and no longer maintained. The author suggests using the tomasnorre/crawler package instead.

Crawler extension for TYPO3

12.0.4 2024-06-13 08:27 UTC

Requires

• php: ~8.1.0 || ~8.2.0 || ~8.3.0
• ext-json: *
• ext-pdo: *
• beberlei/assert: ^3.3
• guzzlehttp/guzzle: ^6.4.1 || ^7.2
• psr/http-message: ^2.0
• psr/log: ^1.0 || ^2.0 || ^3.0
• symfony/console: ^6.4 || ^7.0
• typo3/cms-backend: ^12.4
• typo3/cms-core: ^12.4
• typo3/cms-frontend: ^12.4
• typo3/cms-info: ^12.4
• typo3/cms-seo: ^12.4

Requires (Dev)

• codeception/codeception: ^5.0
• codeception/module-asserts: ^3.0
• codeception/module-filesystem: ^3.0
• codeception/module-phpbrowser: ^3.0
• codeception/module-webdriver: ^4.0
• infection/infection: ^0.26
• nikic/php-parser: ^4.13
• phpspec/prophecy-phpunit: ^2.0
• phpstan/extension-installer: ^1.2
• phpstan/phpstan: ^1.9
• phpstan/phpstan-deprecation-rules: ^1.0
• phpunit/phpunit: ^10.5
• rector/rector: ^1.0
• roave/security-advisories: dev-latest
• saschaegerer/phpstan-typo3: ^1.8
• sbuerk/typo3-cmscomposerinstallers-testingframework-bridge: ^0.1
• slam/phpstan-extensions: ^6.0
• ssch/typo3-rector: ^2.0
• ssch/typo3-rector-testing-framework: *
• symfony/yaml: ^6.4 || ^7.0
• symplify/easy-coding-standard: ^12.2
• symplify/phpstan-rules: ^12.7
• tomasvotruba/cognitive-complexity: ^0.2
• tomasvotruba/type-coverage: ^0.3
• typo3/testing-framework: ^8.0

Suggests

• typo3/cms-seo: Enables the posibility to priorities your Crawler Queue + You have seo features in the CMS it self.

Replaces

• aoepeople/crawler: 12.0.4
• typo3-ter/crawler: 12.0.4

GPL-3.0

• Tomas Norre Mikkelsen

README

Libraries and scripts for crawling the TYPO3 page tree. Used for re-caching, re-indexing, publishing applications etc.

You can include the crawler in your TYPO3 project with composer or from TER

composer require tomasnorre/crawler

Crawler processes

Versions and Support

Documentation

Please read the documentation

To render the documentation locally, please use the official TYPO3 Documentation rendering Docker Tool. https://github.com/t3docs/docker-render-documentation

Contributions

Please see CONTRIBUTING.md

Honorable Previous Maintainers

• Kasper Skaarhoj
• Daniel Poetzinger
• Fabrizio Branca
• Tolleiv Nietsch
• Timo Schmidt
• Michael Klapper
• Stefan Rotsch