itsjjfurki/google-crawl-detector

Logs each request made by Google crawlers.

v1.0.3 2023-03-28 21:36 UTC

Requires

• php: >=8.0
• laravel/framework: >=9.19

Requires (Dev)

• guzzlehttp/guzzle: ^7.5
• laravel/pint: ^1.7
• orchestra/testbench: ^8.1
• phpunit/phpunit: ^10.0
• psalm/plugin-laravel: ^2.8
• vimeo/psalm: ^5.8

MIT

• Furkan OZTURK
• David Majoulian

• google
• detector
• crawl
• itsjjfurki
• google-crawl-detector

README

Google Crawl Detector is a Laravel package that enables logging each request made by Google. It is essential for websites that want to improve their SEO performance to log every request made by Google crawlers. Doing so allows webmasters to obtain valuable insights into how Google crawls and indexes their website. This information can be used to detect potential crawl errors, indexation problems, and areas where optimization is possible.

Installation:

Fetch the package via composer:

composer require itsjjfurki/google-crawl-detector

Publish service provider:

php artisan vendor:publish --provider="Itsjjfurki\GoogleCrawlDetector\GoogleCrawlDetectorServiceProvider"

Migrate to create google_crawls table:

php artisan migrate

Modify and add this to your .env file:

GOOGLE_CRAWL_DETECTOR_ENABLED=true

For more information as to what environment variables you can modify, please check out the config file for this package.

Run the console command to fetch the Google crawler IPs:

php artisan googlecrawlerips:fetch

Optional

In order to fetch Google crawler IPs regularly, create a cronjob to execute scheduled tasks.

Contributing

Please make sure to update tests as appropriate.

Please make sure to write tests and run them as often as possible.

Please make sure to keep the tests fast (less than a second) as you will be running them often.

Please make sure you follow the project code style guides. It currently uses Laravel Pint's default settings.

Please make sure you do all of the above before creating a pull request :)

In order to run the tests and make sure that the project code style guidelines are followed, you can run the following command:

composer check

License

The MIT License (MIT). Please see License File for more information.