pavolbiely/bazos-crawler

PHP Crawler for downloading ads and categories from bazos.sk, bazos.cz or bazos.at.

dev-master 2024-05-15 16:37 UTC

Requires

• php: >=7.1
• ext-curl: *
• ext-tidy: *
• nette/tester: 1.7.x

MIT

• Pavol Biely

README

PHP Crawler for downloading ads and categories from bazos.sk, bazos.cz or bazos.at.

Usage

Use composer to install this package.

Download ads from single category

$crawler = new Bazos\Crawler();

$items = $crawler->crawlAds('https://auto.bazos.sk/', 5); // 5 means number of pages to parse, default is 1

foreach ($items as $item) {
    echo $item->getTitle() . "\n";
}

Download ads from all categories

$crawler = new Bazos\Crawler();

$categories = $crawler->crawlCategories($crawler::URL_SK);

foreach ($categories as $category) {
	$items = $crawler->crawlAds($category->getLink(), 5); // 5 means number of pages to parse, default is 1

	foreach ($items as $item) {
	    echo $item->getTitle() . "\n";
	}
}

How to run tests?

Tests are build with Nette Tester. You can run it like this:

tester.bat -c php.ini-win --coverage coverage.html --coverage-src ../src

Minimum requirements

• PHP 7.1+
• ext-curl
• ext-tidy

Disclaimer

Please do not abuse the Bazos portal. I've developed this crawler just for tracking bike ads where I was looking for the one someone stole from me.

License

MIT License (c) Pavol Biely

Read the provided LICENSE file for details.