PHP
Fast Concurrent Crawler
Abandoned!
Latest version requires dezento/effective-url-middleware ^1.0
24 7