zodream/spider

web spider

1.0 2024-03-26 06:41 UTC

Requires

• php: >=8.2
• zodream/database: ^5.3
• zodream/disk: ^5.3
• zodream/helpers: ^5.3
• zodream/http: ^5.3
• zodream/zodream: ^5.3

MIT

• Jason Zou

• spider
• zodream

README

web spider

网页爬虫软件

基本配置

[
    'url' => '开始网址',
    'filter' => '正则限制',
]

代理配置

config.php

这是使用内部模块代理

[
    'spider.proxy' => 'http://zodream.localhost/proxy?format=json'
];

使用方法

$spider = new Spider($configs | $uri);