wangjian/spiderman

the high performance crawler framework

dev-master 2018-09-05 09:57 UTC

Requires

• php: ~7.0
• guzzlehttp/guzzle: ^6.3
• imangazaliev/didom: ^1.13
• predis/predis: ^1.1

Requires (Dev)

• phpunit/phpunit: ^6.0

MIT

• Wangjian

• crawler

README

Spiderman is a high performance crawler framework, which you can use to develop your own crawler application in only a few minutes.

Requirements

• PHP 5.6 or higher
• ext-pcntl
• ext-sysvmsg
• ext-sysvsem

installation

composer require wangjian/spiderman

Usage

Please refer to the examples