shark/README.md

Shark

(Plunder)

可配置、插件化的爬虫引擎，二次开发框架。仅用于研究学习，请遵守当地法律。

Configurable, pluginable crawler engine, secondary development framework.

Modules：

Engine、Scheduler、ExcludeDuplicateFilter、Downloader、Analyzer、Producer、ResultPipeline、Log、Configuration ...

Version

0.8 beta

License

Apache License, Version 2.0

Contact

supnebula@gmail.com