jinql
/
awesome-python-cn
mirror of https://github.com/jobbole/awesome-python-cn
1
0
Fork 0
Code Issues Releases Wiki Activity

Add ScrapydWeb

pull/63/head
my8100 2019-03-23 17:52:50 +08:00
parent 3f7e7fd2ab
commit 08a8cf3f4d
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@ -611,6 +611,7 @@ Python 实现的数据库。
爬取网络站点的库
* Scrapy：一个快速高级的屏幕爬取及网页采集框架。[官网](http://scrapy.org/)
* ScrapydWeb：一个用于 Scrapyd 集群管理的全功能 web UI，支持 Scrapy 日志分析和可视化，自动打包，定时器任务和邮件通知等特色功能。[官网](https://github.com/my8100/scrapydweb)
* cola：一个分布式爬虫框架。[官网](https://github.com/chineking/cola)
* Demiurge：基于 PyQuery 的爬虫微型框架。[官网](https://github.com/matiasb/demiurge)
* feedparser：通用 feed 解析器。[官网](http://pythonhosted.org/feedparser/)