Spider/NewsSpider
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20 Commits 2 Branches 4 Tags 22 MiB
9da1dac6e8
Commit Graph

3 Commits

Author SHA1 Message Date
lzjqsdd
cbb2cc26b3 对新闻中引号转码修复写入数据库语法错误，div.py从数据加载标题并分词 2016-04-25 22:19:00 +08:00
lzjqsdd
d7a3e28f59 增加UserAgent池防止爬虫被禁，增加进程锁防止同时开启多个爬虫写入同一个文件出现错误数据 2016-04-23 12:34:35 +08:00
lzjqsdd
3201d09c43 Add TencentSpider,Add SelfDefine Command to run mulity spider 2016-04-22 10:14:42 +08:00