Repository Analysis

wistbean/learn_python3_spider

python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等

3.1 Likely human-written View on GitHub

3.1

Adjusted Score

3.1

Raw Score

100%

Time Factor

2026-05-17

Last Push

21,737

Stars

Python

Language

9,844

Lines of Code

68

Files

22

Pattern Hits

2026-05-31

Scan Date

Score History

Severity Breakdown

CRITICAL 0HIGH 0MEDIUM 4LOW 18

Pattern Findings

22 matches across 4 categories. Click a row to expand file-level details.

Over-Commented Block14 hits · 14 pts

Severity	File	Line	Snippet
LOW	qiushibaike/qiushibaike/middlewares.py	61	# scrapy acts as if the downloader middleware does not modify the
LOW	qiushibaike/qiushibaike/middlewares.py	81	return None
LOW	qiushibaike/qiushibaike/settings.py	21	USER_AGENT = 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/73.0.3683.86 Chrome
LOW	qiushibaike/qiushibaike/settings.py	41	#TELNETCONSOLE_ENABLED = False
LOW	qiushibaike/qiushibaike/settings.py	61	# Enable or disable extensions
LOW	qiushibaike/qiushibaike/settings.py	81	# each remote server
LOW	qiushibaike/qiushibaike/spiders/__init__.py	1	# This package will contain the spiders of your Scrapy project
LOW	stackoverflow/stackoverflow/middlewares.py	61	# scrapy acts as if the downloader middleware does not modify the
LOW	stackoverflow/stackoverflow/middlewares.py	81	return None
LOW	stackoverflow/stackoverflow/settings.py	21	# Obey robots.txt rules
LOW	stackoverflow/stackoverflow/settings.py	41	# Override the default request headers:
LOW	stackoverflow/stackoverflow/settings.py	61	#EXTENSIONS = {
LOW	stackoverflow/stackoverflow/settings.py	81	# Enable showing throttling stats for every response received:
LOW	stackoverflow/stackoverflow/spiders/__init__.py	1	# This package will contain the spiders of your Scrapy project

Self-Referential Comments4 hits · 12 pts

Severity	File	Line	Snippet
MEDIUM	qiushibaike/qiushibaike/middlewares.py	18	# This method is used by Scrapy to create your spiders.
MEDIUM	qiushibaike/qiushibaike/middlewares.py	66	# This method is used by Scrapy to create your spiders.
MEDIUM	stackoverflow/stackoverflow/middlewares.py	18	# This method is used by Scrapy to create your spiders.
MEDIUM	stackoverflow/stackoverflow/middlewares.py	66	# This method is used by Scrapy to create your spiders.

Slop Phrases2 hits · 3 pts

Severity	File	Line	Snippet
LOW	qiushibaike/qiushibaike/pipelines.py	5	# Don't forget to add your pipeline to the ITEM_PIPELINES setting
LOW	stackoverflow/stackoverflow/pipelines.py	5	# Don't forget to add your pipeline to the ITEM_PIPELINES setting

Unused Imports2 hits · 2 pts

Severity	File	Line	Snippet
LOW	meizitu.py	4
LOW	qiushibaike/qiushibaike/spiders/qiushibaike_spider.py	2