Repository Analysis

cv-cat/Spider_XHS

小红书爬虫数据采集,小红书全域运营解决方案

16.3 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of cv-cat/Spider_XHS, a Python project with 7,116 GitHub stars. SynthScan v2.0 examined 13,464 lines of code across 67 source files, recording 198 pattern matches distributed across 8 syntactic categories. The overall adjusted score of 16.3 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

16.3
Adjusted Score
16.3
Raw Score
100%
Time Factor
2026-07-29
Last Push
7.1K
Stars
Python
Language
13.5K
Lines of Code
67
Files
198
Pattern Hits
2026-08-02
Scan Date
0.12
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 8MEDIUM 3LOW 187

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 198 distinct pattern matches across 8 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Unused Imports52 hits · 52 pts
SeverityFileLineSnippetContext
LOWxhs_utils/xhs_auth.py3CODE
LOWxhs_utils/xhs_auth.py3CODE
LOWxhs_utils/xhs_auth.py3CODE
LOWxhs_utils/xhs_auth.py3CODE
LOWxhs_utils/xhs_auth.py10CODE
LOWxhs_utils/xhs_auth.py10CODE
LOWxhs_utils/xhs_auth.py10CODE
LOWxhs_utils/xhs_auth.py10CODE
LOWxhs_utils/xhs_auth.py10CODE
LOWxhs_utils/xhs_auth.py17CODE
LOWxhs_utils/xhs_auth.py17CODE
LOWxhs_utils/xhs_auth.py17CODE
LOWxhs_utils/data_util.py2CODE
LOWxhs_utils/xhs_util.py3CODE
LOWxhs_utils/xhs_util.py4CODE
LOWxhs_utils/xhs_pc/auth.py4CODE
LOWxhs_utils/xhs_pc/dsl.py43CODE
LOWxhs_utils/xhs_pc/__init__.py13CODE
LOWxhs_utils/xhs_pc/__init__.py13CODE
LOWxhs_utils/xhs_pc/__init__.py13CODE
LOWxhs_utils/xhs_pc/__init__.py14CODE
LOWxhs_utils/xhs_pc/__init__.py15CODE
LOWxhs_utils/xhs_pc/__init__.py15CODE
LOWxhs_utils/xhs_pc/runtime.py10CODE
LOWxhs_utils/xhs_pc/http.py3CODE
LOWxhs_utils/xhs_pc/state.py8CODE
LOWxhs_utils/xhs_creator/auth.py3CODE
LOWxhs_utils/xhs_creator/params.py3CODE
LOWxhs_utils/xhs_creator/params.py18CODE
LOWxhs_utils/xhs_creator/params.py19CODE
LOWxhs_utils/xhs_creator/__init__.py10CODE
LOWxhs_utils/xhs_creator/__init__.py10CODE
LOWxhs_utils/xhs_creator/__init__.py11CODE
LOWxhs_utils/xhs_creator/__init__.py12CODE
LOWxhs_utils/xhs_creator/__init__.py13CODE
LOWxhs_utils/xhs_creator/__init__.py13CODE
LOWxhs_utils/xhs_creator/runtime.py7CODE
LOWxhs_utils/xhs_creator/runtime.py16CODE
LOWxhs_utils/xhs_creator/http.py3CODE
LOWxhs_utils/xhs_creator/state.py8CODE
LOWxhs_utils/xhs_core/cookies.py3CODE
LOWxhs_utils/xhs_core/auth.py3CODE
LOWxhs_utils/xhs_core/params.py3CODE
LOWxhs_utils/xhs_core/dsl.py3CODE
LOWxhs_utils/xhs_core/__init__.py3CODE
LOWxhs_utils/xhs_core/__init__.py3CODE
LOWxhs_utils/xhs_core/__init__.py3CODE
LOWxhs_utils/xhs_core/__init__.py3CODE
LOWxhs_utils/xhs_core/__init__.py3CODE
LOWxhs_utils/xhs_core/__init__.py10CODE
LOWxhs_utils/xhs_core/runtime.py3CODE
LOWxhs_utils/xhs_core/http.py8CODE
Excessive Try-Catch Wrapping55 hits · 50 pts
SeverityFileLineSnippetContext
LOWxhs_utils/xhs_pc/dsl.py109 except Exception as e:CODE
LOWxhs_utils/xhs_core/dsl.py71 except Exception as exc:CODE
LOWapis/xhs_creator_login_apis.py260 except Exception:CODE
LOWapis/xhs_creator_login_apis.py579 except Exception as error:CODE
LOWapis/xhs_creator_login_apis.py1021 except Exception as error:CODE
LOWapis/xhs_pc_login_apis.py476 except Exception as e:CODE
LOWapis/xhs_pc_login_apis.py778 except Exception as exc:CODE
LOWapis/xhs_pc_login_apis.py803 except Exception as exc:CODE
LOWapis/xhs_pc_login_apis.py820 except Exception as exc:CODE
LOWapis/xhs_pc_login_apis.py850 except Exception as exc:CODE
LOWapis/xhs_creator_apis.py219 except Exception as error:CODE
LOWapis/xhs_creator_apis.py253 except Exception as error:CODE
LOWapis/xhs_creator_apis.py278 except Exception as error:CODE
LOWapis/xhs_creator_apis.py310 except Exception as error:CODE
LOWapis/xhs_creator_apis.py378 except Exception as error:CODE
LOWapis/xhs_creator_apis.py414 except Exception as error:CODE
LOWapis/xhs_creator_apis.py445 except Exception as error:CODE
LOWapis/xhs_creator_apis.py788 except Exception as error:CODE
MEDIUMapis/xhs_creator_apis.py223def get_topic(self, keyword, proxies=None):CODE
MEDIUMapis/xhs_creator_apis.py258def get_location_info(self, keyword, proxies=None):CODE
MEDIUMapis/xhs_creator_apis.py284def get_fileIds(self, media_type, proxies=None):CODE
LOWapis/xhs_pc_apis.py166 except Exception as e:CODE
LOWapis/xhs_pc_apis.py217 except Exception as e:CODE
LOWapis/xhs_pc_apis.py245 except Exception as e:CODE
LOWapis/xhs_pc_apis.py269 except Exception as e:CODE
LOWapis/xhs_pc_apis.py287 except Exception as e:CODE
LOWapis/xhs_pc_apis.py315 except Exception as e:CODE
LOWapis/xhs_pc_apis.py347 except Exception as e:CODE
LOWapis/xhs_pc_apis.py375 except Exception as e:CODE
LOWapis/xhs_pc_apis.py406 except Exception as e:CODE
LOWapis/xhs_pc_apis.py434 except Exception as e:CODE
LOWapis/xhs_pc_apis.py465 except Exception as e:CODE
LOWapis/xhs_pc_apis.py500 except Exception as e:CODE
LOWapis/xhs_pc_apis.py521 except Exception as e:CODE
LOWapis/xhs_pc_apis.py594 except Exception as e:CODE
LOWapis/xhs_pc_apis.py628 except Exception as e:CODE
LOWapis/xhs_pc_apis.py659 except Exception as e:CODE
LOWapis/xhs_pc_apis.py685 except Exception as e:CODE
LOWapis/xhs_pc_apis.py714 except Exception as e:CODE
LOWapis/xhs_pc_apis.py740 except Exception as e:CODE
LOWapis/xhs_pc_apis.py769 except Exception as e:CODE
LOWapis/xhs_pc_apis.py798 except Exception as e:CODE
LOWapis/xhs_pc_apis.py822 except Exception as e:CODE
LOWapis/xhs_pc_apis.py839 except Exception as e:CODE
LOWapis/xhs_pc_apis.py862 except Exception as e:CODE
LOWapis/xhs_pc_apis.py887 except Exception as e:CODE
LOWapis/xhs_pc_apis.py910 except Exception as e:CODE
LOWapis/xhs_pc_apis.py935 except Exception as e:CODE
LOWapis/xhs_pc_apis.py958 except Exception as e:CODE
LOWapis/xhs_pc_apis.py983 except Exception as e:CODE
LOWapis/xhs_pc_apis.py1008 except Exception as e:CODE
LOWapis/xhs_pc_apis.py1041 except Exception as e:CODE
LOWspider/spider.py22 except Exception as e:CODE
LOWspider/spider.py67 except Exception as e:CODE
LOWspider/spider.py99 except Exception as e:CODE
Cross-Language Confusion8 hits · 35 pts
SeverityFileLineSnippetContext
HIGHxhs_utils/xhs_pc/dsl.py19 glb['_BHjFmfUMEtxhI'](__$c, [,,undefined,Uint8Array,getdss])STRING
HIGHxhs_utils/xhs_creator/auth.py232 Creator ``mns0101`` calls ``_dsf(null, 24-byte input)`` from the DSSTRING
HIGHapis/xhs_creator_login_apis.py376 dsl_pair_value='null;undefined',CODE
HIGHapis/xhs_creator_login_apis.py453 dsl_pair_value='null;undefined',CODE
HIGHapis/xhs_creator_login_apis.py477 dsl_pair_value='null;undefined',CODE
HIGHapis/xhs_creator_login_apis.py697 dsl_pair_value='null;undefined',CODE
HIGHapis/xhs_creator_login_apis.py755 dsl_pair_value='null;undefined',CODE
HIGHapis/xhs_pc_login_apis.py190 dsl_pair = f'null;{self.dsl}'CODE
Modern Structural Boilerplate30 hits · 30 pts
SeverityFileLineSnippetContext
LOWxhs_utils/xhs_auth.py23__all__ = [CODE
LOWxhs_utils/xhs_pc/auth.py311 def update_cookies(self, cookies: Any, *, source_url: str = '') -> None:CODE
LOWxhs_utils/xhs_pc/auth.py514 def _set_dsl(self, value: str) -> None:CODE
LOWxhs_utils/xhs_pc/auth.py522__all__ = ['PC_PARAMETER_SOURCES', 'XHSAuth', 'XHSPcAuth']CODE
LOWxhs_utils/xhs_pc/params.py478__all__ = [CODE
LOWxhs_utils/xhs_pc/__init__.py17__all__ = [CODE
LOWxhs_utils/xhs_pc/runtime.py272__all__ = [CODE
LOWxhs_utils/xhs_pc/http.py32__all__ = [CODE
LOWxhs_utils/xhs_pc/state.py325 def set_rwp_login_token(self, token: Mapping[str, Any]) -> None:CODE
LOWxhs_utils/xhs_pc/state.py461 def update_cookies(self, cookies: Any) -> None:CODE
LOWxhs_utils/xhs_pc/state.py663__all__ = [CODE
LOWxhs_utils/xhs_creator/auth.py262 def update_cookies(self, cookies: Any, *, source_url: str = '') -> None:CODE
LOWxhs_utils/xhs_creator/auth.py411 def _set_dsl(self, value: str) -> None:CODE
LOWxhs_utils/xhs_creator/auth.py423__all__ = ['CREATOR_PARAMETER_SOURCES', 'XHSCreatorAuth']CODE
LOWxhs_utils/xhs_creator/params.py339__all__ = [CODE
LOWxhs_utils/xhs_creator/dsl.py37__all__ = ['get_dsl', 'get_ds_bundle', 'DSN_READY', 'DSN_BOOTSTRAP']CODE
LOWxhs_utils/xhs_creator/__init__.py15__all__ = [CODE
LOWxhs_utils/xhs_creator/runtime.py178__all__ = [CODE
LOWxhs_utils/xhs_creator/http.py32__all__ = [CODE
LOWxhs_utils/xhs_creator/state.py396 def update_cookies(self, cookies: Any) -> None:CODE
LOWxhs_utils/xhs_creator/state.py583__all__ = [CODE
LOWxhs_utils/xhs_core/cookies.py174__all__ = [CODE
LOWxhs_utils/xhs_core/auth.py124__all__ = [CODE
LOWxhs_utils/xhs_core/params.py34__all__ = ['generate_x_b3_traceid', 'generate_xray_traceid', 'splice_str']CODE
LOWxhs_utils/xhs_core/dsl.py123__all__ = ['DsFetcher']CODE
LOWxhs_utils/xhs_core/__init__.py12__all__ = [CODE
LOWxhs_utils/xhs_core/runtime.py87__all__ = ['run_node_json', 'generate_websectiga']CODE
LOWxhs_utils/xhs_core/http.py185__all__ = [CODE
LOWapis/xhs_creator_login_apis.py1173__all__ = ['XHSCreatorLoginApi']CODE
LOWapis/xhs_creator_apis.py834__all__ = ['XHS_Creator_Apis', 'XHSCreatorApis']CODE
Hyper-Verbose Identifiers29 hits · 29 pts
SeverityFileLineSnippetContext
LOWmain.py49def _fetch_and_print_creator_notes(CODE
LOWxhs_utils/xhs_qianfan_util.py4def get_qianfan_headers_template():CODE
LOWxhs_utils/xhs_pugongying_util.py7def get_pugongying_headers_template():CODE
LOWxhs_utils/xhs_pugongying_util.py30def generate_pugongying_headers(cookies, api, data='', profile=None):CODE
LOWxhs_utils/xhs_pugongying_util.py49def get_pugongying_bozhu_data(page, brandUserId, contentTag=None):CODE
LOWxhs_utils/xhs_creator_util.py48def load_creator_rap_fingerprint_hex() -> str:CODE
LOWxhs_utils/xhs_pc/params.py118def generate_search_request_id():CODE
LOWxhs_utils/xhs_pc/params.py124def generate_search_session_id():CODE
LOWxhs_utils/xhs_pc/params.py325def get_request_headers_template(CODE
LOWxhs_utils/xhs_pc/params.py364def build_pc_navigation_headers(headers, cookies=None):CODE
LOWxhs_utils/xhs_pc/params.py393def build_pc_business_headers(headers, cookies, *, api, method='POST'):CODE
LOWxhs_utils/xhs_creator/params.py92def build_creator_navigation_headers(headers, cookies=None):CODE
LOWxhs_utils/xhs_creator/params.py101def build_creator_login_headers(headers, cookies=None, *, kind='security'):CODE
LOWxhs_utils/xhs_creator/params.py123def build_creator_business_headers(headers, cookies=None, *, method='GET'):CODE
LOWxhs_utils/xhs_creator/params.py150def get_request_headers_template(CODE
LOWxhs_utils/xhs_creator/params.py257def generate_profile_request_params(CODE
LOWapis/xhs_creator_login_apis.py62def _order_creator_login_cookies(cookies: dict) -> dict:CODE
LOWapis/xhs_creator_login_apis.py228 def _add_service_ratelimit_header(self, headers):CODE
LOWapis/xhs_creator_login_apis.py437 def _finish_security_bootstrap(self) -> None:CODE
LOWapis/xhs_creator_login_apis.py517 def _require_security_cookies(self, names=None) -> None:CODE
LOWapis/xhs_creator_apis.py96def _creator_note_manager_headers(headers, cookies, *, user_info=False):CODE
LOWapis/xhs_creator_apis.py634 def extract_video_cover_and_metadata(self, video):CODE
LOWapis/xhs_creator_apis.py723 # def get_all_publish_note_info(self, proxies=None):COMMENT
LOWapis/xhs_creator_apis.py826 def get_all_publish_note_info(self, proxies=None):CODE
LOWapis/xhs_pc_apis.py222 def get_homefeed_recommend_by_num(self, category, require_num, proxies: dict = None):CODE
LOWapis/xhs_pc_apis.py380 def get_user_all_like_note_info(self, user_url: str, proxies: dict = None):CODE
LOWapis/xhs_pc_apis.py411 def get_user_collect_note_info(self, user_id: str, cursor: str, xsec_token='', xsec_source='', proxies: dict = None)CODE
LOWapis/xhs_pc_apis.py439 def get_user_all_collect_note_info(self, user_url: str, proxies: dict = None):CODE
LOWapis/xhs_pc_apis.py774 def get_note_all_inner_comment(self, comment: dict, xsec_token: str, proxies: dict = None):CODE
AI Structural Patterns12 hits · 12 pts
SeverityFileLineSnippetContext
LOWxhs_utils/xhs_pc/auth.py323CODE
LOWxhs_utils/xhs_pc/params.py411CODE
LOWxhs_utils/xhs_pc/params.py444CODE
LOWxhs_utils/xhs_pc/runtime.py201CODE
LOWxhs_utils/xhs_creator/params.py150CODE
LOWxhs_utils/xhs_creator/params.py203CODE
LOWxhs_utils/xhs_creator/params.py257CODE
LOWapis/xhs_creator_login_apis.py184CODE
LOWapis/xhs_pc_login_apis.py44CODE
LOWapis/xhs_creator_apis.py147CODE
LOWapis/xhs_pc_apis.py526CODE
LOWspider/spider.py73CODE
Deep Nesting8 hits · 7 pts
SeverityFileLineSnippetContext
LOWxhs_utils/data_util.py210CODE
LOWxhs_utils/xhs_qianfan_util.py42CODE
LOWxhs_utils/xhs_pugongying_util.py84CODE
LOWxhs_utils/xhs_pc/params.py373CODE
LOWxhs_utils/xhs_pc/params.py393CODE
LOWxhs_utils/xhs_creator/params.py101CODE
LOWapis/xhs_pc_apis.py526CODE
LOWapis/xhs_pc_apis.py1015CODE
Over-Commented Block4 hits · 4 pts
SeverityFileLineSnippetContext
LOWapis/xhs_creator_login_apis.py41)COMMENT
LOWapis/xhs_creator_apis.py681 return encoded.tobytes(), metadataCOMMENT
LOWapis/xhs_creator_apis.py701 # }COMMENT
LOWapis/xhs_creator_apis.py721 #COMMENT