小红书爬虫数据采集,小红书全域运营解决方案
This report presents the forensic synthetic code analysis of cv-cat/Spider_XHS, a Python project with 7,116 GitHub stars. SynthScan v2.0 examined 13,464 lines of code across 67 source files, recording 198 pattern matches distributed across 8 syntactic categories. The overall adjusted score of 16.3 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 198 distinct pattern matches across 8 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | xhs_utils/xhs_auth.py | 3 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 3 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 3 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 3 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 10 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 10 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 10 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 10 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 10 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 17 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 17 | CODE | |
| LOW | xhs_utils/xhs_auth.py | 17 | CODE | |
| LOW | xhs_utils/data_util.py | 2 | CODE | |
| LOW | xhs_utils/xhs_util.py | 3 | CODE | |
| LOW | xhs_utils/xhs_util.py | 4 | CODE | |
| LOW | xhs_utils/xhs_pc/auth.py | 4 | CODE | |
| LOW | xhs_utils/xhs_pc/dsl.py | 43 | CODE | |
| LOW | xhs_utils/xhs_pc/__init__.py | 13 | CODE | |
| LOW | xhs_utils/xhs_pc/__init__.py | 13 | CODE | |
| LOW | xhs_utils/xhs_pc/__init__.py | 13 | CODE | |
| LOW | xhs_utils/xhs_pc/__init__.py | 14 | CODE | |
| LOW | xhs_utils/xhs_pc/__init__.py | 15 | CODE | |
| LOW | xhs_utils/xhs_pc/__init__.py | 15 | CODE | |
| LOW | xhs_utils/xhs_pc/runtime.py | 10 | CODE | |
| LOW | xhs_utils/xhs_pc/http.py | 3 | CODE | |
| LOW | xhs_utils/xhs_pc/state.py | 8 | CODE | |
| LOW | xhs_utils/xhs_creator/auth.py | 3 | CODE | |
| LOW | xhs_utils/xhs_creator/params.py | 3 | CODE | |
| LOW | xhs_utils/xhs_creator/params.py | 18 | CODE | |
| LOW | xhs_utils/xhs_creator/params.py | 19 | CODE | |
| LOW | xhs_utils/xhs_creator/__init__.py | 10 | CODE | |
| LOW | xhs_utils/xhs_creator/__init__.py | 10 | CODE | |
| LOW | xhs_utils/xhs_creator/__init__.py | 11 | CODE | |
| LOW | xhs_utils/xhs_creator/__init__.py | 12 | CODE | |
| LOW | xhs_utils/xhs_creator/__init__.py | 13 | CODE | |
| LOW | xhs_utils/xhs_creator/__init__.py | 13 | CODE | |
| LOW | xhs_utils/xhs_creator/runtime.py | 7 | CODE | |
| LOW | xhs_utils/xhs_creator/runtime.py | 16 | CODE | |
| LOW | xhs_utils/xhs_creator/http.py | 3 | CODE | |
| LOW | xhs_utils/xhs_creator/state.py | 8 | CODE | |
| LOW | xhs_utils/xhs_core/cookies.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/auth.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/params.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/dsl.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/__init__.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/__init__.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/__init__.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/__init__.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/__init__.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/__init__.py | 10 | CODE | |
| LOW | xhs_utils/xhs_core/runtime.py | 3 | CODE | |
| LOW | xhs_utils/xhs_core/http.py | 8 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | xhs_utils/xhs_pc/dsl.py | 109 | except Exception as e: | CODE |
| LOW | xhs_utils/xhs_core/dsl.py | 71 | except Exception as exc: | CODE |
| LOW | apis/xhs_creator_login_apis.py | 260 | except Exception: | CODE |
| LOW | apis/xhs_creator_login_apis.py | 579 | except Exception as error: | CODE |
| LOW | apis/xhs_creator_login_apis.py | 1021 | except Exception as error: | CODE |
| LOW | apis/xhs_pc_login_apis.py | 476 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_login_apis.py | 778 | except Exception as exc: | CODE |
| LOW | apis/xhs_pc_login_apis.py | 803 | except Exception as exc: | CODE |
| LOW | apis/xhs_pc_login_apis.py | 820 | except Exception as exc: | CODE |
| LOW | apis/xhs_pc_login_apis.py | 850 | except Exception as exc: | CODE |
| LOW | apis/xhs_creator_apis.py | 219 | except Exception as error: | CODE |
| LOW | apis/xhs_creator_apis.py | 253 | except Exception as error: | CODE |
| LOW | apis/xhs_creator_apis.py | 278 | except Exception as error: | CODE |
| LOW | apis/xhs_creator_apis.py | 310 | except Exception as error: | CODE |
| LOW | apis/xhs_creator_apis.py | 378 | except Exception as error: | CODE |
| LOW | apis/xhs_creator_apis.py | 414 | except Exception as error: | CODE |
| LOW | apis/xhs_creator_apis.py | 445 | except Exception as error: | CODE |
| LOW | apis/xhs_creator_apis.py | 788 | except Exception as error: | CODE |
| MEDIUM | apis/xhs_creator_apis.py | 223 | def get_topic(self, keyword, proxies=None): | CODE |
| MEDIUM | apis/xhs_creator_apis.py | 258 | def get_location_info(self, keyword, proxies=None): | CODE |
| MEDIUM | apis/xhs_creator_apis.py | 284 | def get_fileIds(self, media_type, proxies=None): | CODE |
| LOW | apis/xhs_pc_apis.py | 166 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 217 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 245 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 269 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 287 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 315 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 347 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 375 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 406 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 434 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 465 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 500 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 521 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 594 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 628 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 659 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 685 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 714 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 740 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 769 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 798 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 822 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 839 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 862 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 887 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 910 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 935 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 958 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 983 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 1008 | except Exception as e: | CODE |
| LOW | apis/xhs_pc_apis.py | 1041 | except Exception as e: | CODE |
| LOW | spider/spider.py | 22 | except Exception as e: | CODE |
| LOW | spider/spider.py | 67 | except Exception as e: | CODE |
| LOW | spider/spider.py | 99 | except Exception as e: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | xhs_utils/xhs_pc/dsl.py | 19 | glb['_BHjFmfUMEtxhI'](__$c, [,,undefined,Uint8Array,getdss]) | STRING |
| HIGH | xhs_utils/xhs_creator/auth.py | 232 | Creator ``mns0101`` calls ``_dsf(null, 24-byte input)`` from the DS | STRING |
| HIGH | apis/xhs_creator_login_apis.py | 376 | dsl_pair_value='null;undefined', | CODE |
| HIGH | apis/xhs_creator_login_apis.py | 453 | dsl_pair_value='null;undefined', | CODE |
| HIGH | apis/xhs_creator_login_apis.py | 477 | dsl_pair_value='null;undefined', | CODE |
| HIGH | apis/xhs_creator_login_apis.py | 697 | dsl_pair_value='null;undefined', | CODE |
| HIGH | apis/xhs_creator_login_apis.py | 755 | dsl_pair_value='null;undefined', | CODE |
| HIGH | apis/xhs_pc_login_apis.py | 190 | dsl_pair = f'null;{self.dsl}' | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | xhs_utils/xhs_auth.py | 23 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_pc/auth.py | 311 | def update_cookies(self, cookies: Any, *, source_url: str = '') -> None: | CODE |
| LOW | xhs_utils/xhs_pc/auth.py | 514 | def _set_dsl(self, value: str) -> None: | CODE |
| LOW | xhs_utils/xhs_pc/auth.py | 522 | __all__ = ['PC_PARAMETER_SOURCES', 'XHSAuth', 'XHSPcAuth'] | CODE |
| LOW | xhs_utils/xhs_pc/params.py | 478 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_pc/__init__.py | 17 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_pc/runtime.py | 272 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_pc/http.py | 32 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_pc/state.py | 325 | def set_rwp_login_token(self, token: Mapping[str, Any]) -> None: | CODE |
| LOW | xhs_utils/xhs_pc/state.py | 461 | def update_cookies(self, cookies: Any) -> None: | CODE |
| LOW | xhs_utils/xhs_pc/state.py | 663 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_creator/auth.py | 262 | def update_cookies(self, cookies: Any, *, source_url: str = '') -> None: | CODE |
| LOW | xhs_utils/xhs_creator/auth.py | 411 | def _set_dsl(self, value: str) -> None: | CODE |
| LOW | xhs_utils/xhs_creator/auth.py | 423 | __all__ = ['CREATOR_PARAMETER_SOURCES', 'XHSCreatorAuth'] | CODE |
| LOW | xhs_utils/xhs_creator/params.py | 339 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_creator/dsl.py | 37 | __all__ = ['get_dsl', 'get_ds_bundle', 'DSN_READY', 'DSN_BOOTSTRAP'] | CODE |
| LOW | xhs_utils/xhs_creator/__init__.py | 15 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_creator/runtime.py | 178 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_creator/http.py | 32 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_creator/state.py | 396 | def update_cookies(self, cookies: Any) -> None: | CODE |
| LOW | xhs_utils/xhs_creator/state.py | 583 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_core/cookies.py | 174 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_core/auth.py | 124 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_core/params.py | 34 | __all__ = ['generate_x_b3_traceid', 'generate_xray_traceid', 'splice_str'] | CODE |
| LOW | xhs_utils/xhs_core/dsl.py | 123 | __all__ = ['DsFetcher'] | CODE |
| LOW | xhs_utils/xhs_core/__init__.py | 12 | __all__ = [ | CODE |
| LOW | xhs_utils/xhs_core/runtime.py | 87 | __all__ = ['run_node_json', 'generate_websectiga'] | CODE |
| LOW | xhs_utils/xhs_core/http.py | 185 | __all__ = [ | CODE |
| LOW | apis/xhs_creator_login_apis.py | 1173 | __all__ = ['XHSCreatorLoginApi'] | CODE |
| LOW | apis/xhs_creator_apis.py | 834 | __all__ = ['XHS_Creator_Apis', 'XHSCreatorApis'] | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | main.py | 49 | def _fetch_and_print_creator_notes( | CODE |
| LOW | xhs_utils/xhs_qianfan_util.py | 4 | def get_qianfan_headers_template(): | CODE |
| LOW | xhs_utils/xhs_pugongying_util.py | 7 | def get_pugongying_headers_template(): | CODE |
| LOW | xhs_utils/xhs_pugongying_util.py | 30 | def generate_pugongying_headers(cookies, api, data='', profile=None): | CODE |
| LOW | xhs_utils/xhs_pugongying_util.py | 49 | def get_pugongying_bozhu_data(page, brandUserId, contentTag=None): | CODE |
| LOW | xhs_utils/xhs_creator_util.py | 48 | def load_creator_rap_fingerprint_hex() -> str: | CODE |
| LOW | xhs_utils/xhs_pc/params.py | 118 | def generate_search_request_id(): | CODE |
| LOW | xhs_utils/xhs_pc/params.py | 124 | def generate_search_session_id(): | CODE |
| LOW | xhs_utils/xhs_pc/params.py | 325 | def get_request_headers_template( | CODE |
| LOW | xhs_utils/xhs_pc/params.py | 364 | def build_pc_navigation_headers(headers, cookies=None): | CODE |
| LOW | xhs_utils/xhs_pc/params.py | 393 | def build_pc_business_headers(headers, cookies, *, api, method='POST'): | CODE |
| LOW | xhs_utils/xhs_creator/params.py | 92 | def build_creator_navigation_headers(headers, cookies=None): | CODE |
| LOW | xhs_utils/xhs_creator/params.py | 101 | def build_creator_login_headers(headers, cookies=None, *, kind='security'): | CODE |
| LOW | xhs_utils/xhs_creator/params.py | 123 | def build_creator_business_headers(headers, cookies=None, *, method='GET'): | CODE |
| LOW | xhs_utils/xhs_creator/params.py | 150 | def get_request_headers_template( | CODE |
| LOW | xhs_utils/xhs_creator/params.py | 257 | def generate_profile_request_params( | CODE |
| LOW | apis/xhs_creator_login_apis.py | 62 | def _order_creator_login_cookies(cookies: dict) -> dict: | CODE |
| LOW | apis/xhs_creator_login_apis.py | 228 | def _add_service_ratelimit_header(self, headers): | CODE |
| LOW | apis/xhs_creator_login_apis.py | 437 | def _finish_security_bootstrap(self) -> None: | CODE |
| LOW | apis/xhs_creator_login_apis.py | 517 | def _require_security_cookies(self, names=None) -> None: | CODE |
| LOW | apis/xhs_creator_apis.py | 96 | def _creator_note_manager_headers(headers, cookies, *, user_info=False): | CODE |
| LOW | apis/xhs_creator_apis.py | 634 | def extract_video_cover_and_metadata(self, video): | CODE |
| LOW | apis/xhs_creator_apis.py | 723 | # def get_all_publish_note_info(self, proxies=None): | COMMENT |
| LOW | apis/xhs_creator_apis.py | 826 | def get_all_publish_note_info(self, proxies=None): | CODE |
| LOW | apis/xhs_pc_apis.py | 222 | def get_homefeed_recommend_by_num(self, category, require_num, proxies: dict = None): | CODE |
| LOW | apis/xhs_pc_apis.py | 380 | def get_user_all_like_note_info(self, user_url: str, proxies: dict = None): | CODE |
| LOW | apis/xhs_pc_apis.py | 411 | def get_user_collect_note_info(self, user_id: str, cursor: str, xsec_token='', xsec_source='', proxies: dict = None) | CODE |
| LOW | apis/xhs_pc_apis.py | 439 | def get_user_all_collect_note_info(self, user_url: str, proxies: dict = None): | CODE |
| LOW | apis/xhs_pc_apis.py | 774 | def get_note_all_inner_comment(self, comment: dict, xsec_token: str, proxies: dict = None): | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | xhs_utils/xhs_pc/auth.py | 323 | CODE | |
| LOW | xhs_utils/xhs_pc/params.py | 411 | CODE | |
| LOW | xhs_utils/xhs_pc/params.py | 444 | CODE | |
| LOW | xhs_utils/xhs_pc/runtime.py | 201 | CODE | |
| LOW | xhs_utils/xhs_creator/params.py | 150 | CODE | |
| LOW | xhs_utils/xhs_creator/params.py | 203 | CODE | |
| LOW | xhs_utils/xhs_creator/params.py | 257 | CODE | |
| LOW | apis/xhs_creator_login_apis.py | 184 | CODE | |
| LOW | apis/xhs_pc_login_apis.py | 44 | CODE | |
| LOW | apis/xhs_creator_apis.py | 147 | CODE | |
| LOW | apis/xhs_pc_apis.py | 526 | CODE | |
| LOW | spider/spider.py | 73 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | xhs_utils/data_util.py | 210 | CODE | |
| LOW | xhs_utils/xhs_qianfan_util.py | 42 | CODE | |
| LOW | xhs_utils/xhs_pugongying_util.py | 84 | CODE | |
| LOW | xhs_utils/xhs_pc/params.py | 373 | CODE | |
| LOW | xhs_utils/xhs_pc/params.py | 393 | CODE | |
| LOW | xhs_utils/xhs_creator/params.py | 101 | CODE | |
| LOW | apis/xhs_pc_apis.py | 526 | CODE | |
| LOW | apis/xhs_pc_apis.py | 1015 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | apis/xhs_creator_login_apis.py | 41 | ) | COMMENT |
| LOW | apis/xhs_creator_apis.py | 681 | return encoded.tobytes(), metadata | COMMENT |
| LOW | apis/xhs_creator_apis.py | 701 | # } | COMMENT |
| LOW | apis/xhs_creator_apis.py | 721 | # | COMMENT |