xhy/baidu-reporter
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3 Commits 1 Branch 6 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
xhy e2604067fe 证据采集器完成
2025-03-30 16:04:34 +08:00
.idea
init commit
2025-03-28 18:23:30 +08:00
app
证据采集器完成
2025-03-30 16:04:34 +08:00
tests
证据采集器完成
2025-03-30 16:04:34 +08:00
.gitignore
init commit
2025-03-28 18:23:30 +08:00
config.local.toml
init commit
2025-03-28 18:23:30 +08:00
config.prod.toml
init commit
2025-03-28 18:23:30 +08:00
main.py
证据采集器完成
2025-03-30 16:04:34 +08:00
README.md
采集器完成
2025-03-28 23:19:42 +08:00

README.md

baidu-reporter

  • crawl_engine:
    • 从任务队列中获取待爬取的 URL，打开百度搜索收集链接，结果存入 surl 表中
  • evidence_engine:
    • 轮询 surl 表，检查还没有收集证据的 surl，开始收集证据
  • reporter_engine:
    • 轮询 surl 表，找到没有被对应渠道举报过的 url，开始去举报
Description
No description provided
Readme 1.8 MiB
Languages
JavaScript 50.1%
Python 41.3%
Vue 7.8%
TypeScript 0.7%