Tool
web-crawler ReverseAgent
web-crawler includes ReverseAgent for investigating website JavaScript and request signing. It hooks fetch, XHR, cookies, crypto.subtle and webpack activity in a browser, captures traffic, separates webpack modules and uses an LLM to reimplement a discovered signature algorithm in Python.
- Targets
- Website
- Category
- Website analysis tools
- Relationship
- Foundation tool
- Sources reviewed
Requirements & limits
- Prerequisites: Python 3.10 or newer.
- Prerequisites: ReverseAgent uses CamoufoxFetcher and a compatible LLM service; optional browser dependencies are required for that path.
- License: MIT license.
About this entry
The description was reviewed against primary sources.
Primary sources
- README.md GitHub · xiaomaozjj666/web-crawler · Revision 36dca34
- docs/architecture.md GitHub · xiaomaozjj666/web-crawler · Revision 36dca34
More in Websites
- Mirrorframe · Tool
- Dinosaur runner: recovering one acceleration rule · Case study
- rauchg.com: rebuilding an RSC blog from captured Flight output · Case study
- BaoCut Slides: adapting an interactive web editor · Case study
- REA in Claude Code: an isolated static-analysis A/B trial · Case study
- Dinosaur runner: an REA-inspected speed rule rebuilt with Codex · Case study