2025 · Conference paper
DecompileBench: A Comprehensive Benchmark for Evaluating Decompilers in Real-World Scenarios
Evaluates traditional and LLM-based decompilers using functions from real programs, runtime behavioral checks, and an LLM-assisted assessment of analyst-facing code understandability.
Scope and limitations
The evaluated corpus has 23,400 functions from 130 programs. Fuzzing-based checks have finite coverage, and understandability scores depend partly on an LLM judge. The artifact warns that rebuilt OSS-Fuzz projects can differ from the paper's versions.
Why it fits this collection
Helps readers separate readable decompiler output from behaviorally faithful output when choosing or evaluating reverse-engineering tools.
Publication and review details
- Venue
- Findings of ACL 2025
- Status
- Conference paper
- Publication / posting date
- July 2025
- Date source
- ACL proceedings publication month
- First arXiv submission
- May 16, 2025
- arXiv
- 2505.11340
- Reviewed arXiv version
- v1
- DOI
- 10.18653/v1/2025.findings-acl.1194
The published ACL record and PDF use 'Zhang Bolun'; the arXiv record uses 'Bolun Zhang'. The paper's Jennieett/DecompileBench link now redirects to vul337/DecompileBench. This is distinct from Tan et al.'s Decompile-Bench (arXiv:2505.12668).
Sources reviewed
Source review only; experiments were not rerun for this collection. Cite the original authors using the linked paper or BibTeX.