# Binary BPE Tokenizer for Executable Analysis > Binary BPE Tokenizer for Executable Analysis studies byte-pair encoding of ELF, PE, Mach-O and APK files for transformer-based binary analysis. The repository provides paper sources, 4K to 64K tokenizer vocabularies, Python evaluation scripts and a sample archive. The author reports 2.89 bytes per token for the 64K vocabulary. - Type: Research - Targets: App · Binary - Category: Native analysis tools - Relationship: Learning resource - Sources reviewed: 2026-11-06 - Added to the catalog: 2026-11-06 - Original resource: - Primary source: - Catalog page: - Record JSON: - Chinese version: [简体中文](https://awesomerea.org/zh/resources/binary-bpe-tokenizer-research/index.md) ## Requirements & limits - **Prerequisites:** Python 3.10+ with uv; TeX Live 2023+ is required to compile the paper. - **Prerequisites:** Rust 1.70+ is optional for retraining the tokenizer from scratch. - **License:** No licence file in the repository. ## Primary sources 1. ## More in References and learning - [Assassin's Creed III online service docs](https://awesomerea.org/resources/ac3-online-service-docs/index.md) · Documentation - [AC4 docs](https://awesomerea.org/resources/ac4-docs/index.md) · Documentation - [eRepublik API Documentation](https://awesomerea.org/resources/erepublik-api-documentation/index.md) · Documentation - [Garmin Strength Workout API](https://awesomerea.org/resources/garmin-strength-workout-api/index.md) · Documentation - [Substack API Reference (Unofficial)](https://awesomerea.org/resources/substack-api-reference/index.md) · Documentation - [hyperscan-homebrew](https://awesomerea.org/resources/hyperscan-homebrew/index.md) · Documentation ## About this entry The description was reviewed against primary sources. Original editorial content: MIT. Linked projects, papers and assets retain their own rights and licenses.