2026 · Conference paper
SPRITE: From Static Mockups to Engine-Ready Game UI
Transforms game-interface screenshots into editable engine assets through hierarchical YAML, visual grounding, asset extraction, and Unity UXML/USS synthesis, with evaluation on a curated game-UI benchmark and review by three senior UI/UX designers.
Scope and limitations
The generated interactions cover basic hover, toggle, and click behavior. Complex temporal and drag-and-drop logic remain outside scope, and translucent overlap or ambiguous diegetic layouts can fail. This is game-UI prototyping, not complete gameplay reconstruction; the official page still labels code as coming soon.
Why it fits this collection
Adds game-specific screenshot-to-engine reconstruction while distinguishing visual and structural recovery from full game behavior.
Publication and review details
- Venue
- CHI EA 2026 (poster/extended abstract)
- Status
- Conference paper
- Publication / posting date
- April 13, 2026
- Date source
- Crossref publisher-deposited online publication date
- First arXiv submission
- March 18, 2026
- arXiv
- 2604.18591
- Reviewed arXiv version
- v1
- DOI
- 10.1145/3772363.3798742
Published as a CHI 2026 poster/extended abstract. The publisher title has “SPRITE:From” and “GameUI”; arXiv and the project page normalize these spaces. arXiv/Hugging Face report a March 18 first submission despite the 2604 identifier; the April 13 publication date is independently verified in Crossref. No implementation link is verified.
Sources reviewed
Source review only; experiments were not rerun for this collection. Cite the original authors using the linked paper or BibTeX.