2026 · Preprint
Does It Render Everywhere? A Study of Cross-Environment Compatibility in MLLM-Generated Webpages
WebCompat evaluates screenshot-reconstructed webpages across browsers and devices. Its XCompat detector combines rendered DOM geometry, viewport metadata and screenshots to identify layout and element failures, independently of similarity to the original design.
Scope and limitations
Filtering retains 254 static pages from 480 generations, producing 2,032 comparison pairs. The held-out detector test uses 51 pages/408 pairs. Failed renders and interaction-dependent layouts are excluded; heuristic errors and subjective design intent limit generalization to dynamic sites or every environment.
Why it fits this collection
Adds cross-environment validation for reconstructed frontends beyond single-screenshot similarity.
Publication and review details
- Venue
- arXiv
- Status
- Preprint
- Publication / posting date
- August 12, 2026
- Date source
- arXiv v1 submission date; no separate proceedings or journal publication was verified.
- First arXiv submission
- August 12, 2026
- arXiv
- 2608.12518
- Reviewed arXiv version
- v1
- DOI
- 10.48550/arXiv.2608.12518
The pinned public snapshot contains 203 empirical pages; the paper’s 51-page test split was not found. README reports no license and incomplete collection/metric packaging. Its 56 passing tests are author-reported; no code, BrowserStack session or dataset asset was executed or downloaded for this review.
Sources reviewed
Source review only; experiments were not rerun for this collection. Cite the original authors using the linked paper or BibTeX.
Primary sources
- https://arxiv.org/abs/2608.12518v1
- https://arxiv.org/html/2608.12518v1
- README.md GitHub · ZiyunGuo/WebCompat · Revision 61d4ce2
- https://github.com/ZiyunGuo/WebCompat/tree/61d4ce2c345ff2d01ed5176bf5fd6c4c64b74a8b