[2604.08720] Demystifying the Silence of Correctness Bugs in PyTorch Compiler

-->

Computer Science > Software Engineering

arXiv:2604.08720 (cs)

[Submitted on 9 Apr 2026]

Title:Demystifying the Silence of Correctness Bugs in PyTorch Compiler

Authors:Meiziniu Li, Dongze Li, Jianmeng Liu, Shing-Chi Cheung<br>View a PDF of the paper titled Demystifying the Silence of Correctness Bugs in PyTorch Compiler, by Meiziniu Li and 3 other authors

View PDF<br>HTML (experimental)

Abstract:Performance optimization of AI infrastructure is key to the fast adoption of large language models (LLMs). The PyTorch compiler (this http URL), a core optimization tool for deep learning (DL) models (including LLMs), has received due attention. However, this http URL is prone to correctness bugs, which cause incorrect outputs of compiled DL models without triggering exceptions, crashes, or warnings. These bugs pose a serious threat to the reliability of downstream LLM applications. Data from the PyTorch community shows that 19.2% of high-priority issues are incorrect outputs of compiled DL models induced by this http URL bugs, the second-most-common bug category (only behind program crashes at 19.57%). However, no systematic study has been conducted to specifically characterize and thereby detect these bugs. In this paper, we present the first empirical study of the correctness bugs in this http URL, examine their characteristics, and assess the effectiveness of existing fuzzers in detecting them. Based on our findings, we propose a proof-of-concept testing technique named AlignGuard, tailored specifically for detecting correctness bugs in this http URL. AlignGuard incorporates bug characteristics distilled from our empirical study, applying LLM-based test mutation to existing test cases for correctness bug detection. At the time of writing, AlignGuard has successfully detected 23 new correctness bugs in recent this http URL. All these bugs have been confirmed or fixed by the PyTorch development team, and over half (14/23) of them are even marked as high-priority bugs, underscoring the usefulness of our technique.

Subjects:

Software Engineering (cs.SE); Artificial Intelligence (cs.AI)

ACM classes:<br>D.2.5; I.2.5

Cite as:<br>arXiv:2604.08720 [cs.SE]

(or<br>arXiv:2604.08720v1 [cs.SE] for this version)

https://doi.org/10.48550/arXiv.2604.08720

Focus to learn more

arXiv-issued DOI via DataCite

Submission history<br>From: Meiziniu Li [view email]<br>[v1]<br>Thu, 9 Apr 2026 19:13:15 UTC (358 KB)

Full-text links:<br>Access Paper:

View a PDF of the paper titled Demystifying the Silence of Correctness Bugs in PyTorch Compiler, by Meiziniu Li and 3 other authors<br>View PDF<br>HTML (experimental)<br>TeX Source

view license

Current browse context:

cs.SE

next >

new<br>recent<br>| 2026-04

Change to browse by:

cs<br>cs.AI

References & Citations

NASA ADS<br>Google Scholar

Semantic Scholar

export BibTeX citation<br>Loading...

BibTeX formatted citation

&times;

loading...

Data provided by:

Bookmark

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

Which authors of this paper are endorsers? |<br>Disable MathJax (What is MathJax?)