[2605.30507] A Virtual Processor brings back the Free Lunch

-->

Computer Science > Performance

arXiv:2605.30507 (cs)

[Submitted on 28 May 2026]

Title:A Virtual Processor brings back the Free Lunch

Authors:Haymo Kutschbach<br>View a PDF of the paper titled A Virtual Processor brings back the Free Lunch, by Haymo Kutschbach

View PDF

Abstract:This work introduces a self-optimizing virtual processor (VP) for numerical array programs that shifts parallelization from a manual developer task to a cooperative, agent-like runtime mechanism. Instead of relying on centralized task-graph scheduling, static compiler optimization, or explicitly annotated parallel constructs, the VP uses a decentralized network of cooperative execution segments, derived from the stream of numerical instructions and their data dependencies at runtime. Each segment makes only local decisions about when, where, and how to prepare and execute its computation, including task placement, kernel preparation, and data movement. No central scheduler or mapper instance determines the execution globally; instead, scheduling itself is parallelized and distributed over time - asynchronously and strictly dependency driven. The overall execution strategy emerges from concurrently executing local segments, continuously responding to data availability, cost estimates, system state, hardware capabilities, and problem size. While preserving the sequential semantics of the program our VP automatically exploits parallelism across large program regions rather than being limited to individual loop bodies, modules, or explicitly marked parallel sections; developers are not required to design or encode a parallelization strategy. The current VP primarily targets low-latency strong scaling on local heterogeneous hardware, covering workloads from small, latency-sensitive array operations to large data-parallel computations. The current implementation targets the predefined array instruction set of the this http URL domain-specific language, while the underlying concept is applicable to general array-based numerical programming models such as MATLAB and NumPy.

Comments:<br>10 pages + appendix (3 pages), 7 figures, 4 benchmarks at this https URL (GitHub) or this https URL (DOI Zenodo)

Subjects:

Performance (cs.PF); Distributed, Parallel, and Cluster Computing (cs.DC); Programming Languages (cs.PL)

MSC classes:<br>68Q09 (Primary), 68M20, 65Y05, 65Y15, 68M99, 68-04 (Secondary)

ACM classes:<br>D.3.4; D.1.3; C.1.4; C.4; G.4; D.4.1

Cite as:<br>arXiv:2605.30507 [cs.PF]

(or<br>arXiv:2605.30507v1 [cs.PF] for this version)

https://doi.org/10.48550/arXiv.2605.30507

Focus to learn more

arXiv-issued DOI via DataCite (pending registration)

Submission history<br>From: Haymo Kutschbach [view email]<br>[v1]<br>Thu, 28 May 2026 19:43:49 UTC (1,005 KB)

Full-text links:<br>Access Paper:

View a PDF of the paper titled A Virtual Processor brings back the Free Lunch, by Haymo Kutschbach<br>View PDF

view license

Current browse context:

cs.PF

next >

new<br>recent<br>| 2026-05

Change to browse by:

cs<br>cs.DC<br>cs.PL

References & Citations

NASA ADS<br>Google Scholar

Semantic Scholar

export BibTeX citation<br>Loading...

BibTeX formatted citation

&times;

loading...

Data provided by:

Bookmark

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

Which authors of this paper are endorsers? |<br>Disable MathJax (What is MathJax?)