[2604.22847] Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubes

-->

Computer Science > Computer Vision and Pattern Recognition

arXiv:2604.22847 (cs)

[Submitted on 22 Apr 2026]

Title:Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubes

Authors:Tim Merino, Sam Earle, Ryunosuke Iwai, Julian Togelius, Edoardo Cetin<br>View a PDF of the paper titled Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubes, by Tim Merino and 4 other authors

View PDF<br>HTML (experimental)

Abstract:We introduce Dream-Cubed, a large-scale dataset of Minecraft worlds at voxel resolution, and a family of models using cubes as powerful compositional units for efficient generation of interactive 3D environments. Dream-Cubed comprises tens of billions of tokens from a carefully curated mixture of procedural biome terrain and high-quality human-authored maps. We use this dataset to conduct the first large-scale study of 3D diffusion models for voxel generation, analyzing discrete and continuous diffusion formulations, data compositions, and architectural design choices. Our models operate directly in the space of blocks, enabling efficient and semantically grounded generation while supporting interactive user workflows such as inpainting and outpainting from user-authored blocks. To quantitatively evaluate our models, we adapt the FID metric to assess semantic differences between real and generated world renderings, and validate generation quality through a human preference study. We release the full dataset, code, and all our pretrained models, which we hope will provide a foundation for future research in efficient generative modeling for structured, interactive 3D environments.

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:<br>arXiv:2604.22847 [cs.CV]

(or<br>arXiv:2604.22847v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2604.22847

Focus to learn more

arXiv-issued DOI via DataCite

Submission history<br>From: Timothy Merino [view email]<br>[v1]<br>Wed, 22 Apr 2026 00:46:12 UTC (41,330 KB)

Full-text links:<br>Access Paper:

View a PDF of the paper titled Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubes, by Tim Merino and 4 other authors<br>View PDF<br>HTML (experimental)<br>TeX Source

view license

Current browse context:

cs.CV

next >

new<br>recent<br>| 2026-04

Change to browse by:

cs

References & Citations

NASA ADS<br>Google Scholar

Semantic Scholar

export BibTeX citation<br>Loading...

BibTeX formatted citation

&times;

loading...

Data provided by:

Bookmark

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

Which authors of this paper are endorsers? |<br>Disable MathJax (What is MathJax?)