OpenData – Open-Source and Object Store Native Databases

apurvamehta1 pts0 comments

OpenData — Open Source and Object Store Native Databases<br>NEW &middot; Introducing OpenData Log — object-store native event streaming &rarr;<br>Databases ▼ Vector Buffer Timeseries Log

Docs Blog 449 185

DATABASES<br>Vector Buffer Timeseries Log<br>Docs Blog<br>449 185

OpenData is a family of open-source, object-native databases that reduces costs, simplifies operations and scales with ease.

Explore the databases &darr; Read the docs

Databases made simple<br>All OpenData systems are built on the same foundation so once you know how to operate the first, you know how to operate the rest.

╔══════════════╗ ╔══════════════╗ ╔══════════════╗ ╔══════════════╗<br>║ ║▌ ║ ║▌ ║ ║▌ ║ ║▌<br>║ Vector ║▌ ║ Buffer ║▌ ║ Timeseries ║▌ ║ Log ║▌<br>║ ║▌ ║ ║▌ ║ ║▌ ║ ║▌<br>╚═══════┬══════╝▌ ╚═══════┬══════╝▌ ╚═══════┬══════╝▌ ╚═══════┬══════╝▌<br>▀▀▀▀▀▀▀│▀▀▀▀▀▀▀▘ ▀▀▀▀▀▀▀│▀▀▀▀▀▀▀▘ ▀▀▀▀▀▀▀│▀▀▀▀▀▀▀▘ ▀▀▀▀▀▀▀│▀▀▀▀▀▀▀▘<br>│ │ │ │<br>└─────────────────┴────────┬────────┴─────────────────┘<br>┏━━━━━━━━━━━━━━━━━━━━━━━━▼━━━━━━━━━━━━━━━━━━━━━━━┓<br>┃ ┃<br>┃ OpenData Storage Engine ┃<br>┃ ┃<br>┃ built on SlateDB ┃<br>┃ ┃<br>┗━━━━━━━━━━━━━━━━━━━━━━━━┬━━━━━━━━━━━━━━━━━━━━━━━┛<br>╔══════════════════════════▼═════════════════════════╗<br>║ ║<br>║ Object Storage · S3 · GCS · R2 ║<br>║ ║<br>╚════════════════════════════════════════════════════╝<br>╔══════════════╗ ╔══════════════╗ ╷ ┏━━━━━━━━━━━━━━━━━━━┓<br>║ ║ ║ ║ │ ┃ OpenData ┃<br>║ Vector ║ ║ Buffer ║ ├──►┃ Storage Engine ┃<br>║ ║ ║ ║ │ ┃ built on SlateDB ┃<br>╚══════════════╝ ╚══════════════╝ │ ┗━━━━━━━━━┬━━━━━━━━━┛<br>│ │<br>╔══════════════╗ ╔══════════════╗ │ ╔═════════▼═════════╗<br>║ ║ ║ ║ │ ║ Object Storage ║<br>║ Timeseries ║ ║ Log ║ │ ║ ║<br>║ ║ ║ ║ │ ║ S3 · GCS · R2 ║<br>╚══════════════╝ ╚══════════════╝ ╵ ╚═══════════════════╝

OpenData Storage Engine<br>The shared database core behind every OpenData system. Every database compiles down to ordered SlateDB records, so every product inherits the same operating model.<br>One storage engine for data, indexes, compaction, and checkpoints<br>Scale readers independently from writers<br>Learn one operational model

[ learn more → ]slatedb.io →

Object Storage<br>The durable foundation underneath every OpenData database. Your bucket becomes the source of truth, while compute stays simple, replaceable, and easy to scale.<br>Store durable state in your own bucket in S3, GCS, and others<br>Object Storage solves replication, durability, and storage availability<br>Elastically scale compute without moving data

[ learn more → ]

OpenData Vector<br>An open-source vector database for fast ANN and full-text search on object storage.<br>Serve vector search from stateless nodes<br>Get low-latency queries at 100M-vector scale<br>Run production search for hundreds, not thousands, per month

[ read about Vector → ]view docs →

OpenData Buffer<br>A durable ingestion buffer for high-throughput data pipelines. No Kafka required.<br>Build HA pipelines with stateless producers and consumers<br>Use object storage as the durable handoff between systems<br>Cut broker infrastructure from your ingestion path

[ read about Buffer → ]view docs →

OpenData Timeseries<br>A Prometheus-compatible metrics database that keeps the architecture simple, even at high cardinality.<br>Ingest metrics with one writer and stateless readers<br>Handle millions of active series without a distributed cluster<br>Query with PromQL, Grafana, Prometheus, and OpenTelemetry

[ read about Timeseries → ]view docs →

OpenData Log<br>A durable event streaming database for millions of ordered, keyed streams. Built directly on object storage.<br>Route events by key, not partitions<br>Serve millions of keys and tens of thousands of followers from one node<br>Give every key its own isolated and durable stream

[ read about Log → ]view docs →

Why OpenData<br>Running production databases requires specialized expertise, which is why databases are expensive.<br>Object storage promises to change that. It gives us durable, globally addressable storage that makes radically simpler database architectures possible. What's more, the engineering needed to use object storage optimally is substantially similar across databases. That's why every OpenData database shares:<br>01<br>Object native<br>Infinite storage with high durability and excellent unit economics.

02<br>Common tooling<br>One operational model to learn with a common configuration.

03<br>MIT licensed<br>Open formats and a permissive license prevent vendor lock-in.

Read the manifesto &rarr;

Get Started<br>log timeseries vector buffer

$ curl -fsSL https://www.opendata.dev/install.sh | sh -s -- log &rarr; installed opendata-log &rarr; read the log quickstart<br>$ curl -fsSL https://www.opendata.dev/install.sh | sh -s -- timeseries &rarr; installed opendata-timeseries &rarr; read the timeseries quickstart<br>$ curl -fsSL https://www.opendata.dev/install.sh | sh -s -- vector &rarr; installed opendata-vector &rarr; read the vector quickstart<br># Buffer is an embedded library — no install needed &rarr; read the buffer docs

powered by

opendata storage object vector databases buffer

Related Articles