PallasDB

2026 – Present

A self-hosted, distributed key-value database in Go with an LSM storage engine and Raft-backed replication

PallasDB

Overview

PallasDB is an operator-owned, self-hosted key-value data plane for platform teams. It keeps service metadata and runtime configuration revisioned, observable, and strongly consistent across a cluster.

The database is built from first principles in Go: raw byte encoding, crash-safe persistence, sorted storage, a SQL layer, gRPC transport, and Raft-backed server mode.

Storage Engine

Every committed write is persisted through a write-ahead log with fsync and CRC32 checksums before it is acknowledged. A sorted in-memory memtable flushes to durable SSTables, while multi-level merge iterators and compaction maintain an ordered view for range scans.

The embedded engine also provides snapshot transactions with conflict detection, plus a recursive-descent SQL parser and expression evaluator for table operations.

Distributed Operation

The gRPC API exposes Get, Put, Delete, and server-streaming Range operations over Protocol Buffers. In cluster mode, mutating requests are encoded as Raft commands and applied by the leader to the storage engine.

HashiCorp Raft provides strongly consistent replicated writes, while Serf gossip discovers cluster members. Nodes can serve reads from local FSM state, and snapshots restore state by atomically swapping the storage directory.