Data Plane
The data plane is where indexes actually live and run: multitenant Kubernetes (EKS), document ingest, query serving, autoscaling, and reindexing. It carries the majority of Marqo's infrastructure and operations runbooks.
Repos
| Repo | What it is |
|---|---|
cloud_data_plane | Multitenant EKS, index workflows, autoscaling, Cloudflare ingest. Home of most infra/ops runbooks. |
reindexing-pipeline | Serverless pipeline (Lambdas + K8s job) that reindexes/replays documents into Vespa via the ecommerce API. |
What it handles
- Index lifecycle — create, scale, and tear down per-tenant indexes on EKS.
- Ingest & query — document ingest (incl. Cloudflare ingest paths) and query serving against Vespa.
- Reindexing — replaying/reindexing documents through the
reindexing-pipeline.
Go deeper
- 📖 Per-repo docs:
cloud_data_plane,reindexing-pipeline - 🔧 Runbooks (cross-repo) — the data plane owns most operational runbooks.
- 🏛️ Architecture & Design (cross-repo)