What is a Headless Data Architecture?

What is a Headless Data Architecture?

Jun 18, 2024

The headless data architecture. Is it a fad? Some marketecture? Or something real? In this video, Adam Bellemare takes you through the basics of the headless data architecture and why it’s beginning to emerge as its own respective pattern.

Driven by the decoupling of data computation from storage, the headless data architecture provides the basis for a modular data ecosystem. Stream your data for near real-time low latency use cases, or convert it to an Iceberg table for analytical use cases.

The headless data architecture lets you plug your choice of processor into the stream/table data layer, using whichever format that works best for you. Compose your applications, services, data warehouses/lakes using the modular data layer—no more copying data, building pipelines, or dealing with chronic break-fix work.

RELATED RESOURCES
► Apache Iceberg - https://iceberg.apache.org/
► Tableflow - https://cnfl.io/3VKq7hr
► Data quality restrictions and checks for enforcing data contracts - https://cnfl.io/3xnXk9i
► Connecting data into your headless data architecture with Kafka Connect - https://cnfl.io/4cqPvOK

CHAPTERS

00:00 - Intro

00:42 - Kafka for Streams

01:13 - Iceberg for Tables

03:26 - Plugging in Heads

04:55 - Benefits of HDA

06:45 - Difference between HDA and Data Lake

08:34 - Tableflow for Streams-to-Tables

09:52 - Summary

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#streamprocessing #apachekafka #kafka #confluent