What is a Data Streaming Platform?

What is a Data Streaming Platform?

Aug 15, 2024

A Data Streaming Platform (DSP) is composed of six major inter-related components, covered in detail in this video. Each component has evolved over time to servce specific needs in the data streaming platform, but together form a whole that is greater than its sum.

While you can build your own DSP by following the outline in this video, you can also get started immediately with Confluent’s DSP today: https://cnfl.io/4dI8qWa

A DSP provides a complete solution for unified end-to-end data streaming. It provides all the necessary capabilities to succeed in data streaming, incuding data connectivity, integration, discovery, security, and management. Ultimately, a DSP makes it easy for you to build, use, and share data all across your organization for any use case.

RELATED RESOURCES
► How to address bad data in your event streams - https://medium.com/confluent/preventing-and-fixing-bad-data-in-event-streams-part-1-27bf2a99b48e
► Data best practices and CDC - https://cnfl.io/3X4BLo6
► Kafka Connect 101 - https://cnfl.io/4fOdNFc
► What is a Headless Data Architecture? - https://youtu.be/dahs6jpCYQs
► How to Evolve your Schemas with Migration Rules - https://youtu.be/RQeo6Y_7Ahc
► How to Improve Data Quality with Domain Validation Rules - https://youtu.be/3BoljGZf5as
► Organize your data quickly and easily using Confluent Data Portal - https://youtu.be/Vg7k_3vlC3Q

CHAPTERS

00:00 - Introduction, a DSP’s Six Parts

00:26 - Pyramid Model of Data Streaming Evolution

00:46 - Apache Kafka (Part 1)

1:44 - Schema Registry (Part 2)

3:48 - Data Portal (Part 3)

5:21 - Connectors (Part 4)

7:16 - Stream Processor Flink (Part 5)

8:28 - Tableflow (Part 6)

10:24 - Conclusion

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#datastreaming #dsp #apachekafka #kafka #confluent