When you’ve worked with data at scale, you come to appreciate the beauty and the complexity of systems like Kafka. With nearly 30 years of experience navigating the evolution of technology and data platforms, I’ve seen firsthand how Kafka has revolutionized real-time data processing - and where it can challenge even the best teams. The real question is: How do you move past those challenges to unleash everything Kafka has to offer?
We’re diving even deeper into the fundamentals of data streaming to explore stream processing—what it is, the best tools and frameworks, and its real-world applications. Our guests, Anna McDonald, Distinguished Technical Voice of the Customer at Confluent, and Abhishek Walia, Staff Customer Success Technical Architect at Confluent, break down what stream processing is, how it differs from batch processing, and why tools like Flink are game changers.
How do you build systems that keep up with a nonstop flood of data? Anna McDonald, Distinguished Technical Voice of the Customer at Confluent, explains how.
New York City, US - February 12, 2025 - Lenses.io, a data streaming innovation leader whose software helps developers power the world’s largest businesses, today announces the development of an enterprise grade and vendor-agnostic Kafka-to-Kafka replicator. It will enable organizations to share streaming data across different domains, in order to keep up with real-time data demands as AI adoption grows.
Confluent and AWS Lambda can be used to build scalable and real-time event-driven architectures (EDAs) that respond to specific business events. Confluent provides a streaming SaaS solution based on Apache Kafka and built on Kora: The Cloud-Native Engine for Apache Kafka, allowing you to focus on building event-driven applications without operating the underlying infrastructure.
Power AI-driven decision-making with Confluent’s Data Streaming Platform and Databricks’ Data Intelligence Platform. Watch this step-by-step demo to learn how to build a real-time social media AI chatbot that instantly engages with customer posts, like product reviews. New to Confluent? Experience unified Apache Kafka and Apache Flink with a free trial.
As organizations adopt specialized streaming technologies, real-time data is increasingly distributed across multiple domains, clouds, and locations. With the rapid evolution of streaming-dependent technologies, companies need the ability to pivot between providers almost instantly to spread risk and maintain performance (just look at the January DeepSeek-R1 LLM news).