Systems | Development | Analytics | API | Testing

How Real-Time Data Streaming with GenAI Accelerates Singapore's Smart Nation Vision

In today’s data-driven world, the ability to turn raw data into actionable insights is no longer a nice to have—it’s a necessity to power exemplary citizen service. Singapore’s Smart Nation initiative is built on the idea that data, when utilized effectively, can transform public services and improve lives.

Motivating Engineers to Solve Data Challenges with a Growth Mindset

With almost two years at Confluent under her belt, Suguna Ravanappa has taken impressive strides as a people manager. Her eight-person team of engineers in the Global Support organization helps customers tackle technical challenges in their data streaming environments. According to Suguna, leading this team and being part of Confluent’s unique company culture has helped her develop stronger skills as both a leader and a collaborator. Learn more about her experience.

Building High Throughput Apache Kafka Applications with Confluent and Provisioned Mode for AWS Lambda Event Source Mapping (ESM)

Confluent and AWS Lambda can be used to build scalable and real-time event-driven architectures (EDAs) that respond to specific business events. Confluent provides a streaming SaaS solution based on Apache Kafka and built on Kora: The Cloud-Native Engine for Apache Kafka, allowing you to focus on building event-driven applications without operating the underlying infrastructure.

Bridging the Data Divide: How Confluent and Databricks Are Unlocking Real-Time AI

We’re excited to announce an expanded partnership between Confluent and Databricks to dramatically simplify the integration between analytical and operational systems. This is particularly important as enterprises want to shorten the deployment time of AI and real-time data applications. This partnership enables those enterprises to spend less time fussing over siloed data and governance and more time creating value for their customers.

Automating Podcast Promotion with AI and Event-Driven Design

I host two podcasts, Software Engineering Daily and Software Huddle, and often appear as a guest on other shows. Promoting episodes—whether I’m hosting or featured—helps highlight the great conversations I have, but finding the time to craft a thoughtful LinkedIn post for each one is tough. Between hosting, work, and life, sitting down to craft a thoughtful LinkedIn post for every episode just doesn’t always happen.

Revolutionizing Failure Management in Apache Flink: Meet FLIP-304's Pluggable Failure Enrichers

FLIP-304 gives you the power to transform how failures are handled in Apache Flink. With custom failure enrichers, you can tag and classify errors, integrate enriched data with monitoring tools, and quickly identify root causes. Failures in distributed systems are inevitable, but managing them effectively makes all the difference. Enter FLIP-304: Pluggable Failure Enrichers, an upgrade that helps turn confusion into actionable insights.

Agentic AI: The Top 5 Challenges and How to Overcome Them

As generative AI continues its unprecedented surge in popularity, we are already seeing it evolve into the next generation of machine learning-driven technologies: agentic AI. With agentic AI, we are not just prompting models and receiving an answer in a simple one-step process. The AI is engaging in complex multi-step processes, often interacting with different systems to achieve a desired outcome.

Optimize SaaS Integration with Fully Managed HTTP Connectors V2 for Confluent Cloud

Integrations that fail to deliver consistent performance and suffer from long processing times inevitably fall short of the high standards set by today's dynamic business environment. Providing a seamless integration of Apache Kafka with various data sources and destinations is crucial in the fast-paced world of data streaming and real-time analytics.