Hello again. We strive to improve the productivity of developers building event-driven applications on the technology choices that best fit your organization. AWS continues to be a real powerhorse for our customers. Not just for running the workloads, but in supporting them with their native services: MSK Kafka, MSK Connect and now increasingly Glue Schema Registry. This is bringing a strong alternative to Confluent and their Kafka infrastructure offerings.

With version 5.1, Lenses is now offering enterprise support for our popular open-source Secret Provider to customers. In this blog, we’ll explain how secrets for Kafka Connect connectors can be safely protected using Secret Managers and walk you through configuring the Lenses S3 Sink Connector with the Lenses Secret Provider plugin and AWS Secret Manager.

Machine learning (ML) enables organizations to extract more value from their data than ever before. Companies who successfully deploy ML models into production are able to leverage that data value at a faster pace than ever before. But deploying ML models requires a number of key steps, each fraught with challenges.

Since we announced the general availability of Apache Iceberg in Cloudera Data Platform (CDP), we are excited to see customers testing their analytic workloads on Iceberg.

Data integration is the process of combining data from different sources and formats to create a unified and consistent view of the data. This involves merging data from multiple databases, applications, and other sources into a single repository, and transforming and formatting data so that it can be easily accessed and analyzed. Data assets need quality controls to ensure they are valid and reliable as many teams within an organization leverages the same data for different purposes.

Every organization contends with numerous moving parts that drive business forward. But they can be inefficient and convoluted – in fact, Forrester research shows that 71% of organizations use 10 or more applications for a single business process. To make matters worse, only 16% of companies have complete visibility over their own processes. This is where process mining can help. How can you gain more clarity so you can improve efficiency within your organization?

With increased applications developed by different engineering teams on Kafka comes increased need for data governance. JSON is often used when streaming projects bootstrap but this quickly becomes a problem as your applications iterate, changing the data structures with add new fields, removing old and even changing data formats. It makes your applications brittle, chaos ensues as downstream consumers fall over due to miss data and SREs curse you.