Systems | Development | Analytics | API | Testing

Transferring files securely between machines is a fundamental part of the ETL (Extract, Transform, Load) process, which involves extracting data from one source, transforming it for analysis, and loading it into a data warehouse. The challenge? Ensuring these files are both sent and received without interception by malicious entities. For years, FTP (File Transfer Protocol) served as the go-to method to transfer files between a client and server on a network.

DevOps has helped bring software development and IT from the more rigid Waterfall methodology to a more flexible Agile approach, enabling development teams to resolve issues faster, reduce code complexity, and accelerate product delivery. With so many benefits to DevOps, it's natural that a focus on security, using a similar approach, would be the next step for development teams wanting to secure the software development process.

Navigating the intricacies of Apache Kafka just got a lot more intuitive. With Lenses 5.3 we bring you peace of mind, regardless of where you are in your Kafka journey. Our newest release is all about smoothing out the bumps, and making sure you're equipped to handle Kafka's challenges with confidence. Here's a sprinkle of what's in store, ahead of our big 6.0 release later this year.

We like to reduce the most mundane, complex and time-consuming work associated with managing a Kafka platform. One such task is backing up topic data. With a growing reliance on Kafka for various workloads, having a solid backup strategy is not just a nice-to-have, but a necessity. If you haven’t backed up your Kafka and you live in fear of disaster striking, worry no more.

An effective data platform thrives on solid data integration, and for Kafka, S3 data flows are paramount. Data engineers often grapple with diverse data requests related to S3. Enter Lenses. By partnering with major enterprises, we've levelled up our S3 connector, making it the market's leading choice. We've also incorporated it into our Lenses 5.3 release, boosting Kafka topic backup/restore.

With Choreo as your internal developer platform, taking your code to production has never been easier without worrying about the complexities needed to run a production-ready system.

The rapid growth of cloud native applications that are smaller, more distributed, and designed for highly dynamic environments has turned API gateways into indispensable intermediaries for driving digital initiatives. At the same time, the emergence of the Kubernetes Gateway API, with support from the Envoy Gateway project, is driving a shift towards standardization and interoperability.