Systems | Development | Analytics | API | Testing

Kafka ETL for Real-Time Data Pipelines

In the era of real-time analytics, traditional batch ETL processes often fall short of delivering timely insights. Apache Kafka has emerged as a game-changer, enabling organizations to build robust, scalable, and real-time ETL pipelines. This article delves into how Kafka for ETL facilitates modern integration processes, its core components, best practices, and real-world applications.

Instant API updates with Kong Insomnia | Platform engineering demo

Tired of slow, manual config changes in your internal platform? In this quick demo, we show how to instantly deploy and update your API configurations using Kong Gateway, Kong Konnect, and Insomnia. It’s declarative, Git-based, and built for platform engineers who want governance without the bottlenecks. What you'll see:How to manage APIs with declarative config Using Git workflows to push updates to the cloud Real-time deployment via Kong and Insomnia A clean, self-service experience for platform teams.

Secure your MCP servers with Kong AI Gateway

Managing AI infrastructure isn’t enough—you need to protect it. In this demo, learn how to secure, observe, and govern your MCP servers using Kong AI Gateway. If you’re integrating MCP into your stack, Kong’s AI Gateway acts as the trust layer—keeping your costs down, your innovation moving, and your risks in check. Subscribe for more demos on AI infrastructure, API management, and platform engineering.

Building Streaming Data Pipelines, Part 1: Data Exploration With Tableflow

Whether we like it or not, when it comes to building data pipelines, the ETL (or ELT; choose your poison) process is never as simple as we hoped. Unlike the beautifully simple worlds of AdventureWorks, Pagila, Sakila, and others, real-world data is never quite what it claims to be. In the best-case scenario, we end up with the odd NULL where it shouldn’t be or a dodgy reading from a sensor that screws up the axes on a chart.

A Guide to Agentic RAG: What Makes RAG truly Agentic?

Before we delve into agentic RAG and AI agents, let’s take a moment to acknowledge that the world of artificial intelligence is evolving at a tremendous pace. From the initial excitement surrounding large language models (LLMs) to the practical application of generative AI (Gen AI), businesses are constantly finding new ways to automate tasks and innovate faster.

Untangling fan engagement: Carlo De Marchis (A Guy with a Scarf) on going beyond the raw metrics

Fan engagement strategies are evolving rapidly. But how do organizations ensure they are delivering realtime data with real meaning to their customers? As a veteran of the sports media industry with 35 years of experience at Deltatre, Carlo De Marchis (A Guy With a Scarf) recently gave a keynote at Ably’s fan engagement summit in February, and explored exactly this question - what should companies actually be trying to achieve when building a fan engagement strategy? His answer was concise.

Executing Ebpf In Github Actions

At Keploy, we wanted our tool to be part of the Github pipeline so that developers could be guaranteed that modifications made in pull requests could be safely merged and deployed. The only problem we had was ~ is it possible. The reason for this question is because Keploy uses eBPF to track network calls, which requires sudo capabilities. So the question becomes, will GitHub grant users sudo rights for a program they construct and execute on their systems?

Achieving Interoperability with WSO2: Payer Data Exchange and CMS Compliance

In today's evolving healthcare landscape, seamless data exchange between stakeholders is critical for improving patient care, reducing administrative burdens, and ensuring compliance with regulatory mandates. The payer organization plays a pivotal role in facilitating this exchange between members, payers, and providers. This blog explores a structured approach to payer data exchange and explores the key components enabling interoperability.