Systems | Development | Analytics | API | Testing

Over the past few weeks, I’ve spoken with a number of leaders who are digesting Salesforce’s move to acquire Informatica and what it will mean for them. If you are doing the same, I get it. Informatica has been an established company but in recent years pushing customers to move to their cloud only platform, will this accelerate this in particular with their recent PowerCenter end-of-support news?

The digital landscape is changing. More and more, consumers are realising the importance of data privacy. This shift in mindset is something businesses must attune to if they hope to build strong relationships with their customers. The phasing out of third-party cookies by Google at the end of 2024 and global regulations like GDPR and CCPA tightening data collection mean companies that embed privacy as a core part of their operations have the most to gain.

Choosing one over the other can come down to a few key differences. Let’s take a look at both to help you make an informed decision.

Data completeness in ETL pipelines refers to whether all expected data has been successfully processed without missing values or records. The Data Completeness Index (DCI) is a metric that quantifies the percentage of complete data fields in your ETL processes, helping organizations identify gaps that could lead to faulty analytics or business decisions. When your data completeness testing in ETL processes reveals a high DCI score, it indicates reliable data that stakeholders can confidently use.

In data pipelines, timing is everything. When data doesn't arrive when expected, it can create ripples throughout your entire analytics ecosystem. Late-arriving data refers to information that reaches your data warehouse after the expected processing window has closed. The Late-Arrival Percentage for ETL pipelines measures the proportion of data that arrives behind schedule, directly impacting the reliability and usefulness of your business intelligence systems.

The evolution of artificial intelligence (AI) in the enterprise has reached an inflection point. While the early days of generative AI focused on chatbots responding to human prompts, today's enterprise AI agents are fundamentally different—they're event-driven, autonomous systems that continuously process streams of business data, make real-time decisions, and take actions at scale.

Large Language Models (LLMs) like GPT-4, Claude, and LLaMA have reshaped the way businesses think about intelligence, automation, and human-computer interaction. But the performance of an LLM hinges entirely on what powers it: data. And that data must be systematically collected, cleaned, enriched, and delivered—a task owned by the ETL (Extract, Transform, Load) pipeline.