Systems | Development | Analytics | API | Testing

Data is the oil that fuels the growth of modern enterprises. But unless you have the tools to unlock the potential of data, you might be left stuck on the tracks as your competitors speed ahead. With the rise of Big Data, the nature of the data that we work with has changed drastically. Data scientists like to refer to the ‘3 Vs’ of Big Data: The 3 Vs of Big Data reshaped the data landscape as we knew it.

Five leading experts share their insights on what’s ahead for the data industry.

Why you should use Fivetran history mode for historical analysis over alternative solutions.

In the previous post, we talked about Kerberos authentication and explained how to configure a Kafka client to authenticate using Kerberos credentials. In this post we will look into how to configure a Kafka client to authenticate using LDAP, instead of Kerberos. We will not cover the server-side configuration in this article but will add some references to it when required to make the examples clearer.

Have you been burned by the unexpected costs of a cloud data warehouse? If so, you know about the failed economics of some cloud-native solutions on the market today. If not, before adopting a cloud data warehouse, consider the true costs of a cloud-native data warehouse. Data warehouses have been broadly adopted to provide timely reports and valuable insights. However, traditional deployments are notoriously cumbersome and cost-prohibitive at large scales.

Data engineers love to use SQL to solve all kinds of data problems. For this and more, Snowflake is a perfect partner. Snowflake’s support for standard SQL and several SQL variations, combined with JavaScript stored procedures, has helped me solve complex data challenges. But sometimes you might have the need for custom code.

Learn how Databox helped Virta with centralizing their data and ensuring their efforts and budget are creating the returns needed.

There are a few standard structured data formats and discussions galore on which of them is more advantageous. Within Xplenty, users are able to process JSON and XML data formats with ease, and this article shares an example showing the functions that facilitate processing XML on Xplenty.

It's important to understand the uses and abuses of streaming infrastructure. Apache Kafka is a message broker that has rapidly grown in popularity in the last few years. Message brokers have been around for a long time; they're a type of datastore specialized for "buffering" messages between producer and consumer systems. Kafka has become popular because it's open-source and capable of scaling to very large numbers of messages.