Systems | Development | Analytics | API | Testing

Three dbt data modeling mistakes and how to fix them

When I first started my role as an analytics engineer, I was tasked with rewriting a bunch of data models that were written in the past by contractors. These models were taking over 24 hours to run and often failed to run at all. They were poorly thought out and contained a bunch of “quick fix” code rather than being designed with the entire flow of the model in mind.

Visual Regression Testing Basics

In a world where technological advances are made on a daily basis, software products are often affected by routine updates. While updating software is necessary for all businesses, it can introduce a slew of bugs into applications and websites. If these software bugs are not thoroughly tested, validated, and fixed, they could end up costing the company a lot of money in production. User interface (UI) and visual bugs in software products are often disregarded due to the focus on functional testing.

Why is Data Integration Important in a Data Management Process?

Our five key points: Your data management processes are only as effective as the quality of the data you collate. Gaining access to as much data as possible is vital if you want the business-critical insights that can set you apart from the crowd. For Ecommerce businesses, so many of the resources you use are online, such as cloud-based SaaS, ERPs, or CRMs. Integrate.io explains why data integration is such a big part of data management for Ecommerce and the benefits of an intuitive ETL and ELT tool.

Secret weapons for testing transformations

Have you developed a vision for modernizing your testing? Now it’s time to make that vision a reality. When you set out to transform your testing practice, don’t just aim to improve a few processes—instead, strive to make sweeping changes in the culture and activities of your testing organization. By definition, a transformation should entail major changes. It’s your chance to implement an entirely new vision for testing.

What is the Difference Between Data Compliance and Data Privacy?

When deploying any application that holds customer or user data, both data compliance and data privacy are important areas to consider. Yet these two areas of data management are sometimes misunderstood. This blog post will shed some light on the differences between data compliance and data privacy.

Sponsored Post

High Scale Postman Load Testing for Kubernetes

In this Postman load testing tutorial, you'll learn how to run a large scale load test in Kubernetes using your existing Postman collections. Because HTTP services don't have a graphical user interface, it's common to build collections of requests using Postman during the development process. These collections are useful for running quick functionality tests as you develop each endpoint. However, as the service grows you eventually need to test it in a more realistic way with larger volume. This is called a load or stress test. Speedscale is a Production Data Simulation Platform that includes this stress/load testing capability out of the box.

Flex your FitBit stats using OAuth 2 authentication and Talend

We’re back with another Job of the Week – but this time, we’re taking a step back to cover a concept we’ve skipped over in previous segments: OAuth2 authentication. Richard’s demonstrations often show simpler shortcuts to accessing data – but these shortcuts may not always be practical in real-world examples. Never fear! We’ll arm you with the know-how you need to make your data hacks just as impressive in real life.

The Modern Data Lakehouse: An Architectural Innovation

Imagine having self-service access to all business data, anywhere it may be, and being able to explore it all at once. Imagine quickly answering burning business questions nearly instantly, without waiting for data to be found, shared, and ingested. Imagine independently discovering rich new business insights from both structured and unstructured data working together, without having to beg for data sets to be made available.