Data, data, data. It does seem we are not only surrounded by talk about data, but by the actual data itself. We are collecting data from every nook and cranny of the universe (literally!). IoT devices in every industry; geolocation information on our phones, watches, cars, and every other mobile device; every website or app we access—all are collecting data. In order to derive value from this avalanche of data, we have to get more agile when it comes to preparing the data for consumption.
Scania is at the forefront of a more autonomous, connected, electric future for the transportation industry. Find out why its Head of Data and Information Management uses data mesh—and Snowflake—to make it a reality. Scania is a global truck, bus, and industrial engine manufacturer and offers an extensive range of related services so its customers can focus on their core business.
Instrumentation is an essential part of monitoring and operating an application, especially for apps heavily used in production. Even in today's everchanging technology landscape, visibility and observability still challenge developers and system administrators. Metrics and logging are essential for monitoring and operating an application. Metrics measure an application's performance and system health, while logging records system health and application state.
Analytics engineer is the latest role that combines the technical skills of a data engineer with the business knowledge of a data analyst. They are typically coding in SQL, building dbt data models, and automating data pipelines. You could say they own the steps between data ingestion and orchestration. Whether you are a seasoned analytics engineer or new to the field, it’s important to continually learn new things and improve the work you’ve already done.
If you’ve got an agile team interested in shipping fast without breaking things, this post is for you. In this piece, I’m going to explain how we at Rainforest QA approach automated testing in a continuous integration / continuous delivery (CI/CD) pipeline, with a focus on end-to-end (e2e) functional testing. The aim of our testing and other DevOps methodologies is to maintain a healthy balance between speed and product quality.