Systems | Development | Analytics | API | Testing

6 Database Schema Designs and How to Use Them

In this guide, we'll discuss what a database schema is, six database schema designs, and how and why they are used. We know a lot of thought goes into database construction. Before creating any database, developers plan what it should include and how the different aspects work together. This planning ensures a database has the necessary design for its intended use. Coders then use the schema to implement the database’s design.

5 Tips for Pushing Data from Your Warehouse to SAP

Reverse ETL flips the targets and destinations of the standard ETL (extract, transform, load) process. Instead of collecting your data within a centralized data warehouse, reverse ETL transfers information out of this warehouse and into third-party operational systems for ease of access and better analytics and reporting. That’s all very well and good — but what does reverse ETL look like in practice with systems and software such as SAP?

Automated Competition Scraping with Apify and Keboola

Whether you saw or missed our webinar, we thought it would be useful to provide a step-by-step guide on how to set up quick competition monitoring (or, any other web scraping and data processing automation) with Apify and Keboola. Thank you Apify and Revolt.bi for the collaboration! So what can you do with automated competition data processing? In this article, we’ll take an example of daily monitoring of the best-sellers list at Amazon.

Migrating Data Pipelines from Enterprise Schedulers to Airflow

At Airflow Summit 2021, Unravel’s co-founder and CTO, Shivnath Babu and Hari Nyer, Senior Software Engineer, delivered a talk titled Lessons Learned while Migrating Data Pipelines from Enterprise Schedulers to Airflow. This story, along with the slides and videos included in it, comes from the presentation.

Optimizing Cloudera Data Engineering Autoscaling Performance

The shift to cloud has been accelerating, and with it, a push to modernize data pipelines that fuel key applications. That is why cloud native solutions which take advantage of the capabilities such as disaggregated storage & compute, elasticity, and containerization are more paramount than ever. At Cloudera, we introduced Cloudera Data Engineering (CDE) as part of our Enterprise Data Cloud product — Cloudera Data Platform (CDP) — to meet these challenges.

Our reflections on the 2021 Gartner Magic Quadrant for Data Integration Tools

“The data integration tool market is seeing renewed momentum, driven by requirements for hybrid and multi-cloud data integration, augmented data management, and data fabric designs.” This is what Gartner assesses in its latest Magic Quadrant for Data Integration Tools* report. And that assessment makes perfect sense. Data is the lifeblood of an organization.

How to connect Mongo DB to Heroku Postgres

Every computer application must have a method of storing, managing and using data. This requires an application and at least one database that can communicate with each other. Managing this connection can be difficult, especially with multiple databases. Fortunately, there are platforms that can manage databases and connections applications more efficiently. Heroku offers a Postgres management system for creating, managing, and using databases.