Systems | Development | Analytics | API | Testing

May 2021

Product announcement: Say hello to the new and improved Storage UI

Keboola’s Storage UI now comes with a new - slicker - look which will improve the user experience for all Keboola veterans. (New to Keboola? Do not fear. Simply follow along with the guided tour when you sign up for free, and you can unlock all the new features after June 2nd).

How to get started with data lineage

Modern enterprises leverage over 400 data sources to stay ahead of the competition. The sheer volume and complexity of data operations raise several challenges for intrepid organizations: How to cut the complexity of data operations? Enterprises turn to data lineage for the answer. Data lineage is the process of recording and visualizing data assets as they flow along your system.

How to use CDC for database replication

In the age when data is the new oil, more than 80% of IT decision-makers delay their business decisions due to slow data processing. Architecting your ETL pipeline with database replication can speed up your data processes. Database replication creates an analytic database as a separate copy of your production database. This unburdens the transactional database from analytical queries while securing fresh data in the analytical database for faster time-to-insights.

"Reverse ETL" with Keboola

TL;DR: Yes, you can do it. And no, you don’t need a separate tool for it. “Reverse ETL” is a fairly recent addition to the data engineer’s dictionary. While you can read articles upon articles about it (there’s a pretty good ‘primer’ in the Memory Leak blog), it can be summarized as being the art and science of taking data from your data warehouse and sending it somewhere other than BI - generally into other tools and systems where it becomes operational.

New: Data scientists, run transformations and model data in R!

We’re happy to announce that we added R to our selection of transformation and workspace backends in our freemium accounts. Access a wide variety of statistical methods offered by R and model data straight from Keboola. No more context switching and working in a few different tools. Start modeling data and running transformations in R. Create a free account and take Keboola for a spin. R transformations complement Python and SQL where computations or other operations are too difficult.

Database replication techniques

When data is the bloodline of business operations, data breaches, corruptions, inaccessibility due to server downtimes, and accidental deletions can stop business continuity and even drive your business out of business. In this article, we take a look at database replication techniques. That is, how to use data replication to keep data in your database management systems (DBMS) such as PostgreSQL or MySQL accessible and safe.