Systems | Development | Analytics | API | Testing

ETL

Top 5 ETL to Snowflake Tools for 2021

Reports and records. Sales sheets and spreadsheets. Files and financials. Your team has more big data than you can comprehend spread across multiple data sources in more locations than a James Bond movie. Isn't it time you kept this data somewhere safe? Moving data to a data warehouse like Snowflake is like keeping thousands of books in a library or a trove of treasure in an underground vault. Big data, your most prized asset, will be safe and snug.

Leveraging ETL to Enable your Domain Driven Design

How much do you know about Domain-Driven Design (DDD)? It's a design approach to software development where the language and structure of software code match the business domain. The concept comes from a 2003 book by Eric Evans. And it influences software architects, information architects, data engineers, and computer science professionals who organize code and solve some seriously stressful software problems. Domain-Driven Design is a super-successful concept with brilliant business logic benefits.

ETLG: ETL for Data Governance and Better Security

Most enterprises are leveraging vast reserves of data to improve their business insights and decision-making. However, as companies manage larger stores of data and move more and more information from operational databases to data warehouses, it creates an ever-mounting threat of data breaches.

Xplenty's X-Console: A How-To Guide

One of Xplenty's most rewarding features is its ability to enact low-code and no-code digital transformation. Even with no experience in ETL or data integration, non-technical users can take advantage of Xplenty’s intuitive drag-and-drop interface to build robust, complex data pipelines to a data warehouse or data lake in the cloud.

How to Offload ETL from Redshift to Xplenty

Amazon Redshift is great for real-time querying, but it's not so great for handling your ETL pipeline. Fortunately, Xplenty has a highly workable solution. Xplenty can be used to offload ETL from Redshift, saving resources and allowing each platform to do what it does best: Xplenty for batch processing and Redshift for real-time querying. Redshift is Amazon’s data warehouse-as-a-service, a scalable columnar DB based on PostgreSQL.

Introducing Component Previewer

The component previewer is a feature that allows you to preview your data at each component step without having to validate packages and run full-scale production jobs. It gives you the ability to extract, transform and preview your data on any transformation component, allowing you to debug your pipeline and/or to confirm and validate your data flow logic. Component previews are similar to the data previews available on source components, which you might already be familiar with.

Scheduling With Cron Expressions in Xplenty

One of the most requested features in a data integration tool is greater flexibility around the scheduling of packages and workflows. With Xplenty, this can be achieved through the use of our Cron Expression scheduling feature. Cron is a software utility that enables Unix-based operation systems, such as Linux, to use a job scheduler. You can create cron jobs, which execute a script or command at a time of your choosing. Cron has broad applications for tasks that need time-based automation.