Systems | Development | Analytics | API | Testing

Latest Posts

Ingesting data from AWS s3 to Snowflake using Stitch

Stitch is a very simple yet very powerful cloud service which connects to a diversity of data sources. It is a very user-friendly ingestion system and works in a very simple format. Stitch connects to the data sources, pulls the data and loads the data to a target. In this blog, I am going to connect to Amazon S3, read a file and load the data to Snowflake but first let’s understand few concepts of Stitch. For Stitch to work you need an Integration and a Destination.

Data Integration Best Practices - How to set the framework for data integration projects

So far, in our blog series Data Integration Best practices, we have covered the different types of high-level and low-level problems occurring in data integration projects. We have also addressed the different types of integration, the systems that move data and even the pricing aspect of such a project. Ten articles later, we arrived at best practices moving forward. In this last chapter, we are going to talk about some tips that revolve around preparing for and running an integration project.

How to bulk load Snowflake tables using Talend Cloud Platform

Talend Cloud is an Integration platform as a service (iPaaS) offering by Talend. It is a fully managed cloud option which has the capabilities of data integration, data stewardship, data preparation, API designer and Tester and Pipeline designer. These tools can be used for lightweight ETL and detecting the schema on the fly. One of the unique features of Talend Cloud is it provides both on premise and cloud execution environments.

From DevOops to DevOps | Best Strategies to Implement for Your Team

In today’s rapidly changing world, software products need to be upgraded frequently and quickly to bring value to customers and users. Software features are continuously developed, tested, deployed, and operated in the production environment. New features are not only developed and tested successfully, but they also deployed and operated without much chaos and disruption.

Microsoft Azure & Talend : 3 Real-World Architectures

We know that data is a key driver of success in today data-driven world. In fact, according to Forrester, data and insight-driven businesses are growing at an average of more than 30% annually. However, becoming a data driven organization is not easy. Companies often struggle with speed in accessing and analyzing their data, as well with ensuring delivery of trustworthy data that is free of critical errors.

What to Consider Before Applying CI/CD | A Beginner's Cheat Sheet

Continuous Integration and continuous delivery (CI/CD) is a complex part of any development cycle. It involves continuously integrating code into a shared repository to keep code progression amongst a team of developers running smooth and steady. This helps prevent merging errors, duplicated efforts and promoting collaboration to create a better product. That code is then thoroughly and continuously tested to keep problems from arising.

The first Pay-as-You-Go design environment for accelerating integration projects

The integration landscape is changing. According to Gartner, “Two-thirds of all business leaders believe that their companies must pick up the pace of digital transformation to remain competitive.” One of the byproducts of this increasing pace is the desire to get results quickly. In a cloud-first world, that means expectations are changing for how products are trialed, procured, and billed. People expect things to be simpler, faster, and more intuitive.