Systems | Development | Analytics | API | Testing

The 5 Types of Data Processing

As the business landscape continues to evolve, companies are becoming increasingly more reliant on their data. However, before you can utilize any data for the benefit of your company, you must first process both the structured and unstructured data that you collect. While the simplest and most well-known form of data processing is data visualization, there are several different data processing methods that are commonly used to interact with data.

Streaming data into BigQuery using Storage Write API

BigQuery is a serverless, highly scalable, and cost-effective data warehouse that customers love. Similarly, Dataflow is a serverless, horizontally and vertically scaling platform for large scale data processing. Many users use both these products in conjunction to get timely analytics from the immense volume of data a modern enterprise generates.

Qlik Lineage Connectors Brief Overview and Use Case

Qlik Lineage Connectors is a new offering that provides lineage related insights for QlikView, Qlik Sense client-managed and other on premise BI applications and data sources such as Tableau, PowerBI, Oracle, Azure SQL and Snowflake. It also offers a visual data lineage capability integrated with Qlik Sense SaaS, allowing you to see the complete history of those assets without having to access multiple systems. In this scenario I am considering migrating my Windows on-premise Qlik Sense client-managed environment over to Qlik Sense SaaS.

Snowpark Explained In Under 2 Minutes

What if there was a way to enable your entire team to collaborate securely on the same data in a single platform that just works, regardless of language? Snowpark is here to help. Supercharge your data team to securely build scalable, optimized pipelines, and quickly and efficiently execute machine learning workflows, with your choice of language.

How to get data from Keboola to Google Data Studio?

Google Data Studio is a beautiful visualization tool that turns your data into compelling story-telling reports. But before you can visualize your data, you have to collect it, clean it, and validate it. This is where Keboola comes in. Keboola is the Data Stack as a Service (DaaS) platform that helps you with all your data operations - from building and automating ETL pipelines to data governance.

Operationalizing Data Pipelines With Snowpark Stored Procedures, Now in Preview

Following the recent GA of Snowpark for our customers on AWS, we’re happy to announce that Snowpark Scala stored procedures are now available in preview to all customers on all clouds. Snowpark provides a language-integrated way to build and run data pipelines using powerful abstractions like DataFrames. With Snowpark, you write a client-side program to describe the pipeline you want to run, and all of the heavy lifting is pushed right into Snowflake’s elastic compute engine.

Connected Apps or Managed Apps: Which Model to Implement?

We recently wrote about the interest we’re seeing in connected applications that are built on Snowflake. Connected applications separate code and data such that the app provider creates and maintains the application code, while their customers manage their own data and provide their data platform for processing the application’s data. Some of our partners choose the connected application model because it has benefits for both customers and application providers.