Systems | Development | Analytics | API | Testing

May 2023

Data-Driven Decision-Making in Utility Sector

For the past 25+ years, Kirk Mower, Cyber Security and Data Integrity Leader at TasNetworks, has been on a mission to scale Data-Driven Decision Making in a sector marked by the vast amount and complexity of data - Australian Utilities Space. In this engaging fireside chat, Kirk talks about the significance of data in the utility sector, his role as a data leader, and his thoughts on the Modern Data Stack. Check out this delightful data talk on our new show - Mavericks of Data.

Amazon Redshift ETL - Top 3 ETL Approaches for 2023

Amazon Redshift is a completely managed Data Warehouse, offered as a cloud service by Amazon. It can scale up to petabytes of data and offers great performance even for complex queries. Table of Contents Its columnar nature with Postgres as the querying standard makes it very popular for analytical and reporting use cases. These days it is very common to use Amazon Redshift as the backbone Data Warehouse for highly reliable ETL or ELT systems.

SQL Server to Snowflake: 2 Easy Methods

Microsoft SQL Server is kind of a swiss army knife for most SME needs and workloads. However there are a handful of things that SQL Server will be better at, and there’s a handful of things Snowflake will be better at. Table of Contents Snowflake is great if you have big data needs. It offers scalable computing and limitless size in a traditional SQL and Data Warehouse setting. If you have a relatively small dataset or low concurrency/load then you won’t see the benefits of Snowflake.

Aurora to Snowflake ETL: 5 Steps to Move Data Easily

Often businesses have a different Database to store transactions (Eg: Amazon Aurora) and another Data Warehouse (Eg. Snowflake) for the company’s Analytical needs. There are 2 prime reasons to move data from your transactional Database to a Warehouse (Eg: Aurora to Snowflake). Table of Contents Firstly, the transaction Database is optimized for fast writes and responses. Running Analytics queries on large data sets with many aggregations and Joins will slow down the Database.

MongoDB to Snowflake: 2 Easy Methods

Before we dive deep into MongoDB to Snowflake data migration steps, it is important to understand the unique properties of MongoDB and Snowflake that make a data migration like this both challenging and exciting. Table of Contents NoSQL databases like MongoDB address very specific use cases. Data storage and access patterns will be highly optimized for fast write and retrieval and many other factors like the availability and durability of data.

Data Maturity Models: Why Having Capabilities in Place Isn't Enough

Data maturity models measure the extent to which organizations have developed their data capabilities. They focus on a couple of dimensions that can include strategy, leadership, culture, people, governance, architecture, processes, and technology. Table of Contents The maturity levels of each of these dimensions may be measured along a continuum of four to six levels.

MariaDB to MySQL: 2 Easy Methods

MariaDB and MySQL are two widely popular relational databases that boast many of the largest enterprises as their clientele. Both MariaDB and MySQL are available in two versions – A community-driven version and an enterprise version. But the distribution of features and development processes in the community and enterprise versions of MySQL and MariaDB differ from each other.