Systems | Development | Analytics | API | Testing

How can you avoid wasting engineering cycles around data pipeline creation and maintenance? Answer: Powered By Fivetran

Welcome back to another one of our Community Roundups, folks! Summer is halfway gone, but we hope you’re having a great time nonetheless. Let’s take a look at what’s been going on in the community!

When migrating a data warehouse to BigQuery, one of the most critical tasks is mapping existing user permissions to equivalent Google Cloud Identity and Access Management (Cloud IAM) permissions and roles. This is especially true for migrating from large enterprise data warehouses like Teradata to BigQuery. The existing Teradata databases commonly contain multiple user-defined roles that combine access permissions and capture common data access patterns.

Cloudera’s Operational Database provides unparalleled scale and flexibility for applications, enabling enterprises to bring together and process data of all types and from more sources, while providing developers with the flexibility they need. In this blog, we’ll look into capabilities that make Operational Database the right choice for hyperscale.

No-code is growing quickly. More and more people from all roles and departments are using a wide range of new tools and apps to build and experiment without fighting for engineering resources. This creates amazing opportunities for growth, but it also means data teams have to integrate data from ever-more sources to get a full picture of their business’s operations.

Next to the healthcare system, COVID-19’s biggest infrastructural burden fell upon the supply chain. Fluctuations in supply and demand of essential goods, along with the oil surplus, led to a freight cliff in mid-April. Outbound tender volume and spot rates bottomed out, which highlighted a massive drop in demand. As the market rebounds, technological investments are key to the industry’s recovery.

Since the financial crisis of 2008, regulators have been consistently working to identify emerging risks that can potentially result in financial stability events. The growth in cloud adoption across the Financial Services Industry (FSI) and the associated increase in reliance on third-party infrastructure providers has gained the attention of regulators at global, regional, and national levels.

Earlier this year, Sauce Labs announced the release of our newest product to expand developer-first capabilities: Sauce Testrunner Toolkit. Currently in a free beta, it makes setting up, writing, and running web tests easier and faster for developers during early pipeline testing. This is the first in a number of updates to our platform that empower developers with the tools they need to achieve quality at scale.

Fivetran is the industry leader of fully managed data integration from lots of different sources to your data warehouse. There are hundreds of popular sources, like Salesforce, Zendesk, NetSuite, and more, for which Fivetran has fully managed, prebuilt connectors that can deliver your data to your warehouse within literal minutes. However, people often struggle to get data from more obscure sources since most data integration tools focus on what is popular.

Cloud computing is a well-established IT option for businesses of all sizes in the modern era, but there are still plenty of organizations that have remained reticent about adoption. If you are in this camp, here is a look at a few of the reasons that migrating an on-premise data warehouse to the cloud may make a lot of sense, in addition to the other contexts in which the cloud could be a better fit for your business.