Airflow has been adopted by many Cloudera Data Platform (CDP) customers in the public cloud as the next generation orchestration service to setup and operationalize complex data pipelines. Today, customers have deployed 100s of Airflow DAGs in production performing various data transformation and preparation tasks, with differing levels of complexity.
Support for unstructured data is now in public preview! That’s one of many of the exciting announcements made in September, in addition to a new serverless tasks feature, expanded public cloud regions, enhanced business continuity capabilities, and several new providers on Snowflake Data Marketplace.
Organizations are more often running data and applications on multiple clouds, and that’s great. However, multi-cloud isn’t enough. To let loose the true power of data on your business, you must be cross-cloud. Cross-cloud means data moves easily between multiple public clouds without any additional work. It means never worrying about where your data and applications live or where your business and technical people are located.
When power company executives were asked to list the most important issues facing their organizations, 45% overwhelmingly cited their top concern as “renewables, sustainability or the environment.” At the same time, global energy consumption continues to rise faster than the population. These two realities are reshaping the international energy sector. The push to produce more energy, in a greener manner, is propelling the industry to re-imagine the power grid of the future.
