Systems | Development | Analytics | API | Testing

Processing DICOM Files With Spark on CDP Hybrid Cloud

In this video, you will see how you can use PySpark to process medical images from an MRI and convert them from DICOM format to PNG. The data is read from and written to AWS S3 and we leverage numpy and the pydicom libraries to do the data transformation. We are using data from the "RSNA-MICCAI Brain Tumor Radiogenomic Classification" Kaggle competition but this approach can be used for general purpose DICOM processing.

Managing APIs at Scale in a Kubernetes Environment - Part II

In the last blog, we discussed the challenges in managing APIs at scale in a Kubernetes environment. We also discussed how deploying a Kubernetes Ingress Controller or an API gateway can help you address those challenges. In this blog, we will briefly touch upon some of the similarities and differences between an API gateway and Kubernetes Ingress. We will also discuss a unique approach offered by Kong for the end-to-end lifecycle API management (APIM) in Kubernetes.

Process Mining, Low-code, and the Future of Innovation, Part 1

This is the decade of hyperautomation—a decade when companies are doubling down on mating critical processes to drive sustainable growth. But here’s the problem. An eye-popping 60 to 80% of your organization’s processes may be running on unstructured data such as documents and email according to news reports. Which makes them that much harder to automate manage and audit.

New Report Shares Best Practices for Modern Enterprise Data Management in Multi-Cloud World

A new report from Raconteur highlights the most important trends shaping the future of enterprise data management in 2021. The Raconteur Future of Data Report is packed with valuable insights that reveal how the world’s leading businesses are generating and collecting more data than ever before, and how they’re innovating to make better use of it.

Talend iPaaS momentum grows. Talend recognized in the 2021 Gartner Magic Quadrant for Enterprise iPaaS

As organizations continue to embrace cloud-based computing as the cornerstone of their digital transformation, the integration platform as a service (iPaaS) has become a critical component of their integration environments. An iPaaS solution simplifies the integration of data, applications, and systems, whether in the cloud or on-premises, through unified support for API, application, data, and B2B integration styles.

How Cloudera DataFlow Enables Successful Data Mesh Architectures

In this blog, I will demonstrate the value of Cloudera DataFlow (CDF), the edge-to-cloud streaming data platform available on the Cloudera Data Platform (CDP), as a Data integration and Democratization fabric. Within the context of a data mesh architecture, I will present industry settings / use cases where the particular architecture is relevant and highlight the business value that it delivers against business and technology areas.

A Practical Guide to Automated Testing Strategy: Benefits, Best Practices, and More

An automated testing strategy answers the who, what, when, why, and how of software test automation. While automation can be used for many kinds of software testing, in this post, we’re going to focus on the steps you should take when developing a strategy for functional UI testing (also known as end-to-end testing). End-to-end testing simulates real user conditions to test the functionality of an application from the front-end user interface.

The Great Data Revolution Is Here, and Qlik Customers Are at the Heart of It

Data – the amount we create, how we create it, how it is accessed (think both people and Artificial Intelligence/machines), and how we use it to inform, propel and influence everyone and everything is one of the biggest challenges and opportunities we face in our lifetime. And it’s driving enormous change.