Systems | Development | Analytics | API | Testing

Spark Technical Debt Deep Dive

Once in a while I stumble upon Spark code that looks like it has been written by a Java developer and it never fails to make me wince because it is a missed opportunity to write elegant and efficient code: it is verbose, difficult to read, and full of distributed processing anti-patterns. One such occurrence happened a few weeks ago when one of my colleagues was trying to make some churn analysis code downloaded from GitHub work.

Puppeteer in Node.js: Common Mistakes to Avoid

Puppeteer is a powerful Node.js browser automation library for integration testing and web scraping. However, like any complex software, it comes with plenty of potential pitfalls. In this article, I'll discuss a variety of common Puppeteer mistakes I've encountered in personal and consulting projects, as well as when monitoring the Puppeteer tag on Stack Overflow.

Revamping Data Management Strategies with Data Pipelines

1. Data pipelines can improve data management strategies by enabling quick and easy data flow, transformation, and analysis. 2. Considerations when building a data pipeline include real-time data ingestion, scalability, performance optimization, data security and governance, and support for multiple sources. 3. Data mesh is a decentralized data architecture that organizes data sources by their specific business domains and must comply with the principles of the architecture. 5.

Future-Proof Your Code: Top JavaScript Frameworks to Watch in 2023

The internet was written in JavaScript. This versatile programming language is supported by all major web browsers and has been used to create over 1.8 billion websites, which amounts to 98% of the world’s total (that figure will probably have jumped a few thousand by the time you finish this article). Developers love JavaScript for the dynamic web pages it empowers them to build, with a whole bunch of interactive elements and user interfaces available on a drag-and-drop basis.

7 Best Alternatives to WordPress with the Most Flexible Designs

If you want to create a website, you might have heard of WordPress. It has been one of the most highly recommended content management systems (CMS) since its creation in 2003. Over the years, it has become one of the world’s most popular website publishing software. That is also why it has millions of fans and is responsible for powering about 42.9% of all websites worldwide.

Feature Flags and How to Use Them in Software Development

Developing software can be a complex and sometimes chaotic process. You need to create, build, test and debug code quickly, while watching for potential problems down the road. Unfortunately, unless you’re Doctor Strange, you can’t predict the future. There’s no way of telling when clients may ask to add a feature or decide to completely scrap several features. When this happens, you obviously have to make changes to your code.

Getting Started with Flask: A Python Flask Tutorial

Flask is Python’s most popular web application framework. Using Flask, you can establish a strong foundation for a full-stack application, opening up frontiers for a more extensive, feature-rich website and allowing you to exercise full control over serving your web pages and over the internal data flow. At the end of this post, you will know enough to be able to create a basic web application using a Flask server. Let’s get started!