Authentic Leadership — How to feel like DevOps During a recent retrospective with my team, I realized that despite consistently delivering high-value projects and meeting our organization’s objectives, none of my team members identified themselves as “DevOps Engineers” Instead, they primarily described their roles along the lines of release engineering and cloud support. …

For decades, theoretical physicists have been trying to come up with a grand unification theory. By unification, it means uniting two or more ideas that were thought to be as completely distinct, proving their different aspects as the same underlying phenomena. An example is prior to the 19th century, electricity…

Introduction There is no doubt that constructive feedback is a catalyst for growth and improvement in any endeavor, and it holds immense power, especially in the fast-paced world of software development. The expertise of Quality Assurance (QA) teams lie in providing valuable feedback throughout the software development life cycle, aiding in…

Eliminate downtime due to cluster spin-up and initializations Spark Structured Streaming, when deployed on Databricks, is a great solution for executing real-time streaming workflows at scale. In Spark’s driver-worker architecture, a driver program consumes from an input source like Kafka and delegates tasks to executors. As discussed in a previous…

Introduction In the rapidly evolving landscape of software development, the ability to continuously integrate and deploy applications is crucial for achieving shorter development cycles, faster time-to-market, and improved overall software quality. …

Introduction Looker, a powerful business intelligence tool, is designed to unlock significant value for your organization. It can be utilized for a variety of tasks, ranging from monitoring key performance metrics to validating specific queries. For users, one of the most important aspects to consider is the tool’s performance. Dashboards need…

Integrating Apache Airflow with Databricks : A Step-by-Step Guide Apache Airflow and Databricks are two potent tools for data engineering, data science, and data analytics. By integrating these tools, organizations can establish an efficient workflow management system that simplifies and automates complex workflows. …

TL;DR Since 2019, Apache Airflow has been releasing over 10 times a year from its GitHub repository. When maintaining a stable working environment from development to production, keeping up with all these releases can be challenging and time-consuming. Based on our experience, it is essential to not delay updates in…

At GumGum, our front-end stack is mostly the same across all applications: React, Redux, and our open-source design system. Although they are pretty cookie-cutter every time we create a new application, engineers are encouraged to research new technologies that could benefit our development process. …