The Startup
Published in

The Startup

Operationalising NiFi on Kubernetes

Cloud Gate — Millenium Park Chicago.

This blog details my experience setting up a secure multi-node NiFi (1.9.2) cluster on Kubernetes (AWS EKS). I used the OIDC protocol for authentication (I set up a Keycloak server that acts as an identity broker to my organization’s Google IAM). There were a few ‘gotchas’ that took me way longer to figure out than they should have. The information on this topic is pretty scattered and I had to dig deep through NiFi’s…




Get smarter at building your thing. Follow to join The Startup’s +8 million monthly readers & +756K followers.

Recommended from Medium

A Few Tips Every Aspiring Programmer Should Know

Run Gitlab Pipeline DRY

How to transfer BigQuery table to Cloud SQL using Cloud Dataflow

Proceed With Caution: Code Reuse

Managing Your Lambda Empire with Serverless

Tips for better learning

Zero Downtime Deployments: Best Practices for CI/CD on Heroku

Effective Agile Retrospectives

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Swarup Karavadi

Swarup Karavadi

Dev is love. Dev is life.

More from Medium

Kubernetes Architecture: An Overview

Best Practices to Optimize Your Kubernetes Cloud Costs

Logging for Spark on Kubernetes

Journey to reverse engineer OpenShift operator