Apache NiFi 1.22 Updates

Apache NiFi 1.22 is now available for download!

Photo by NASA on Unsplash

Apache NiFi Downloads

I recommend you add some extra NARs for your NiFi deployment.

GitHub - tspannhw/FLaNK-NARs: NARs

The NiFi Media NAR is a great one and includes my processor based on Tika for parsing PDFs and Documents.

A List of new features, updates and fixes:

MiNiFi/C2 - Support access via LB / Proxy

Expose JMX metrics from NiFi JVM

Add a ModifyCompression processor

Add Azure Queue Storage Processors using Azure SDK 12

Add ADLSCredentialsControllerServiceLookup

Add AzureStorageCredentialsControllerServiceLookup_v12

AttributeToJSON: Nested JSON

Example image viewed in lineage

Upgrade Apache Tika to 2.7.0

Image Viewer not available in Apache NiFi release

Deprecate ECMAScript Script Engine

Deprecate Lua and Ruby Script Engines

Release Date: June 11, 2023

A full list of issues that were resolved can be found at:

Release Notes - ASF JIRA

Deprecated Components and Features

NiFi CLI Update to export and import all!

Add Export/Import All - NiFi CLI - NiFi Registry

https://www.apache.org/dyn/closer.lua?path=/nifi/1.22.0/nifi-toolkit-1.22.0-bin.zip

registry export-all-flows
registry import-all-flows

That’s a lot of reason to upgrade, if you are on NiFi 1.20 or earlier it’s a no brainer. Even if you are on NiFi 1.21, they bug fixes alone are worth it.

This should be it for a few months, but additional releases may come fast as the sprint towards NiFi 2.0 continues.

https://attend.cloudera.com/nificommitters0503

Data In Motion

Apache NiFi 1.21/1.20 Updates

Create processor for triggering HMS events

Add Put Processor for Apache IoTDB

Add GenerateRecord processor to populate records with random data

Add GetAsanaObject Processor

Add Processors for AWS Polly, Textract, Translate, and Transcribe Services

Add Expression Language method to encode a URI

Create PutSalesforceObject processor

Add PutDropbox processor

MiNiFi C2 - Implement UPDATE/PROPERTIES command

MiNiFi C2 - Implement UPDATE/PROPERTIES command

Add a 'count' function to RecordPath

Add Decrypt Processors Compatible with EncryptContent Encoding

Add PutBoxFile processor

Add Processor to Verify Content using HMAC algorithm

Now put NiFi and friends in action

Harnessing the Power of NiFi: Building a Seamless Flow to Ingest PM2.5

FLaNK Stack

References

https://localhost:8443/nifi-api/system-diagnostics/jmx-metrics

Apache NiFi Documentation

Inheritance

Email Record Sink

Lots of Reporting Tasks (Azure, DataDog, Prometheus, NiFI)

Parameter Providers