Report: 28-Feb-2024: Building Realtime AI Applications with Apache Flink

Apache Flink, LLM, RAG, apiRAG, Low Code, Flink SQL, Apache NiFi, Meetup, Cloudera, New York City

We had a great turnout and nine real pizzas from Roma the pizza place down the block. We had a little bit of an issue with the Zoom audio but we figured that out with a hand-held microphone.

Video

The live stream started early streaming to Youtube without a lot going on (as we were testing, setting up, having pizza and networking).

Login to Meetup | Meetup

Chat / Q&A

19:15:20  From A B : Why is NiFi used  between source and Flink ? As it is additional tech?
19:17:07  From Michael Kohs : Replying to "Why is NiFi used  be..."

NiFi has more connectors than Flink and can also retrieve data. 

For use cases where you don’t need advanced processing/analytics across time windows, NiFi can do it all without Flink.

19:17:29  From Michael Kohs : Replying to "Why is NiFi used  be..."

Sometimes organizations only use NiFi, some only use Flink and some combine it

Slides

2024 February 28 - NYC - Meetup Unlocking Financial Data with Real-Time Pipelines

Matthias Broecheler From DataSQRL will post his slides soon and I will add them here.

https://github.com/tspannhw/meetups/blob/main/28feb2024/Cloudera%20Meetup%20Feb%202024_%20Building%20Realtime%20AI%20Applications%20with%20Apache%20Flink.pdf

For a PDF download of my slides:

meetups/2024Feb08OSS at main · tspannhw/meetups

ADDITIONAL RESOURCES FROM THE MEETUP

More Photos are coming, please send yours.

DataSQRL

Build Realtime Data Products | DataSQRL

https://github.com/DataSQRL/sqrl/tree/main/sqrl-examples

GitHub - DataSQRL/apiRAG: Retrieval Augmented Generation for (semi-)structured data using APIs

apiRAG/api-examples/finance at main · DataSQRL/apiRAG

Cloudera

What is SQL Stream Builder?

What is SQL Stream Builder?

GitHub - tspannhw/FLaNK-Transit: More transit details

Tim’s Demo Output

current.jpg

7:14
Camera: Skyline-1872  I-495 at Roslyn Rd  I-495
Direction of Travel Westbound
Lat/Long:  40.784926/-73.637802
URL: https://511ny.org/map/Cctv/1872--1 https://s52.nysdot.skyvdn.com:443/rtplive/R10_016/playlist.m3u8 https://511ny.org/map/Cctv/1872--1#
Date: Thu, 22 Feb 2024 23:40:33 GMT 8918478324
File: path.e8f45845-aa46-4c68-b9c8-5322c1367d6220240222184073.jpg

==== OLLAMA: Thu, 29 Feb 2024 00:03:41 GMT : 2024-02-29T00:03:41.237383Z
Eval Count/Duration: 79 2304748000
Load Duration: 1223625 Total Duration: 2448116417
Prompt Eval Count: 6 Prompt Eval Duration: 141614000
Model: mistral
Prompt:
What is the current stock price for Microsoft?
Response:
 I cannot provide you with the current stock price for Microsoft in real-time as I don't have the ability to access live data. However, you can easily check the latest stock price by visiting reputable financial news websites or using a financial app that provides real-time stock quotes. Microsoft's stock symbol is MSFT on major exchanges like NASDAQ and NYSE.
==== Meta Info:
Slack msg id: a2f31408-fa4b-40bd-a2f3-ec70523d9d59
Timothy Spann
bunkertor
America/New_York
UUID: 254fdbf5-62e2-40e1-9013-344cf923ff04
=====