Apache NiFi — REST — Stocks — STONKS
REGULAR CODE
EASY CODE
FLOW
This is a pretty easy flow, let’s see if we can tweak it. Next week, let’s see if we can optimize with NiFi 2.0.0-M1.
3 Different InvokeHTTP (Should Consolidate and Feed with a list or cache)
UpdateAttribute
UpdateAttribute
ForkRecord
QueryRecord
UpdateRecord
UpdateRecord
UpdateRecord
PublishKafkaRecord
RetryFlowFile
Stock Sources
https://api.twelvedata.com/time_series?symbol=SNOW&interval=1min&apikey=ANAPIKEY&outputsize=5000
Raw Stock JSON Data
{
"meta" : {
"symbol" : "IBM",
"interval" : "1min",
"currency" : "USD",
"exchange_timezone" : "America/New_York",
"exchange" : "NYSE",
"mic_code" : "XNYS",
"type" : "Common Stock"
},
"values" : [ {
"datetime" : "2023-12-06 15:59:00",
"open" : "160.25000",
"high" : "160.36000",
"low" : "160.25000",
"close" : "160.32001",
"volume" : "92509"
}, {
"datetime" : "2023-12-06 15:58:00",
"open" : "160.25000",
"high" : "160.25500",
"low" : "160.21001",
"close" : "160.24500",
"volume" : "35550"
}, { ...Cleaned JSON Data
{
"symbol":"GOOG",
"uuid":"2e73f71b-1fea-47b2-8edc-cc2193ac126a",
"ts":1701897905801,
"dt":1673896200000,
"datetime":"2023/01/16 14:10:00",
"open":"138.50999",
"close":"138.46001",
"high":"138.50999",
"volume":"27528",
"low":"138.46001"
}
REFERENCE
Flow Download
