Jean-Claude Cote – Medium

Jean-Claude Cote

Jean-Claude Cote
in
Towards Data Science

Performance Insights from Sigma Rule Detections in Spark Streaming

Utilizing Sigma rules for anomaly detection in cybersecurity logs: A study on performance optimization

Jun 1

Performance Insights from Sigma Rule Detections in Spark Streaming

Jun 1

Jean-Claude Cote
in
Towards Data Science

Performant IPv4 Range Spark Joins

A Practical guide to optimizing non-equi joins in Spark

Jan 25

Performant IPv4 Range Spark Joins

Jan 25

Jean-Claude Cote
in
Towards Data Science

Unleashing the Power of SQL Analytical Window Functions: A Deep Dive into Fusing IPv4 Blocks

How to summarize a geolocation table by merging contiguous network IPv4 blocks

Jan 10

Unleashing the Power of SQL Analytical Window Functions: A Deep Dive into Fusing IPv4 Blocks

Jan 10

Jean-Claude Cote
in
Towards Data Science

Anomaly Detection Using Sigma Rules: Build Your Own Spark Streaming Detections

Easily deploy Sigma rules in Spark streaming pipelines: a future-proof solution supporting the upcoming Sigma 2 specification

Jun 12, 2023

Anomaly Detection Using Sigma Rules: Build Your Own Spark Streaming Detections

Jun 12, 2023

Jean-Claude Cote
in
Towards Data Science

Anomaly Detection using Sigma Rules (Part 5) Flux Capacitor Optimization

To boost performance, we implement a forgetful bloom filter and a custom Spark state store provider

Mar 17, 2023

Anomaly Detection using Sigma Rules (Part 5) Flux Capacitor Optimization

Mar 17, 2023

Jean-Claude Cote
in
Towards Data Science

Anomaly Detection using Sigma Rules (Part 4): Flux Capacitor Design

We implement a Spark structured streaming stateful mapping function to handle temporal proximity correlations in cyber security logs

Mar 2, 2023

Anomaly Detection using Sigma Rules (Part 4): Flux Capacitor Design

Mar 2, 2023

Jean-Claude Cote
in
Towards Data Science

Anomaly Detection using Sigma Rules (Part 3) Temporal Correlation Using Bloom Filters

Can a custom tailor made stateful mapping function based on bloom filters outperform the generic Spark stream-stream join?

Feb 14, 2023

Anomaly Detection using Sigma Rules (Part 3) Temporal Correlation Using Bloom Filters

Feb 14, 2023

Jean-Claude Cote
in
Towards Data Science

Anomaly Detection using Sigma Rules (Part 2) Spark Stream-Stream Join

A class of Sigma rules detect temporal correlations. We evaluate the scalability of Spark’s stateful symmetric stream-stream join to…

Feb 2, 2023

Anomaly Detection using Sigma Rules (Part 2) Spark Stream-Stream Join

Feb 2, 2023

Jean-Claude Cote
in
Towards Data Science

Anomaly Detection using Sigma Rules (Part 1): Leveraging Spark SQL Streaming

Sigma rules are used to detect anomalies in cyber security logs. We use Spark structured streaming to evaluate Sigma rules at scale.

Jan 24, 2023

Anomaly Detection using Sigma Rules (Part 1): Leveraging Spark SQL Streaming

Jan 24, 2023

Jean-Claude Cote
in
Towards Data Science

Leveraging Azure Event Grid to Create a Java Iceberg Table

We will use Azure Event Grid to implement an event-driven architecture

Jan 10, 2023

Leveraging Azure Event Grid to Create a Java Iceberg Table

Jan 10, 2023

Jean-Claude Cote

Jean-Claude Cote

Data democratization advocate and principal engineer at Canadian Centre for Cyber Security | jean-claude.cote@cyber.gc.ca | Twitter @cybercentre_ca

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams