Sitemap
TDS Archive

An archive of data science, data analytics, data engineering, machine learning, and artificial intelligence writing from the former Towards Data Science Medium publication.

Follow publication

Member-only story

Semi-supervised Anomaly Detection using Auto Encoders

7 min readNov 30, 2020

--

In this article, I’ll be discussing a paper [1] that proposes an AutoEncoder based approach for the task of semi-supervised anomaly detection. If you want to look at the GitHub repository link, results and conclusion directly, please scroll to the bottom of the article.

Introduction

Anomaly detection refers to the task of finding unusual instances that stand out from the normal data [1]. The non-conforming patterns can be referred to using different names depending on the application area/domain, such as anomalies, outliers, exceptions, defects, containments, etc. [2] In several applications, these outliers or anomalous samples are of greater interest compared to the normal ones. Specifically in the case of industrial surface inspection and infrastructure asset management, finding defects (anomalous regions) is of extreme importance.

But there are several challenges that make this a difficult task.

Challenges in Anomaly Detection [2]

There are several challenges in anomaly detection and a few of the major ones are explained below.

  1. Definition of the normal region which encompasses every possible normal behavior is extremely challenging.
  2. Even noise is different…

--

--

TDS Archive
TDS Archive

Published in TDS Archive

An archive of data science, data analytics, data engineering, machine learning, and artificial intelligence writing from the former Towards Data Science Medium publication.

Manpreet Singh Minhas
Manpreet Singh Minhas

Written by Manpreet Singh Minhas

DL/CV Research Engineer | MASc UWaterloo | Follow and subscribe for DL/ML content | https://github.com/msminhas93 | https://www.linkedin.com/in/msminhas93