Chapter 2 : SVM (Support Vector Machine) — Theory

Savan Patel
May 3, 2017 · 6 min read
Image for post
Image for post
A bug in the code is worth two in the documentation.

0. Introduction

Image for post
Image for post
Image A: Draw a line that separates black circles and blue squares.
Image for post
Image for post
s Image B: Sample cut to divide into two classes.

1. Making it a Bit complex…

Image for post
Image for post
Can you draw a separating line in this plane?
Image for post
Image for post
plot of zy axis. A separation can be made here.
Image for post
Image for post
Transforming back to x-y plane, a line transforms to circle.

2. Making it a little more complex…

Image for post
Image for post
What in this case?
Image for post
Image for post
Image 1
Image for post
Image for post
Image 2
Image for post
Image for post
When somebody asks me for advice.

3. Tuning parameters: Kernel, Regularization, Gamma and Margin.

Kernel

Regularization

Image for post
Image for post
Image for post
Image for post
Left: low regularization value, right: high regularization value

Gamma

Image for post
Image for post
High Gamma
Image for post
Image for post
Low Gamma

Margin

Image for post
Image for post
Image for post
Image for post

4. In next part of this chapter,

5. Conclusion


Image for post
Image for post
Coding is but art of thinking than typing.

Machine Learning 101

Machine Learning articles for beginner to intermediates.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store