Maximum Likelihood Estimation For Regression

Ashan Priyadarshana
Quick Code
Published in
9 min readFeb 15, 2018

--

Maximum likelihood estimation or otherwise noted as MLE is a popular mechanism which is used to estimate the model parameters of a regression model. Other than regression, it is very often used in statics to estimate the parameters of various distribution models.

photo courtesy Andrew Gook

A section wise summary of the artical is as follows. Although post is written with assumption of reader being started from begining, feel free to jump to any section at your desire.
-Normal / Gaussian distribution
-Binomial distribution
-What is MLE
-How to Calculate Likelihood
-How to use MLE for linear regression

Normal / Gaussian distribution
In probability the normal or gaussian distribution is a very famous continous probability distribution. It basically depends on two factors — the mean and the standard deviation. The mean of the distribution determines the location of the center of the graph and the standard deviation determines the height and width of the graph. So notation of normal distribution becomes:

PDF of Normal distribution is:

Note: from a pdf function, we can get the probability related to a data point x. So by substituting values for x, the relevant…

--

--

Ashan Priyadarshana
Quick Code

Associate Technical Lead | BSc. Information Technology | MSc. Artificial Intelligence | Founder Programming.lk | GSoC 2017 |