Part 18 : Norms

Avnish
Linear Algebra
Published in
3 min readApr 19, 2019

Norm is a function that returns length/size of any vector (except zero vector).

Lets assume a vector x such that

For any function f to be a norm, it has to satisfy three conditions

Condition 1

If norm of x is greater than 0 then x is not equal to 0 (Zero Vector) and if norm is equal to 0 then x is a zero vector.

Condition 2

For any scalar quantity, say K

Condition 3

Assuming that we have another vector y

If these three conditions are satisfied then the function f is a norm.

Commonly used Norms

The most commonly used norms are clubbed under p-norms or (lₚ-norms) family, where p is any number greater than or equal to 1.

The p-norm of vector x will be denoted as

To calculate the p-norm of vector x we have the formula

Every element of vector x is raised to the power p. Then their sum is raised to the power (1/p)

It could be re-written in simplified form as

Manhattan Distance (1-norm)

1-norm is also called Manhattan distance because it measures distance between two points in a city given that you can only travel along orthogonal city blocks.

Suppose, for a vector a we have to calculate 1-norm.

1-norm could be represented on a figure as

Line in red represents 1-norm of vector a

To calculate 1-norm using formula, we could just replace p by 1

Euclidean Norm (2-norm)

The most used norm within p-norm family is the Euclidean Norm or 2-norm. We have used it earlier to calculate the magnitude of vector.

Euclidean Norm returns the shortest distance between two points.

So, 2-norm of vector a will be

and to show 2-norm of vector a on figure

Line in red represents 2-norm. It is the shortest distance between origin and point represented by vector a

Infinity-norm

The infinity-norm returns maximum absolute value in the given vector.

Infinity-norm of vector a will be

Suppose we have to find infinity-norm of another vector, say b

then

4 is the largest number in vector b but infinity-norm returns maximum absolute value

Read Part 19 : Minors and Cofactors

You can view the complete series here
I’m now publishing at avni.sh

Connect with me on LinkedIn.

--

--