…reduce to) left most values of Σ to lower dimensionality?
Well there is something special about Σ .
Σ is a diagonal matrix, there are p (number of dimensions) diagonal values (called singular values) and their magnitude indicates how significant they are to preserving the information.
So we can choose to reduce dimensionality, to the number of dimensions that will preserve approx. g…