Nearest Neighbour Noise (NNN) as Regularization Method for Neural Networks

During my research about Noise Injection (NI) as a regularization method, an idea came into my mind. The usual NI works as follows:

The most common approach is to take a Gaussian Normal Distribution and simply add it to the Input of your data set during each epoch. Other variants have been proposed, e.g. multiplicating instead of adding…