The short time I have spent on Kaggle, I have realized ensembling (stacking models) is the best way to perform well.
