Exploring Stochastic Gradient Descent with Restarts (SGDR)

Mark Hoffmann
Nov 16, 2017 · 5 min read
Example of Cyclic Learning Rates: From paper Snapshot Ensembles

38th Street Studios

Tips, tricks and updates we think are cool.

Mark Hoffmann

Written by

Data Scientist @NASAJPL 🚀 Entrepreneur @Padscouts, @38thStreetStudios. LA Living, Classical Pianist / Deep Learning Researcher

38th Street Studios

Tips, tricks and updates we think are cool.