Effect of Batch Size on Neural Net Training

co-authored with Apurva Pathak

Welcome to the first installment in our Deep Learning Experiments series, where we run experiments to evaluate commonly-held assumptions about training neural networks. Our goal is to better understand the different design choices that affect model training and evaluation. To do so, we come up with questions about each design choice and then run experiments to answer them.

In this article, we seek to better understand the impact of batch size on training neural networks. In particular, we will cover…




Evaluating deep learning design choices through experimentation

Recommended from Medium

Machine Learning Paradigms

Introducing Huskarl: The Modular Deep Reinforcement Learning Framework

GANimation — Facial Animation

Building an Image Database

Dual-input CNN with Keras

Managing ML experiments with Spark and Kafka

Programmatic approach to Machine Learning

AI Modeling Explained and Simplified

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Daryl Chang

Daryl Chang

More from Medium

R-CNN Object Detection and Semantic Segmentation

Neural Net Optimizers

Beginners guide to Convolution Neural Networks

A Single Camera 3D Functions