Alexander Crosson
Aug 25, 2017 · 1 min read

I don’t know which mother boards support that many PCIe slots. But you could link a bunch of 4 GPU machines together on the same network, and then do parameter updates by pulling from all the nodes.

)
    Alexander Crosson

    Written by

    Curious about Deep Learning, NLP, AI. Hopeful traveler, wannabe chef.

    Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
    Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
    Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade