In my last blog post I explained what model and data parallelism is and analysed how to use data parallelism effectively in deep learning. In this blog post I will focus on model parallelism.
[Read more…] about How to Parallelize Deep Learning on GPUs Part 2/2: Model Parallelism