GPUs

Paper #2: Splitting One Network Across Two Graphics Cards

ReLU made training fast enough. But the network was too big to fit on a single graphics card, so the authors did something unusual: they cut it in half.

Sep 23, 20234 min read