Paper #2: ReLU, the Small Change That Made Big Networks Trainable
AlexNet's shape is familiar from Paper #1. What we skipped is how the activation function controls training speed. Picking a fast one, ReLU, is the first thing that made training a network as big as AlexNet possible.