Paper #6: Looking Inside, and What It Left Open
A few of a trained RNN's memory values track things nobody told it about, such as whether it's inside a quote. Karpathy also names what RNNs do poorly, and points to attention as the next step.
Tag
interpretability
Paper #2: What AlexNet Learned, and Why It Mattered
With AlexNet trained, this last post looks at what the network learned, and why this paper mattered.
Paper #1, Part 14: Peeking Inside the Black Box (What Is a CNN Looking At?)
Neural networks learn patterns, but we can't see them directly. Visualization techniques let us peek inside and understand what features a network has learned.