Multi-Path Summation: The Σ a Single-Output Network Hides
Going from 1 output neuron to 2 adds one step to backpropagation. That step is not a new rule — the multivariable chain rule had it all along.
Going from 1 output neuron to 2 adds one step to backpropagation. That step is not a new rule — the multivariable chain rule had it all along.
A 2→2→1 network, and where every single number in three rounds of training comes from. Plus two things you only see once you actually run it.
Starting from handwritten digit recognition: what neurons, layers, weights, biases and activation functions each are, and why the whole network is only a function.