Tags02

#Diagnostics

2026-09-09·—READS·—LIKES·Learning AI with AI

Divide the Learning Rate by 3: Four Plots That Turn Guessing into Arithmetic

The six-layer network runs, and all four diagnostic plots are in hand. The first three are snapshots of a single step, and all three are green; the one that yields an action item is the fourth — it turns “what should the learning rate be” from a range a sweep can only narrow into a factor you can compute.

2026-09-08·—READS·—LIKES·Learning AI with AI

Saturation from 62.3% to 1.4%: Four Lines of Initialisation, and an Order to Debug In

An initial loss of 17 and six in ten neurons dead on arrival — because the standard deviation is amplified once at each of two matrix products. The fix is four lines, but what actually travels is the checklist of what to check in what order, and why Kaiming loses to a guessed number on this particular network.