04:04
2026-06-26
pub.towardsai.net
neural-networks
Why Every Weight in a Neural Network Is Born Divided by the Square Root of n.
Neural network weights are initialized by dividing by the square root of the number of inputs to prevent the network from being dead before training begins. This technique, known as Xavier initializatβ¦