Xavier initialization

Neural network weights are initialized by dividing by the square root of the number of inputs to prevent the network from being dead before training begins. This technique, known as Xavier initializat…