Category: Neural Network Research

An Empirical Study of Training Stability in Feedforward Neural Networks Abstract Weight initialization plays a critical role in neural network optimization by influencing early gradient flow, convergence speed, and training stability. While theoretically motivated initialization schemes such as Glorot (Xavier) and He (Kaiming) are widely adopted, their practical behavior depends on architectural and optimization context….