Skip to main content
Cloud & AI Hub
Browse
Glossary AI Directory Playgrounds Models Prompts Explainers Strategy Matrix Benchmark Decoder

Weight Initialization

The strategy of assigning initial random numeric values to neural weights to prevent gradient explosion.

Weight Initialization assigns initial weights using probability distributions (like Xavier or Kaiming methods) to prevent gradient signals from exploding or vanishing during the first steps of training.

Historical figures and technical concepts for informational purposes only. Not technical, professional, legal, or financial advice. Sources: Official Documentation.