How covariate shift happens in neural networks

Photo by Zdeněk Macháček on Unsplash

During the training process of a deep neural network, the input values are propagated through many hidden layers. When that happens, the input values are multiplied (scaled) by weights in each hidden layer. Weights are also updated during the training. So, we get different activation values in each hidden layer…

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Rukshan Pramoditha

Rukshan Pramoditha

3.3K Followers

1M+ Total Views | 130K+ Monthly Views | Top 50 Data Science/AI/ML Writer on Medium | Sign up: https://rukshanpramoditha.medium.com/membership