Yes, exactly! Weight decay (regularization) will reduce overfitting in neural network models by penalizing large weights. Here is an article about that: https://rukshanpramoditha.medium.com/how-to-apply-l1-and-l2-regularization-techniques-to-keras-models-da6249d8a469