This is a technique used in Neural network training to make learning more stable.
Usage with frameworks
Keras
You can use Batch Normalization in Keras like this.
keras.layers.BatchNormalization()
Documentation of the Keras batch norm layer: https://keras.io/api/layers/normalization_layers/batch_normalization/
PyTorch
torch.nn.BatchNorm1d(out_dim)
Torch documentation for batch norm: https://pytorch.org/docs/stable/generated/torch.nn.BatchNorm1d.html
Useful links
Citation
If you find this work useful, please cite it as:
@article{yaltirakli,
title = "Batch normalization",
author = "Yaltirakli, Gokberk",
journal = "gkbrk.com",
year = "2025",
url = "https://www.gkbrk.com/batch-normalization"
}
Not using BibTeX? Click here for more citation styles.
IEEE Citation Gokberk Yaltirakli, "Batch normalization", March, 2025. [Online]. Available: https://www.gkbrk.com/batch-normalization. [Accessed Mar. 12, 2025].
APA Style Yaltirakli, G. (2025, March 12). Batch normalization. https://www.gkbrk.com/batch-normalization
Bluebook Style Gokberk Yaltirakli, Batch normalization, GKBRK.COM (Mar. 12, 2025), https://www.gkbrk.com/batch-normalization