Goal¶

This post aims to compare loss functions in deep learning with PyTorch.

The following loss functions are covered in this post:

• Mean Absolute Error (L1 Loss)
• Mean Square Error (L2 Loss)
• Binary Cross Entropy (BCE)
• Kullback-Leibler divergence (KL divergence)

Reference

• Medium - A Brief Overview of Loss Functions in Pytorch
• PyTorch Documentation - nn.modules.loss
• Medium - VISUALIZATION OF SOME LOSS FUNCTIONS FOR DEEP LEARNING WITH TENSORFLOW

Read more…