If you like what you see here, please post this website on other sites. Message me directly on Twitter with any comments.
Categorical Cross Entropy
These are some additional notes that I am taking on the incredible book by David Foster on Generative Deep Learning
The calculation for this is:
$$\Huge - \overset{n}{\underset{i = 1}{\Sigma}} y_i\space log(p_i)$$
This simply shows the log of the prediction times the ground truth. Then you sum all of this up for each data point.