Question 30/30 fast.ai v3 lecture 10

Answer

Relevant part of lecture

supplementary material

There is a nice video from Andrew Ng (the deeplearning.ai series) on this. Here is a screenshot taken from it:

The red line is a regular average, and purple and green lines are EMA without correction and with correction. The impact of the inital mean of 0 is clearly visible if you compare these two close to the origin.

The red line is a regular average, and purple and green lines are EMA without correction and with correction. The impact of the inital mean of 0 is clearly visible if you compare these two close to the origin.