There is a nice video
from Andrew Ng (the deeplearning.ai series) on this. Here is a screenshot taken from it:
The red line is a regular average, and purple and green lines are EMA without correction and with correction. The impact of the inital mean of 0 is clearly visible if you compare these two close to the origin.