Question 2/7 fast.ai v4 lecture 4
What is the difference between a metric and a loss? Which one has a nicely behaved gradient?
The metric is the thing we actually care about, the loss the thing that is similar to what we care about that has a nicely behaved gradient.
Relevant part of lecture