You have actually personally seen your validation error getting worse.
Relevant part of lecture
How can the model continue to improve while the loss on the validation set increases as well? More importantly, how can the accuracy continue to improve in this scenario? Here is a discussion on the fastai forums that delves deeper into this.