We have a model that overfits. What actions, and in what order, should we consider to maximize its performance?

It is important to thoroughly consider how we can make our model perform better (getting more data, augmenting data, searching for an architecture that generalizes better) before we jump to limiting its capabilities. It's easy to overlook these steps and it comes at a price of limiting the performance our model can achieve.