When can feedback loops occur? What are the consequences of feedback loops in the context of recommendation systems?
Answer
When your model is controlling the next round of data you train it on. A good example of this are recommendation systems - they predict what content a user will like, but they are also determining what content the user is even exposed to, and helping determine what has a chance of becoming popular.