I am trying to solve some classification problems. It seems many classical approaches follow a similar paradigm. That is, train a model with some training set and then use it to predict the class labels for new instances.
I am wondering if it is possible to introduce some feedback mechanisms into the paradigm. In control theory, introducing a feedback loop is an effective way to improve system performance.
Currently, a straight forward approach on my mind is, first we start with an initial set of instances and train a model with them. Then each time the model makes a wrong prediction, we add the wrong instance into the training set. This is different from blindly enlarge the training set because it is more targeting. This can be seen as some kind of negative feedback in the language of control theory.
Is there any research going on with the feedback approach? Could anyone shed some light?