Use feedback or reinforcement in machine learning?

Question

I am trying to solve some classification problems. It seems many classical approaches follow a similar paradigm. That is, train a model with some training set and then use it to predict the class labels for new instances.

I am wondering if it is possible to introduce some feedback mechanisms into the paradigm. In control theory, introducing a feedback loop is an effective way to improve system performance.

Currently, a straight forward approach on my mind is, first we start with an initial set of instances and train a model with them. Then each time the model makes a wrong prediction, we add the wrong instance into the training set. This is different from blindly enlarge the training set because it is more targeting. This can be seen as some kind of negative feedback in the language of control theory.

Is there any research going on with the feedback approach? Could anyone shed some light?

Answer 1

There are two areas of research:

One is Reinforcement Learning. This is an online learning paradigm that allows you to get feedback and update your policy as you observe the results.

The second is active learning, where the classifier gets to select examples from a pool of unclassified examples to get labeled. The classifier will choose the examples for labeling which best improve its accuracy by choosing difficult examples under the current classifier hypothesis.

Also, you can go through the Machine Learning Certification course for more details.

Hope this answer helps you!