+2 votes
in Machine Learning by (170 points)
I am a beginner and want to know what exactly the difference between these two algorithms.

1 Answer

+2 votes
by (10.9k points)
edited by

@mistry , Hope this answer will help you understand better.

 Discriminative Approach- This happens in the case of logistic regression, Conditional Random Fields (CRFs), etc. Some literature also describes these as probabilistic classifiers. The name ‘discriminative’ comes from the fact that under a probabilistic perspective, we are trying to find a conditional distribution that is helping us differentiate between different labels. In this approach, we don’t care about the distribution of data.

Generative Approaches - When we try to predict Pr(x|y) or more generally Pr(x,y) from the data ,we are trying to model the distribution D from which the data is generated.

 For example-

Let’s try to predict Pr(y|x)

Say (x,y) stand for (Height,Gender) in a country

 A discriminative approach tells us that for a given height, how much the height is likely to be of a female or a male. The generative approach will let us know the distribution of heights for each female and a male.

The discriminative approach helps us make predictions based on gender from a country while the generative approach can help us make comparisons between different countries in terms of their gender heights.

Welcome to Intellipaat Community. Get your technical queries answered by top developers !