Explore Courses Blog Tutorials Interview Questions
0 votes
in Machine Learning by (55.6k points)

Can anyone explain the entropy in Machine Learning?

1 Answer

0 votes
by (119k points)
edited by

In Machine Learning, Entropy is a measure to calculate the impurity of the group. Entropy is used in tree algorithms such as Decision tree to decide where to split the data. Entropy helps to check the homogeneity of the data. Entropy is calculated using the following formula:

Entropy = ∑ -pi log2 (pi)

where pi is the probability of ith class

If you are interested to learn Machine Learning from Industry experts, you can enroll in this Machine Learning Course course by Intellipaat provides Instructor-led training, hands-on projects, and certification.

Also, watch this video on Machine Learning:

Browse Categories