What is entropy in Machine Learning?

Question

Can anyone explain the entropy in Machine Learning?

Answer 1

In Machine Learning, Entropy is a measure to calculate the impurity of the group. Entropy is used in tree algorithms such as Decision tree to decide where to split the data. Entropy helps to check the homogeneity of the data. Entropy is calculated using the following formula:

Entropy = ∑ -pi log2 (pi)

where pi is the probability of ith class

If you are interested to learn Machine Learning from Industry experts, you can enroll in this Machine Learning Course course by Intellipaat provides Instructor-led training, hands-on projects, and certification.

Also, watch this video on Machine Learning: