Entropy in Artificial Intelligence is to calculate the impurity of the group that helps to make a better split of data. Entropy is a measure that is used to check the homogeneity of the data. Entropy is calculated using the following formula:
Entropy = ∑ -pi log2 (pi)
where pi is the probability of ith class
You can learn more about the Expert system in AI by enrolling in our Applied AI Course.