Data Science

What is information gain?

Describes how much an attribute improves (decreases) entropy.
 
IG(parent, children) = entropy(parent) - [p(c1)*entropy(c1)+p(c2)*entropy(c2)...]

Diskussion