Next: Problems with Gain Ratio
Up: Decision Tree Learning
Previous: Example
- Information Gain has natural bias towards attributes with many values over ones
with few
- For instance
attribute has highest information gain - use Gain Ratio
-
- entropy of S with respect to the values of A
-
- if attribute A (Date),
- if attribute B splits the examples in half,
- if attributes A and B have the same
then B will clearly
score higher
Patricia Jean Riddle
Wed Jun 23 13:06:34 NZST 1999