Next: Problems with Gain Ratio
Up: Decision Tree Learning
Previous: Example
- Information Gain has natural bias towards attributes with many values over ones
with few
- For instance attribute has highest information gain
- use Gain Ratio
-
- entropy of S with respect to the values of A
-
- if attribute A (Date),
- if attribute B splits the examples in half,
- if attributes A and B have the same then B will clearly
score higher
Patricia Riddle
Fri May 15 13:00:36 NZST 1998