Next: Problems with Gain Ratio
Up: Decision Tree Learning
 Previous: Example
 
-  Information Gain has natural bias towards attributes with many values over ones
with few
 -  For instance  
  attribute has highest information gain -  use Gain Ratio
 -   
  -  entropy of S with respect to the values of A
 -   
  -  if attribute A (Date),  
  -  if attribute B splits the examples in half,  
  -  if attributes A and B have the same  
  then B will clearly
score higher
 
 
Patricia Riddle 
Fri May 15 13:00:36 NZST 1998