Next: Information Gain Example
Up: Decision Tree Learning
Previous: What Attribute is the
-
, where 
is
the set of possible values for the attribute 
and 
is
the subset of 
for which attribute has value 
. - Information Gain is the expected reduction in entropy caused by knowing the value of
attribute .
- Information Gain is the information provided about the target
function value, given the value of some other attribute .
- The value of
is the number of bits saved when
encoding the target value of an arbitrary member , by knowing the
value of .
Patricia Jean Riddle
Wed Jun 23 13:06:34 NZST 1999