Improved Estimated Accuracy

1. calculate the rule accuracy over training data
2. calculate the standard deviation assuming a binomial distribution
3. For a given confidence interval, lower bound estimate is taken as measure of rule performance

• for large data sets the estimated accuracy is very close to the observed whereas it grows further away as the data set size decreases
• not statistically valid, but found useful in practice