Expressibility Tradeoff

• Very expressive representations allow close approximations to the ideal target function V, but the more expressive the representation the more training data the program will require in order to choose among the alternative hypothesis
• Also depending on the purpose, a more expressive representation might make it more or less easy for people to understand!!