Introduction: Why you need a book like this
Beware of averages
Follow the money
Beware of the uncritical acceptance of convenient conclusions
Watch for selectivity in the data
Show me the data!
Beware of nostalgia
Beware of causal explanations made from correlational data
Be aware of whether the statistics being used are numbers or rates (percentages)
Know whether you're dealing with ranks or scores
Make sure the statistic used is the right one
Ask how the variable is defined
Ask how the variable is defined; and then ask what the criterion measure is
Differentiate practical and statistical significance
Look for trends, not snapshots
Beware of trends
Ask what the consequences are even if the interpretation of the data is true
Beware of changing demographics
Try to "see through" graphs
Beware of big (small) numbers
Beware of generalizations
The rise of testing
Types of tests
Other indicators of achievement
How come American students fall farther behind their international peers the longer they stay in school?
Why are test scores falling?
How come private schools do so much better than public schools?
Why don't we have vouchers so the money would follow the child?
Why don't we use charter schools as laboratories for innovation for the rest of the system?
Why are we throwing money at schools?
Why are SAT scores still falling?
Why don't bright people go into teaching?
With all this talk about standards and accountability, why aren't teachers and administrators held accountable?