Keeping Up Statistical Appearances