Google has published a new “Webmaster Help” video, In that Matt Cutts talks about what goes into evaluating the quality of an algorithm change before they push it out.
Here’s the question he was answering:
What are some of the metrics that Google uses to evaluate whether one iteration of the ranking algorithm is delivering better quality results to users than another?