We've talked about elevating the quality of our multivariate testing code in the past. ("We" should be understood inclusively!)
Our attention was piqued by PlanOut, a framework for online field experiments released by Facebook.
There is now an open-source PHP port of that library called ABLincoln. We should take a close look at it and see if it would have value for us.