A/B split testing for Recipes
|Opened on:||Sunday, January 24, 2010 - 21:53|
|Last modified:||Wednesday, January 27, 2010 - 15:30|
When creating a recipe there's a problem that you really don't know whether you should put 10, 15 or 20 into a function like set_behavior_clash_importance.
It would be nice to be able to write a recipe that randomly chooses one of the three numbers every times the recipe runs and afterwards uploads information about the score change that the recipe produced and the time that the script took to complete.
This would allow evidence based fine tuning of the parameters of recipes.