Change Details

The idea is to create an A/B test analysis/report template (see http://rmarkdown.rstudio.com/developer_parameterized_reports.html) that allows anyone (mostly Chelsy and Mikhail but also Erik, for example) to specify a few parameters in a config file– e.g. SQL query, metrics, aggregation level – and then generate a report that fetches the appropriate data, cleans it up, and runs through the specified metrics. This will not replace the thorough analysis and report with interpretation provided by analysts. It will only serve as an initial peek for the team. According to Mikhail and Chelsy's discussion (T131795#3375527), the first prototype will include: - Configuration reader - Data fetcher + processor - Summary stats in a table: - CTR - ZRR - First clicked - Generate Rmd/markdown of report

The idea is to create an A/B test analysis/report template (see http://rmarkdown.rstudio.com/developer_parameterized_reports.html) that allows anyone (mostly Chelsy and Mikhail but also Erik, for example) to specify a few parameters in a yaml file– e.g. SQL query, metrics, aggregation level – and then generate a report that fetches the appropriate data, cleans it up, and runs through the specified metrics. This will not replace the thorough analysis and report with interpretation provided by analysts. It will only serve as an initial peek for the team. According to Mikhail and Chelsy's discussion (T131795#3375527), the first prototype will include: - Configuration reader - Data fetcher + processor - Summary stats in a table: - CTR - ZRR - First clicked - Generate Rmd/markdown of report

The idea is to create an A/B test analysis/report template (see http://rmarkdown.rstudio.com/developer_parameterized_reports.html) that allows anyone (mostly Chelsy and Mikhail but also Erik, for example) to specify a few parameters in a configyaml file– e.g. SQL query, metrics, aggregation level – and then generate a report that fetches the appropriate data, cleans it up, and runs through the specified metrics. This will not replace the thorough analysis and report with interpretation provided by analysts. It will only serve as an initial peek for the team. According to Mikhail and Chelsy's discussion (T131795#3375527), the first prototype will include: - Configuration reader - Data fetcher + processor - Summary stats in a table: - CTR - ZRR - First clicked - Generate Rmd/markdown of report