HomePhabricator

Add functions for working with interleaved experiments
39f4533c6887Unpublished

Authored by mpopov on Aug 5 2017, 12:26 AM.

Unpublished Commit · Learn More

Not On Permanent Ref: This commit is not an ancestor of any permanent ref.

Description

Add functions for working with interleaved experiments

  • Functions for working with interleaved search results experiments; see ?interleaved for details
      • interleaved_preference() calculates the preference statistic from click data according to Eq. 4 from Chapelle et al. (2012) paper on interleaved search evaluation
    • interleaved_bootstraps() resamples sessions with replacement to generate a sample of preferences
    • interleaved_confint() computes a confidence interval from a bootstrapped sample of preferences
    • These require a C++11-compatible compiler
  • C++-based exact_binomial() to estimate sample size for exact binomial tests
  • Misc. things changed with this patch:
    • ggplot themes theme_min() and theme_facet()
    • Documentation updates (including a vignette on interleaved experiments)
    • Syntax-checking unit test
    • MIT licensing

Bug: T150032
Change-Id: Ie6aa90fad2b25a07b200a2c822f5a34227cca8c8

Details

Committed
mpopovNov 2 2017, 4:50 PM
Parents
R1821:1b8b395c0df9: Fix variable name
Branches
Unknown
Tags
Unknown
References
refs/changes/03/370303/9
ChangeId
Ie6aa90fad2b25a07b200a2c822f5a34227cca8c8