Page MenuHomePhabricator

Run A/B Test of Wikipedia Android App Product Page for Japanese users on Google Play Store
Open, HighPublic

Description

Hypothesis

We believe that showcasing the features valued by users based on reviews from the App Store and Google Play using modern visuals and benefit-focused messaging (e.g.: “ad free access to articles on millions of topics and languages”) that reflects the app’s current state

Will result in a higher installation rate and retention rate than the existing product page designs and copy

We will know this is true when our installation rate of the improved designs and copy exceed the existing designs and copy on the app store.

Task

  • Finalize copy @JTannerWMF
  • Align on designs in English in preparation for translation and design missing screens @TLessa-WMF
  • Get copy and designs translated into Japanese @TLessa-WMF
  • Launch A/B Test in Google Play Store in Japanese @TLessa-WMF
  • Check progress and determine if we should run the test longer @JTannerWMF
  • Provide recommendations on next steps @TLessa-WMF
  • Publish winning designs and copy

Designs

Control

Screenshot 2025-10-03 at 10.02.01 AM.png (938×1 px, 782 KB)

Experiment - in the process of being translated to Japanese

[Android] Android screens.png (1×5 px, 1 MB)

Figma link: https://www.figma.com/design/QvsLu7llrctBWbAANlTHTG/iOS---%3E-App-Store-A-B-test?node-id=3031-776&t=Q1oGW1o5Nnp6Cco0-1

Copy

Control:

Save and organize articles with Reading lists
Learn about nearby Places
Add Widgets to your home screen
Switch between articles with Tabs
Read comfortably in Dark mode
Explore new content on your customized feed
Search in 300+ languages
Edit articles with ease
Discuss articles with Talk pages
Stay updated with Notifications

Experiment:

Experimental Refreshed Copy for Android

Title (Short Description)

Wikipedia: Free knowledge without ads, always at your fingertips

Long Description (Body Copy)

The official Wikipedia app for Android helps you search, read, and contribute to the world’s largest free knowledge project — ad-free and free of charge, forever. Explore 60+ million articles in over 300 languages, wherever you are.

Why you’ll love this app

  1. Free, open, and ad-free

Wikipedia is created, edited, and verified by volunteers worldwide, supported by the nonprofit Wikimedia Foundation. No ads, no tracking — just knowledge you can trust.

  1. Search smarter, discover more

Find the information you need without distraction. Search across 300 languages, explore trending and breaking news, and save personalized recommendations to your reading list.

  1. Stay connected offline

Save articles to custom reading lists and access them offline — perfect for travel or learning without internet access.

  1. Test your knowledge

Try a daily trivia game to see how much you know and learn something new along the way.

  1. Explore nearby places

Discover articles about landmarks, cities, and places near you — or places you dream of visiting.

  1. Read your way

Choose from light, sepia, dark, or pure black themes. Adjust text size and switch to night mode for comfortable reading anywhere, anytime.

  1. Get insights into your activity

See your own reading and contribution activity on Wikipedia with personalized insights that help you understand and celebrate how you use the app.

  1. Stay organized with tabs (UPDATED from: Keep knowledge organized with tabs so it fits in 2 lines)

Open multiple articles in tabs and switch between them with ease, just like in a browser. Compare topics, keep your place, and dive deeper without losing track.

  1. Join the conversation

Read and reply to article discussion pages, and get notifications when discussions you follow are updated.

  1. Contribute on the go

Make micro-contributions with Suggested Edits or manage your Watchlist to help keep Wikipedia accurate and up to date.

Additional Information

Highlights Copy

Free knowledge made easy. Explore 60M+ articles ad-free in 300+ languages, wherever you are. Save articles for offline reading, get personalized recommendations, and track your learning. Play trivia, explore places, and stay organized with tabs — all free, forever, while protecting your privacy.

Event Timeline

WIP Figma here: https://www.figma.com/design/QvsLu7llrctBWbAANlTHTG/iOS---%3E-App-Store-A-B-test?node-id=3038-1201&t=MDyQSBhuBU5LJXhy-4

Started conversation with Jaz, Derek and Carolyn on Slack about questions I have and gathering feedback.

Note: we don't have the Android screens yet, the ones in the mockup are iOS screens as placeholders.

Japanese screens ready: https://www.figma.com/design/QvsLu7llrctBWbAANlTHTG/iOS---%3E-App-Store-A-B-test?node-id=3109-3365&t=ioEoSVDBSwyqHCIh-1

Had to request a Japanese-speaking staff's help to make sure line breaks were okay in the screenshots. We're good to go.

Lets proceed with the wining design and copy.

Recommendations:
• As seen below, for a while the winning variant is the dark blue one + new copy
• Although it’s not statistically significant, after checking with Shay, it seems we have strong enough signals to call this the winning variant.

Screenshot 2025-11-21 at 3.31.30 PM.png (1×2 px, 141 KB)

The winning variation was published and replaced the default in Japan.

Screenshot 2025-11-21 at 3.46.44 PM.png (1×2 px, 440 KB)