What
Develop a test suite that allows for viewing the rendered output of mobile-html on a variety of articles on a variety of language wikis. This will allow us to make changes to mobile-html and verify the visual output hasn't significantly regressed.
How
There are three main steps to achieve this, increasing in difficulty, so they can be completed as time allows. Each step should inform the next, so it's useful to do them in order.
- Create lists of the top 1000 articles of the past 5 years on the top 30 wikis. The lists should be stored in the repo for testing but easy to update with a script.
- Build a tool that allows for browsing the visual output of those articles in a browser, an android app, and an iOS app. The tool should show the local development version or the mobileapps.wmflabs version along side the current production version. This tool will assist with manual testing and day to day development.
- The wikipedia-ios-liter app is an initial prototype of the end goal expressed here
- Build a test suite that renders the output of these pages to images and tracks the changes over time