Page MenuHomePhabricator

[Spike] Can we use production data for our Visual Regression test environment?
Closed, DeclinedPublic3 Estimated Story PointsSpike

Description

Similar to T305662, to get the most confidence out of our visual regression tests, our database would have a subset of actual data from a production db including articles, templates, and gadgets.

Back in 2015, there was great work done in T120345 for visual regression testing that generated an XML dump from a number of wikis: https://dumps.wikimedia.org/other/testfiles/20160405/ . This work might be relevant to our efforts in setting up a production-like environment for our visual regression tests.

Question we are trying to answer

  • Meet with @ssastry and determine how feasible it is to use the dump files from 2015. Does it have all the article text, templates, etc necessary to show a production-like page when imported into a MariaDB database and what are the steps needed to import it? Compare this approach against using the content provider (or perhaps some other strategy).

Event Timeline

nray renamed this task from [Spike] Can we use production data to [Spike] Can we use production data for our Visual Regression testing environment?.Apr 7 2022, 11:35 PM
nray renamed this task from [Spike] Can we use production data for our Visual Regression testing environment? to [Spike] Can we use production data for our Visual Regression test environment?.
ovasileva changed the point value for this task from 0 to 3.Apr 12 2022, 5:50 PM
nray updated the task description. (Show Details)
nray added a subscriber: ssastry.

@ovasileva I hope these dump files do work because it would be amazing to use these when developing new skins.

Our team talked about this ticket today and agreed that, at least for now, we are content with going with a more barebones mediawiki setup with minimal seed data and seeing how far that takes us. As a result, I am declining this ticket