Page MenuHomePhabricator

Set QA Engineer up with being able to QA Data is firing on Android
Closed, ResolvedPublic

Description

Background
Presently our Data Scientist completes all validation steps for data. On other teams, the QA Engineer is responsible for validating that data is firing properly. Our team would like to adopt this model but will need to set up the QA Engineer to take on this task.

Task

  • Engineer set up QA Engineer how to stream events through the console OR data scientist to set up queries
  • QA Engineer ensure he has superset account
  • Data Scientist to cross train QA Engineer
  • Engineers to show QA Engineer how to stream events as it goes out

Reference
Sample Validation Sheet

Event Timeline

JTannerWMF triaged this task as Medium priority.Jun 21 2023, 9:32 AM

@ABorbaWMF Example ticket for QA/data validation: T320281. Linked Github has notebooks/queries I can help you create if we need to expand the first pass validation. Note our data validation needs are usually less involved than this example but it's a good resource and we should use a similar format, saving here for reference.

Hi @SNowick_WMF @JTannerWMF

Anthony and I were able to finally come up with a fool-proof process to see the events as they come in validate them against the schema doc. I have created a QA doc for the process here:
https://docs.google.com/document/d/1ZWowk_zS93lHiXo1nO5gQCRapeM-8f53ChYrvW2sV0Y/edit?usp=sharing

@ABorbaWMF Thank you for working with me on many iterations before landing on this :). Please review the document and let me know if you have questions or need more more info. Once you acknowledge that the document is sufficient, I will close out this task.

Thank you.

@Sharvaniharan Great news - let's have @ABorbaWMF do a first pass with the next instrumentation we implement. Thank you both for persistently working on this!

ABorbaWMF updated the task description. (Show Details)

Resolved from my side