Sep 17 2020
Sep 16 2020
<Provide link to Data QA checks document once it is created>
Sep 15 2020
thank you @MNeisler ! for your review :)
09/15 Meeting Notes: SearchSatisfaction Instrumentation & Data-QA
Sep 10 2020
awesome, thanks @MNeisler for the feedback. :)
Sep 9 2020
Moving this to Backlog, to pick up after I get back from Parental Leave (in dec)
Stretch goal for Q1.
Assigning to @cchen as I will be on parental leave starting Sep 21.
We've been able to get a few recommendations from stakeholders as a part of the Content Dataset Questionnaire.
Created QC document, updated link in description : Search Feature QC : Instrumentation QA and data checks
Sep 8 2020
Currently drafting the Requirement Document : Content Data Accessibility
Sep 7 2020
Requested @JTannerWMF to create Phab task template.
Sep 3 2020
Sep 2 2020
Sep 1 2020
Added the following features:
- Tagging a user in a talk page comment - using @mention or clicking an icon
Completed Data-QA. Verdict: Data in both the schemas look good!
Here are some notes/observations.
Aug 17 2020
Aug 12 2020
Aug 11 2020
Reviewed the QA-Instrumentation Checklist Phab Form with Kate and Jazmin.
Sent the content of the Data-QA checklist that we would like included in the Phab task template and added to Guidelines document, to Jazmin.
- Present the template to Editing and Web teams
- Document this in the QA Process documentation T228228
Aug 7 2020
Aug 4 2020
Jul 30 2020
Jul 29 2020
- Assuming everything is working as expected [i], @Mayakp.wiki is there any work left to be done on this task on your end (e.g. confirm the events/fields are being logged in the DB correctly)?
i. "Working as expected": as evidenced by all of the events in rows 182-204 being marked as Passed.
Jul 28 2020
The number of events have picked up as of today. Here's the break up by day and wiki.
@Mayakp.wiki and @Edtadros are working on the post deployment instrumentation data-QA.
Jul 27 2020
@alexhollender : Can you please file a task, set a priority and tag Product-Analytics ? We can triage this request tomorrow in our Board Refinement meeting.
Currently reviewing T238449 with Kate, Jazmin etc. before publishing it to Product teams.
Closing this task since we have started deploying on production test wikis.
- T255727 is complete, tested in T257909
- Donate (and other external links) T258513 : observed that they are not logged in Network tab but they are making it to the db.
Post deployment data-QA is being done in T256075
Jul 24 2020
On July 23 @Edtadros helped fire many events to external links on Testwiki to check on this issue and I can confirm that all events have made it to the database.
Posted initial results here
We will be checking on the test wikis listed here T258058 in the next 2 weeks.
Jul 23 2020
I have done some preliminary checks on the data and posted results here : https://github.com/wikimedia-research/Collapsible-Sidebar-Analysis/blob/master/Post%20Deployment%20Data%20QA%20for%20Collapsible%20Sidebar%20Instrumentation.ipynb
Jul 22 2020
Jul 21 2020
Jul 17 2020
@Ryasmeen I have added a new section to the QC document and provided instructions in the Test Description of this task.
We are primarily looking at the data being stored in the 6 new fields. For that, I've added a few scenarios where you can trigger specific actions to validate them.
Please feel free to ping/chat or let me know if you have any questions.
Jul 16 2020
Hi @CGlenn, thank you for opening this task and letting us know about its priority. We will triage this task during our next Board Refinement meeting on Tuesday 7/21 and provide you an update.
Jul 10 2020
Jul 9 2020
- We are unable to check Donate link on Testwiki
Jon has added the link to testwiki for us. Thanks Jon ! :)
- Collapsed/Uncollapsed state of the sidebar is sometimes persistent, sometimes not
This is dependent on the deployment of T255727 and yet to be completed. Edward will re-test once this is fixed.
Jul 8 2020
I will be assisting @Edtadros with this task to check events in the Data Lake.
Posting an update on this task: During our weekly 1:1s, Peter and Megan are actively brainstorming on this problem statement :
Jul 7 2020
Sent to Jazmin Tanner to review. Will review with Kate in the next 1:1
Jul 6 2020
Jul 2 2020
@ppelberg I agree. Its best to record it in the current document. @Ryasmeen should test all the editing interfaces in each test scenario under the Production section of the Replying QC Template.
If she sees an unexpected value in any of the fields she can mark that scenario as 'failed' and explain the bug in the issue description (this should work even if she encounters issues with one scenario in multiple editing interfaces).
Jun 29 2020
Discussed the below items in our instrumentation meeting today:
Jun 27 2020
I don't believe this takes into account GlobalPreferences, correct? That would mean we're potentially missing some highly active cross-wiki users.
Jun 25 2020
June 25, 2020: new Open question have come up
- name of "donate" link
Every sidebar is different depending on the wiki. It’s defined by https://en.wikipedia.org/wiki/MediaWiki:Sidebar . As you can see there donate is defined as “sitesupport-url|sitesupport” which means we will see name=n-sitesupport for this specific link. This is not an ideal value to be stored in the database table.
Action: @Mayakp.wiki @has asked if we can transform the name. Jdlrobson is seeing if it's possible to change just the donate link and at what cost.
- Sidebar instrumentation gotcha - any community liaison support needed?
We will be discussing on email to get to a consensus and then posting updates here, if any.
@Nuria , I did reach out to @Ottomata back in May when we were designing the new schema. I would like to clarify that after discussions with @ovasileva and the web team's engineers we eventually decided to go with legacy EL as mentioned in my earlier comment-
Jun 24 2020
hey @ovasileva , can we have this task updated to include the use of VectorSkinVersion that we spoke about in our last 1:1 ?
Jun 23 2020
Thanks @DLynch for the clarification and update.
I have added a new test scenario for when you type in the field inside the link window. Can you confirm if its correct?
When user clicks on "Link" i.e. "🔗" icon to add a hyperlink on selected text and types in the field inside the link window
Hi @ppelberg, I agree, it would be better if David could answer this.
sidenote: not sure why but I never got an email or notified for the ping on June 18. sorry about that.
Duplicate task, created by mistake.
Jun 22 2020
Next Up: From meetings with @JTannerWMF it is required to make a Phab ticket checklist of all the Data QA steps that need to be performed and attach it to an instrumentation task - to get the various people involved in the instrumentation QA to do the things, update their statuses and keep the analyst informed.