Page MenuHomePhabricator
Create Task
Maniphest T135751

Workable CSV for Data need: Explore range of article revision comparisons
Closed, ResolvedPublic5 Story Points
Actions

Description

T134861: Data need: Explore range of article revision comparisons was about logging data.

This task is about creating a csv file out of the log data that the UX-team can use to make sense of it.

This is what needs to be included in the file:
For the revision view as is (without the new revision slider):

[] date and position of older revision (as in "the nth revision")
[] date and position of younger revision
[] total number of revisions of this article
[] maybe: article id

Background: This is an investigation task related to a wish from the German Community wishlist: https://de.wikipedia.org/wiki/Wikipedia:Umfragen/Technische_W%C3%BCnsche_2015/Topw%C3%BCnsche#Anzeige_aller_Bearbeitungskommentare_im_Diff_.5BUmfrage_2015.5D

Related Objects
Search...

Event Timeline

Lea_WMDE created this task.May 19 2016, 4:15 PM
Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptMay 19 2016, 4:15 PM
Lea_WMDE moved this task from Incoming to Backlog on the Revision-Slider board.May 24 2016, 1:36 PM
Lea_WMDE moved this task from Backlog to Maintenance on the Revision-Slider board.May 24 2016, 2:20 PM
Lea_WMDE moved this task from Incoming to Revision Slider on the TCB-Team board.May 30 2016, 11:22 AM
Lea_WMDE renamed this task from Workable CSV for Data need: User Behaviour when comparing article revisions to Workable CSV for Data need: Explore range of article revision comparisons .Jun 6 2016, 3:48 PM
Lea_WMDE updated the task description. (Show Details)
• Addshore added a subscriber: • Addshore.Jul 21 2016, 9:50 PM

Data should start appearing for this as of this evening.

• Addshore moved this task from Proposed to Doing on the TCB-Team-Sprint-2016-07-14 board.Jul 26 2016, 9:09 AM
• Addshore moved this task from Next to Back Burner 🏛️ on the User-Addshore board.
• Addshore set the point value for this task to 5.
• Addshore triaged this task as Normal priority.
• Addshore added a comment.EditedJul 26 2016, 11:39 AM

For the revision view as is (without the new revision slider):

This was not specified in the previous task and thus the data currently being collected is for ALL views to the diff page.
@Jan_Dittrich @Lea_WMDE does this need to change?

Also there was no request for the dates of the revisions being compared.
I will make another patch and wait for it to be deployed before making any CSV.

Jan_Dittrich added a comment.Jul 26 2016, 11:57 AM

Hmm, it would be good to distinguish between them (Existence of the revisions slider would be a confounding variable), but even without the data is useful.

gerritbot added a subscriber: gerritbot.Jul 26 2016, 12:00 PM

Change 301110 had a related patch set uploaded (by Addshore):
dewiki_diffstats add rev timestamps & feature state

https://gerrit.wikimedia.org/r/301110

gerritbot added a comment.Jul 26 2016, 12:10 PM

Change 301110 merged by jenkins-bot:
dewiki_diffstats add rev timestamps & feature state

https://gerrit.wikimedia.org/r/301110

gerritbot added a comment.Jul 26 2016, 2:02 PM

Change 301119 had a related patch set uploaded (by Addshore):
dewiki_diffstats add rev timestamps & feature state

https://gerrit.wikimedia.org/r/301119

gerritbot added a comment.Jul 26 2016, 6:30 PM

Change 301119 merged by jenkins-bot:
dewiki_diffstats add rev timestamps & feature state

https://gerrit.wikimedia.org/r/301119

• Addshore added a comment.Jul 27 2016, 12:04 AM

So I have made a script @ https://github.com/addshore/dewiki_diffstats which can be used to turn the log files into a CSV with all of the data requested in it.

Links to the code and an explanation of the data in the resulting CSVs can be found in the README @ https://github.com/addshore/dewiki_diffstats/blob/master/README.md

The python script can be run on fluorine (as shown below)

python process.py /a/mw-log/dewiki_diffstats.log

I guess now we just need to wait for more data to appear.
@Jan_Dittrich what period of data do you want?

• Addshore moved this task from Doing to Done on the WMDE-Analytics-Engineering board.Jul 28 2016, 11:52 AM
• Addshore moved this task from Back Burner 🏛️ to Closing ✔️ on the User-Addshore board.
• Addshore moved this task from Review to Done on the TCB-Team-Sprint-2016-07-14 board.
• Addshore closed this task as Resolved.
Jan_Dittrich added a comment.Aug 1 2016, 2:54 PM

The data I have now is sufficient, so we can stop the logging. (@Addshore )

gerritbot added a comment.Aug 1 2016, 2:55 PM

Change 302258 had a related patch set uploaded (by Addshore):
Remove dewiki_diffstats logging

https://gerrit.wikimedia.org/r/302258

gerritbot added a comment.Aug 1 2016, 2:56 PM

Change 302259 had a related patch set uploaded (by Addshore):
Remove dewiki_diffstats logging

https://gerrit.wikimedia.org/r/302259

gerritbot added a comment.Aug 1 2016, 3:28 PM

Change 302259 merged by jenkins-bot:
Remove dewiki_diffstats logging

https://gerrit.wikimedia.org/r/302259

• Addshore added a comment.Aug 1 2016, 3:47 PM
In T135751#2511644, @Jan_Dittrich wrote:

The data I have now is sufficient, so we can stop the logging. (@Addshore )

Logging disabled and there is now a patch up to remove the code that was running for the logging too.

gerritbot added a comment.Aug 1 2016, 5:13 PM

Change 302258 abandoned by Addshore:
Remove dewiki_diffstats logging

Reason:
Done in a revert in https://gerrit.wikimedia.org/r/#/c/302274

https://gerrit.wikimedia.org/r/302258

gerritbot added a comment.Aug 1 2016, 5:14 PM

Change 302258 restored by Addshore:
Remove dewiki_diffstats logging

https://gerrit.wikimedia.org/r/302258

• Addshore moved this task from Doing to Done on the Revision-Slider board.Aug 3 2016, 5:13 PM
gerritbot added a comment.Aug 4 2016, 4:00 PM

Change 302258 merged by jenkins-bot:
Remove dewiki_diffstats logging

https://gerrit.wikimedia.org/r/302258

Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL