Page MenuHomePhabricator
Create Task
Maniphest T189653

Please review: public data sets for the WDCM Biases Dashboard
Closed, ResolvedPublic
Actions

Description

Please review the following data sets and files that need to be made public (i.e. placed in https://analytics.wikimedia.org/datasets/wdcm/) for the WDCM Biases Dashboard:

  • genderProjectDataSet.csv
  • globalIndicators.csv
  • mfPropProject.csv
  • genderUsage_Distribution.png
  • genderUsage_Distribution_jitterp.png
  • M_Items_Distribution.png
  • F_Items_Distribution.png
  • Gender_LorenzCurves.png

All png files are produced from aggregated data only. The three csv tables do not contain any private data: they all encompass only Wikidata usage data and are produced by combining the data from the WDQS with the data obtained by querying the WDCM Hive tables; thus nothing here refers to any particular users.

All files are currently stored on stat1005 in /home/goransm/RScripts/_pdReview/WDCM_Biases/

The README.txt is also present in this directory.

Thank you.

Related Objects

Event Timeline

GoranSMilovanovic created this task.Mar 14 2018, 9:32 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 14 2018, 9:32 AM
Aklapper added projects: WMDE-Analytics-Engineering, Analytics-Data-Quality, Analytics.Mar 14 2018, 9:58 AM
Aklapper removed subscribers: WMDE-Analytics-Engineering, Analytics-Data-Quality, Analytics.
Ottomata added a project: Analytics-Kanban.Mar 15 2018, 4:30 PM
Ottomata moved this task from Incoming to Smart Tools for Better Data on the Analytics board.
GoranSMilovanovic mentioned this in T184109: WDCM: Wikidata Usage Biases.Mar 21 2018, 1:09 AM
Milimetric claimed this task.Mar 22 2018, 4:22 PM
Milimetric moved this task from Next Up to In Progress on the Analytics-Kanban board.
Milimetric added a comment.Mar 22 2018, 4:32 PM

+1 from me, @GoranSMilovanovic, this doesn't involve any user or aggregate user data, it's just content statistics. It's always safe to publish data that's 100% based on publicly-available information, and is usually a service to the community. In this case, some of these findings are very interesting!

Milimetric moved this task from In Progress to Done on the Analytics-Kanban board.Mar 22 2018, 4:32 PM
• Nuria closed this task as Resolved.Mar 27 2018, 3:02 PM
Addshore moved this task from Incoming to Done on the WMDE-Analytics-Engineering board.May 8 2018, 1:26 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL