Page MenuHomePhabricator
Create Task
Maniphest T119777

Track number of referenced and unreferenced statements in wikidata
Closed, ResolvedPublic
Actions

Details

SubjectRepoBranchLines +/-
Add script to count refs by typeanalytics/limn-wikidata-datamaster+87 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

Addshore created this task.Nov 27 2015, 9:01 PM
Addshore raised the priority of this task from to Needs Triage.
Addshore updated the task description. (Show Details)
Addshore added projects: Wikidata, WMDE-Analytics-Engineering.
Addshore subscribed.
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptNov 27 2015, 9:01 PM
Addshore renamed this task from Track number of references in wikidata to Track number of referenced and unreferenced statements in wikidata.Nov 27 2015, 9:16 PM
Addshore set Security to None.
Addshore triaged this task as Medium priority.Nov 27 2015, 9:22 PM
Addshore moved this task from Incoming to Doing on the WMDE-Analytics-Engineering board.Nov 30 2015, 11:26 AM
gerritbot subscribed.Nov 30 2015, 1:52 PM

Change 255991 had a related patch set uploaded (by Addshore):
Add script to count refs by type

https://gerrit.wikimedia.org/r/255991

gerritbot added a project: Patch-For-Review.Nov 30 2015, 1:52 PM
Addshore moved this task from Doing to Done on the WMDE-Analytics-Engineering board.Nov 30 2015, 1:52 PM
gerritbot added a comment.Nov 30 2015, 2:16 PM

Change 255991 merged by Addshore:
Add script to count refs by type

https://gerrit.wikimedia.org/r/255991

Addshore claimed this task.Nov 30 2015, 9:11 PM
Addshore moved this task from Done to Doing on the WMDE-Analytics-Engineering board.
Addshore added a subtask: T119941: Enable longer WDQS queries from inside the cluster.Dec 1 2015, 9:38 AM
Addshore added a parent task: T119182: Track Wikidata data completeness .
Addshore closed subtask T119941: Enable longer WDQS queries from inside the cluster as Resolved.Dec 1 2015, 7:34 PM
Addshore added a subtask: T120010: Add firewall exception to get to wdqs*:8888 from analytics cluster.Dec 1 2015, 7:38 PM
Addshore moved this task from Doing to Done on the WMDE-Analytics-Engineering board.Dec 2 2015, 10:46 AM
This comment was removed by Addshore.
Addshore closed this task as Resolved.Dec 2 2015, 11:06 AM
This comment was removed by Addshore.
Addshore reopened this task as Open.Dec 3 2015, 11:03 AM

This is totally the wrong task for the above comments.
This is not done!

Addshore moved this task from Done to Doing on the WMDE-Analytics-Engineering board.Dec 3 2015, 11:04 AM
Lydia_Pintscher moved this task from incoming to ready to go on the Wikidata board.Dec 3 2015, 3:40 PM
akosiaris closed subtask T120010: Add firewall exception to get to wdqs*:8888 from analytics cluster as Resolved.Dec 8 2015, 10:56 AM
Addshore added a comment.Dec 8 2015, 3:35 PM

So, after much messing around with SPARQL and looking at our SQL schema it looks like the only logical way of doing this is to use the dumps :/
So I will look into this over the next days.

Addshore moved this task from Doing to ToDo on the WMDE-Analytics-Engineering board.Dec 8 2015, 3:35 PM
Addshore moved this task from ToDo to Done on the WMDE-Analytics-Engineering board.Dec 15 2015, 2:33 PM
Addshore closed this task as Resolved.Dec 15 2015, 3:03 PM

https://grafana.wikimedia.org/dashboard/db/wikidata-datamodel-references

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL