Page MenuHomePhabricator
Create Task
Maniphest T152615

Collect stats about the usage of Quantity values on Wikidata
Closed, ResolvedPublic
Actions

Description

For each property with data type quantity, produce:

  • number of values (at least main snak, maybe qualifier + reference)
  • number of values with +/-0 bounds (upper bound == lower bound)
  • number of values with no unit (unit is "1" or http://www.wikidata.org/entity/Q199)
  • bonus: number of values with no decimal point (i.e. whole numbers)

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
New build (with 2 changes)analytics/wmde/toolkit-analyzer-buildproduction+0 -0
New build (with 2 changes)analytics/wmde/toolkit-analyzer-buildmaster+0 -0
Count per property for the 3 groups (ExactValueQuantityP..)analytics/wmde/toolkit-analyzermaster+6 -2
In quantities units of "1" are converted to ""analytics/wmde/toolkit-analyzer-buildproduction+0 -0
In quantities units of "1" are converted to ""analytics/wmde/toolkit-analyzer-buildmaster+0 -0
In quantities units of "1" are converted to ""analytics/wmde/toolkit-analyzermaster+6 -2
Customize query in gerrit

Related Objects

Event Timeline

daniel created this task.Dec 7 2016, 5:08 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 7 2016, 5:08 PM
daniel triaged this task as High priority.Dec 7 2016, 5:08 PM
daniel added a project: User-Daniel.Dec 7 2016, 5:12 PM
Addshore added projects: WMDE-TechWish, User-Addshore.Dec 8 2016, 11:52 AM
Addshore moved this task from Unsorted 💣 to Back Burner 🏛️ on the User-Addshore board.
Addshore moved this task from Proposed to Sprint ready on the WMDE-TechWish board.Dec 9 2016, 12:03 PM
gerritbot subscribed.Dec 9 2016, 12:21 PM

Change 326104 had a related patch set uploaded (by Addshore):
In quantities units of "1" are converted to ""

https://gerrit.wikimedia.org/r/326104

gerritbot added a project: Patch-For-Review.Dec 9 2016, 12:21 PM
Addshore mentioned this in rADTA5530f97c37ee: In quantities units of "1" are converted to "".Dec 9 2016, 12:21 PM
gerritbot added a comment.Dec 9 2016, 12:22 PM

Change 326105 had a related patch set uploaded (by Addshore):
In quantities units of "1" are converted to ""

https://gerrit.wikimedia.org/r/326105

gerritbot added a comment.Dec 9 2016, 12:23 PM

Change 326104 merged by Addshore:
In quantities units of "1" are converted to ""

https://gerrit.wikimedia.org/r/326104

gerritbot added a comment.Dec 9 2016, 12:23 PM

Change 326105 merged by Addshore:
In quantities units of "1" are converted to ""

https://gerrit.wikimedia.org/r/326105

Addshore added a comment.Dec 9 2016, 12:25 PM

After fixing the bug you mentioned in the email the script is now running again.

Addshore mentioned this in rADTB2d79ca1dea1c: In quantities units of "1" are converted to "".Dec 9 2016, 12:26 PM
Addshore moved this task from Back Burner 🏛️ to Closing ✔️ on the User-Addshore board.Dec 10 2016, 9:24 PM

The new data can be found at P4606

Addshore closed this task as Resolved.Dec 10 2016, 9:25 PM
Addshore moved this task from Sprint ready to Done on the WMDE-TechWish board.
daniel reopened this task as Open.Dec 12 2016, 2:45 PM

Re-opening, since the data doesn't have the counters per property.

Addshore moved this task from Closing ✔️ to Back Burner 🏛️ on the User-Addshore board.Dec 12 2016, 5:17 PM
Addshore moved this task from Done to Sprint ready on the WMDE-TechWish board.
gerritbot added a comment.Dec 12 2016, 6:07 PM

Change 326481 had a related patch set uploaded (by Addshore):
Count per property for the 3 groups (ExactValueQuantityP..)

https://gerrit.wikimedia.org/r/326481

gerritbot added a comment.Dec 12 2016, 6:09 PM

Change 326482 had a related patch set uploaded (by Addshore):
New build

https://gerrit.wikimedia.org/r/326482

Addshore mentioned this in rADTA3836f0942d00: Count per property for the 3 groups (ExactValueQuantityP..).Dec 12 2016, 6:09 PM
Addshore mentioned this in rADTBcd668c0780bf: New build.
Addshore mentioned this in rADTBb36133af888f: New build.Dec 12 2016, 6:17 PM
gerritbot added a comment.Dec 12 2016, 6:20 PM

Change 326486 had a related patch set uploaded (by Addshore):
In quantities units of "1" are converted to ""

https://gerrit.wikimedia.org/r/326486

gerritbot added a comment.Dec 12 2016, 6:20 PM

Change 326486 merged by Addshore:
In quantities units of "1" are converted to ""

https://gerrit.wikimedia.org/r/326486

Addshore mentioned this in rADTB4e5160263586: In quantities units of "1" are converted to "".Dec 12 2016, 6:20 PM
Addshore mentioned this in rADTB848d82b075fd: New build (with 2 changes).Dec 12 2016, 6:23 PM
gerritbot added a comment.Dec 12 2016, 6:25 PM

Change 326487 had a related patch set uploaded (by Addshore):
New build (with 2 changes)

https://gerrit.wikimedia.org/r/326487

gerritbot added a comment.Dec 12 2016, 6:25 PM

Change 326481 merged by Addshore:
Count per property for the 3 groups (ExactValueQuantityP..)

https://gerrit.wikimedia.org/r/326481

Addshore mentioned this in rADTB5fd34ebd7869: New build (with 2 changes).Dec 12 2016, 6:26 PM
Addshore mentioned this in rADTB8ae9af141c75: New build (with 2 changes).
gerritbot added a comment.Dec 12 2016, 6:26 PM

Change 326482 merged by Addshore:
New build (with 2 changes)

https://gerrit.wikimedia.org/r/326482

gerritbot added a comment.Dec 12 2016, 6:26 PM

Change 326487 merged by Addshore:
New build (with 2 changes)

https://gerrit.wikimedia.org/r/326487

Addshore added a comment.Dec 12 2016, 6:29 PM

Script running again for corrected output

Addshore added a comment.EditedDec 12 2016, 8:06 PM

New paste can be found at P4610
New data can be found with keys such as propertyCounters.noUnit.PXXX

Addshore closed this task as Resolved.Dec 12 2016, 8:07 PM
Addshore moved this task from Sprint ready to Done on the WMDE-TechWish board.
Addshore moved this task from Back Burner 🏛️ to Closing ✔️ on the User-Addshore board.
daniel added a comment.Dec 12 2016, 11:07 PM

Thank you!

Addshore moved this task from Done to Demoed on the WMDE-TechWish board.Dec 13 2016, 1:10 PM
Esc3300 subscribed.EditedDec 13 2016, 1:58 PM

Nice. It posted the top 10 at Project_chat#Stats_on_quantities

daniel added a comment.EditedDec 13 2016, 7:47 PM

Anyone up to turning this into CSV?

Esc3300 added a comment.Dec 13 2016, 10:24 PM

Maybe from this .

daniel added a comment.Dec 13 2016, 11:30 PM

@Esc330 oh wow, thank you!

• Glorian_Yapinus added a comment.Dec 19 2016, 5:30 PM

I have combined the table formatted by @Esc3300 and the one that I have created on https://www.wikidata.org/wiki/User:Glorian_Yapinus_(WMDE)/quantity_change_properties (thanks @Addshore for generating the raw data and @Esc3300 for formatting the table!)

It is still not sortable though. I will work on it again later. In the meantime, you can find the raw CSV file on https://phabricator.wikimedia.org/P4649

• Glorian_Yapinus added a comment.Dec 20 2016, 10:21 AM

Update:
The table in https://www.wikidata.org/wiki/User:Glorian_Yapinus_(WMDE)/quantity_change_properties is now sortable.

• Glorian_Yapinus added a subscriber: Ladsgroup.Dec 20 2016, 10:22 AM
Tobi_WMDE_SW removed a project: WMDE-TechWish.Jun 7 2017, 12:01 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits