Page MenuHomePhabricator
Create Task
Maniphest T239127

Import slots/slots_roles and wikibase.wbc_entity_usage through scoop
Closed, ResolvedPublic
Actions

Description

https://www.mediawiki.org/wiki/Wikibase/Schema/wbc_entity_usage

https://www.mediawiki.org/wiki/Manual:Slot

https://www.mediawiki.org/wiki/Manual:Slot_roles_table/en

Details

SubjectRepoBranchLines +/-
Fix sqoop after new tables addedanalytics/refinerymaster+7 -3
Add newly sqooped tables to hive and mw-load jobanalytics/refinerymaster+482 -0
Add new tables and features to sqoop scriptanalytics/refinerymaster+180 -13
Customize query in gerrit

Related Objects
Search...

Event Timeline

• Nuria created this task.Nov 25 2019, 5:16 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 25 2019, 5:16 PM
• Nuria assigned this task to JAllemandou.Nov 26 2019, 6:05 PM
• Nuria renamed this task from Import slots table through scoop to Import slots/slots_roles and wikibase.wbc_entity_usage through scoop .Nov 26 2019, 6:09 PM
• Nuria added a project: Analytics-Kanban.
• Nuria updated the task description. (Show Details)
gerritbot added a comment.Nov 26 2019, 6:57 PM

Change 553160 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery@master] [WIP] Add slot, slot_roles and wbc_entity_usage to sqoop

https://gerrit.wikimedia.org/r/553160

gerritbot added a project: Patch-For-Review.Nov 26 2019, 6:58 PM
Addshore subscribed.Nov 26 2019, 9:12 PM
JAllemandou moved this task from Next Up to In Code Review on the Analytics-Kanban board.Nov 27 2019, 5:00 PM
gerritbot added a comment.Nov 27 2019, 8:07 PM

Change 553405 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery@master] Add newly sqooped tables to hive and mw-load job

https://gerrit.wikimedia.org/r/553405

• Nuria added a parent task: T238878: Data about how many file pages on Commons contain at least one structured data element .Nov 27 2019, 8:13 PM
JAllemandou moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Nov 28 2019, 5:49 PM
gerritbot added a comment.Dec 2 2019, 8:59 AM

Change 553160 merged by Joal:
[analytics/refinery@master] Add new tables and features to sqoop script

https://gerrit.wikimedia.org/r/553160

gerritbot added a comment.Dec 2 2019, 9:03 AM

Change 553405 merged by Joal:
[analytics/refinery@master] Add newly sqooped tables to hive and mw-load job

https://gerrit.wikimedia.org/r/553405

Maintenance_bot removed a project: Patch-For-Review.Dec 2 2019, 9:10 AM
JAllemandou moved this task from Ready to Deploy to Done on the Analytics-Kanban board.Dec 3 2019, 2:53 PM
gerritbot added a comment.Dec 5 2019, 7:59 AM

Change 554255 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery@master] Fix sqoop after new tables added

https://gerrit.wikimedia.org/r/554255

gerritbot added a project: Patch-For-Review.Dec 5 2019, 7:59 AM

Change 554255 merged by Joal:
[analytics/refinery@master] Fix sqoop after new tables added

https://gerrit.wikimedia.org/r/554255

JAllemandou moved this task from Done to In Code Review on the Analytics-Kanban board.Dec 5 2019, 8:01 AM
Maintenance_bot removed a project: Patch-For-Review.Dec 5 2019, 8:10 AM
mforns moved this task from Incoming to Smart Tools for Better Data on the Analytics board.Dec 5 2019, 6:17 PM
Milimetric moved this task from In Code Review to Done on the Analytics-Kanban board.Dec 5 2019, 6:17 PM
mforns closed this task as Resolved.Dec 5 2019, 6:17 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL