Page MenuHomePhabricator
Create Task
Maniphest T215290

update mw scooping to be able to scoop from new db cluster
Closed, ResolvedPublic
Actions

Description

update mw scooping to be able to scoop from new db cluster

Different wikis will be in different shards so we need probably a module that gives the right connection info if you pass the wiki

Details

SubjectRepoBranchLines +/-
Find db host and port using refineryoperations/puppetproduction+3 -8
Use db_mapping to find the hostnameanalytics/refinerymaster+85 -79
Update sqoop timers templates to follow new CLIoperations/puppetproduction+0 -3
Customize query in gerrit

Related Objects
Search...

Event Timeline

• Nuria created this task.Feb 5 2019, 4:27 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 5 2019, 4:27 PM
• Nuria added a comment.Feb 5 2019, 5:07 PM

See: https://phabricator.wikimedia.org/T212386 for snipet to determine the correct shard.

Milimetric added a comment.Feb 5 2019, 9:46 PM

you mean T212386#4905949 right? Elukey I'm going to wait until you have that in code review, just in case you have other thoughts as you make it more official.

• fdans triaged this task as High priority.Feb 7 2019, 6:13 PM
• fdans moved this task from Incoming to Operational Excellence on the Analytics board.
• fdans added a project: Analytics-Kanban.
JAllemandou merged a task: T215549: Update sqoop base script for new analytics-db infra.Feb 7 2019, 8:52 PM
JAllemandou subscribed.
elukey added a parent task: T215589: Migrate users to dbstore100[3-5].Feb 8 2019, 8:41 AM
Milimetric moved this task from Next Up to In Progress on the Analytics-Kanban board.Feb 21 2019, 10:51 PM
gerritbot subscribed.Feb 21 2019, 10:53 PM

Change 492209 had a related patch set uploaded (by Milimetric; owner: Milimetric):
[analytics/refinery@master] Use db_mapping to find the hostname

https://gerrit.wikimedia.org/r/492209

gerritbot added a project: Patch-For-Review.Feb 21 2019, 10:53 PM
Milimetric moved this task from In Progress to In Code Review on the Analytics-Kanban board.Feb 22 2019, 9:31 PM
gerritbot added a comment.Feb 27 2019, 10:26 PM

Change 493331 had a related patch set uploaded (by Milimetric; owner: Milimetric):
[operations/puppet@production] Find db host and port using refinery

https://gerrit.wikimedia.org/r/493331

gerritbot added a comment.Feb 28 2019, 1:32 PM

Change 493406 had a related patch set uploaded (by Joal; owner: Joal):
[operations/puppet@production] Update sqoop timers templates to follow new CLI

https://gerrit.wikimedia.org/r/493406

gerritbot added a comment.Feb 28 2019, 1:55 PM

Change 493406 abandoned by Joal:
Update sqoop timers templates to follow new CLI

Reason:
Already done in https://gerrit.wikimedia.org/r/c/operations/puppet/ /493331/

https://gerrit.wikimedia.org/r/493406

gerritbot added a comment.Feb 28 2019, 2:05 PM

Change 492209 merged by Joal:
[analytics/refinery@master] Use db_mapping to find the hostname

https://gerrit.wikimedia.org/r/492209

gerritbot added a comment.Feb 28 2019, 2:46 PM

Change 493331 merged by Elukey:
[operations/puppet@production] Find db host and port using refinery

https://gerrit.wikimedia.org/r/493331

JAllemandou moved this task from In Code Review to Done on the Analytics-Kanban board.Feb 28 2019, 3:19 PM
• Nuria closed this task as Resolved.Mar 11 2019, 6:14 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits