Page MenuHomePhabricator
Create Task
Maniphest T146468

wdqs - move metric collections to diamond
Closed, ResolvedPublic
Actions

Description

Some of WDQS metrics are collected through an external PHP script, not integrated with diamond or our usual metric collection tools. The solution works well, except that it is not automatically aware of additional servers in the wdqs cluster. Moving to diamond would allow to integrate better with our puppet infrastructure and automate the configuration of metric collection.

See T146207 for the latest modifications to that PHP script.

Details

SubjectRepoBranchLines +/-
Remove minutely SPARQL scriptanalytics/wmde/scriptsproduction+0 -63
Remove minutely SPARQL script from CRONanalytics/wmde/scriptsproduction+0 -1
WDQS - move metric collection to diamondoperations/puppetproduction+1 -2
WDQS - move metric collection to diamondoperations/puppetproduction+60 -4
Remove minutely SPARQL scriptanalytics/wmde/scriptsmaster+0 -63
Remove minutely SPARQL script from CRONanalytics/wmde/scriptsmaster+0 -1
Customize query in gerrit

Related Objects

Event Timeline

Gehel created this task.Sep 23 2016, 12:05 PM
Restricted Application added a project: Wikidata. · View Herald TranscriptSep 23 2016, 12:05 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Addshore merged a task: T146467: wdqs lag & triple count metrics should be generated from diamond.Sep 23 2016, 12:06 PM
Addshore added projects: User-Addshore, WMDE-Analytics-Engineering.
Addshore moved this task from Incoming to ToDo on the WMDE-Analytics-Engineering board.Sep 23 2016, 1:47 PM
Addshore moved this task from Unsorted 💣 to Next on the User-Addshore board.Sep 26 2016, 9:52 AM
Addshore moved this task from incoming to ready to go on the Wikidata board.Sep 26 2016, 11:07 AM
Smalyshev moved this task from Incoming to Operations/SRE on the Wikidata-Query-Service board.Oct 11 2016, 5:55 PM
elukey triaged this task as Low priority.Oct 18 2016, 12:56 PM
Lydia_Pintscher moved this task from ready to go to blocked on others on the Wikidata board.Dec 16 2016, 9:42 AM
Lydia_Pintscher moved this task from blocked on others to monitoring on the Wikidata board.
gerritbot subscribed.Feb 6 2017, 11:49 AM

Change 336207 had a related patch set uploaded (by Addshore):
Remove minutely SPARQL script

https://gerrit.wikimedia.org/r/336207

gerritbot added a project: Patch-For-Review.Feb 6 2017, 11:49 AM

Change 336206 had a related patch set uploaded (by Addshore):
Remove minutely SPARQL script from CRON

https://gerrit.wikimedia.org/r/336206

gerritbot added a comment.Feb 6 2017, 11:49 AM

Change 336208 had a related patch set uploaded (by Addshore):
Remove minutely SPARQL script from CRON

https://gerrit.wikimedia.org/r/336208

gerritbot added a comment.Feb 6 2017, 11:49 AM

Change 336209 had a related patch set uploaded (by Addshore):
Remove minutely SPARQL script

https://gerrit.wikimedia.org/r/336209

Addshore moved this task from ToDo to Doing on the WMDE-Analytics-Engineering board.Feb 6 2017, 11:51 AM
Addshore moved this task from Next to Back Burner 🏛️ on the User-Addshore board.
Addshore mentioned this in rADES650f83d5cd84: Remove minutely SPARQL script from CRON.Feb 6 2017, 11:52 AM
Addshore mentioned this in rADES2da92ec26374: Remove minutely SPARQL script.
Addshore mentioned this in rADES47601fa0b9cb: Remove minutely SPARQL script.
Addshore mentioned this in rADESdcf7bedcdc01: Remove minutely SPARQL script from CRON.
Addshore mentioned this in rADES383e1de1e496: Remove minutely SPARQL script.
Addshore mentioned this in rADES76c9ce87331b: Remove minutely SPARQL script.
gerritbot added a comment.Feb 6 2017, 11:59 AM

Change 336206 merged by jenkins-bot:
Remove minutely SPARQL script from CRON

https://gerrit.wikimedia.org/r/336206

gerritbot added a comment.Feb 6 2017, 11:59 AM

Change 336207 merged by jenkins-bot:
Remove minutely SPARQL script

https://gerrit.wikimedia.org/r/336207

gerritbot added a comment.Feb 6 2017, 2:11 PM

Change 336220 had a related patch set uploaded (by Gehel):
WDQS - move metric collection to diamond

https://gerrit.wikimedia.org/r/336220

gerritbot added a comment.Feb 13 2017, 3:01 PM

Change 335646 merged by Gehel:
WDQS - move metric collection to diamond

https://gerrit.wikimedia.org/r/335646

gerritbot added a comment.Feb 13 2017, 4:33 PM

Change 336220 merged by Gehel:
WDQS - move metric collection to diamond

https://gerrit.wikimedia.org/r/336220

gerritbot added a comment.Feb 14 2017, 10:02 AM

Change 336208 merged by jenkins-bot:
Remove minutely SPARQL script from CRON

https://gerrit.wikimedia.org/r/336208

gerritbot added a comment.Feb 14 2017, 10:02 AM

Change 336209 merged by jenkins-bot:
Remove minutely SPARQL script

https://gerrit.wikimedia.org/r/336209

Addshore moved this task from Back Burner 🏛️ to Closing ✔️ on the User-Addshore board.Feb 14 2017, 2:32 PM
Addshore closed this task as Resolved.Feb 21 2017, 9:57 AM
Addshore claimed this task.
Addshore moved this task from Doing to Done on the WMDE-Analytics-Engineering board.Mar 20 2017, 11:59 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits