Page MenuHomePhabricator
Create Task
Maniphest T159248

collect usual GC metrics for Blazegraph JVMs
Closed, ResolvedPublic
Actions

Description

We only collect free / max / total memory on Blazegraph. It might make sense to also collect the GC time / count and the usual heap / non heap memory metrics (see elasticsearch for an example). Activating GC logs would help as well.

Details

SubjectRepoBranchLines +/-
wdqs: cleanup old GC logsoperations/puppetproduction+10 -0
wdqs: activate GC logswikidata/query/rdfmaster+23 -2
Customize query in gerrit

Related Objects

Event Timeline

Gehel created this task.Feb 28 2017, 5:21 PM
Restricted Application added projects: Wikidata, Discovery-ARCHIVED. · View Herald TranscriptFeb 28 2017, 5:21 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Gehel triaged this task as High priority.Feb 28 2017, 5:22 PM
Smalyshev subscribed.Feb 28 2017, 6:06 PM

Where can I see the ES example?

Gehel added a comment.Mar 1 2017, 6:10 PM

Elasticsearch configuration is done through puppet (https://github.com/wikimedia/puppet/blob/production/modules/elasticsearch/manifests/init.pp#L132-L141)

debt edited projects, added Discovery-Search (Current work); removed Discovery-Search.Mar 2 2017, 11:08 PM
debt mentioned this in T158874: wdqs replication lagging behind on some nodes.
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint.Mar 2 2017, 11:29 PM
Smalyshev moved this task from Incoming to Current work on the Wikidata-Query-Service board.
Smalyshev moved this task from Backlog to In progress on the Discovery-Wikidata-Query-Service-Sprint board.Mar 4 2017, 1:06 AM
gerritbot subscribed.Mar 6 2017, 7:11 PM

Change 340938 merged by jenkins-bot:
[wikidata/query/rdf] wdqs: activate GC logs

https://gerrit.wikimedia.org/r/340938

Smalyshev moved this task from In progress to Done on the Discovery-Wikidata-Query-Service-Sprint board.Mar 6 2017, 7:21 PM
Stashbot subscribed.Mar 6 2017, 7:52 PM

Mentioned in SAL (#wikimedia-operations) [2017-03-06T19:52:42Z] <gehel> restarting wdqs-updater on wdqs* servers to activate GC logs - T159248

Smalyshev closed this task as Resolved.Mar 6 2017, 8:42 PM
gerritbot added a comment.Mar 7 2017, 11:39 AM

Change 340940 merged by Gehel:
[operations/puppet] wdqs: cleanup old GC logs

https://gerrit.wikimedia.org/r/340940

Smalyshev removed a project: Discovery-Wikidata-Query-Service-Sprint.Jul 14 2017, 10:31 PM
EBernhardson moved this task from Incoming to Needs Reporting on the Discovery-Search (Current work) board.May 6 2019, 4:03 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits