Page MenuHomePhabricator

Mathew.onipe (onimisionipe)
User

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Aug 22 2018, 7:21 AM (42 w, 5 d)
Availability
Available
LDAP User
Mathew.onipe
MediaWiki User
Unknown

Recent Activity

Yesterday

Mathew.onipe moved T224073: Create Icinga plugin to check number of eligible masters from in progress to Needs review on the Discovery-Search (Current work) board.
Sun, Jun 16, 8:11 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Icinga, Elasticsearch

Fri, Jun 14

Mathew.onipe renamed T224073: Create Icinga plugin to check number of eligible masters from Create Icinga check that alerts whenever elasticsearch master is down to Create Icinga plugin to check number of eligible masters.
Fri, Jun 14, 5:22 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Icinga, Elasticsearch

Thu, Jun 13

Mathew.onipe triaged T225694: Create cookbook to do `nodetool repair` across cassandra cluster as Normal priority.
Thu, Jun 13, 7:11 AM · Patch-For-Review, Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe created T225694: Create cookbook to do `nodetool repair` across cassandra cluster.
Thu, Jun 13, 7:11 AM · Patch-For-Review, Operations-Software-Development, User-jijiki, User-Joe, Operations

Wed, Jun 12

Mathew.onipe edited projects for T219507: Create cookbook to reindex into elasticsearch / cirrus, added: Discovery-Search (Current work); removed Discovery-Search.
Wed, Jun 12, 8:48 AM · Discovery-Search (Current work), Operations
Mathew.onipe edited projects for T224073: Create Icinga plugin to check number of eligible masters, added: Discovery-Search (Current work); removed Discovery-Search.
Wed, Jun 12, 8:47 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Icinga, Elasticsearch

Tue, Jun 11

Mathew.onipe moved T221832: Create Cookbook to restart WDQS from Waiting/Blocked to Done on the Discovery-Search (Current work) board.
Tue, Jun 11, 5:18 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service

Sun, Jun 9

Mathew.onipe closed T224829: WDQS internal servers started lagging behind as Invalid.
Sun, Jun 9, 12:06 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service

Tue, Jun 4

Mathew.onipe moved T214494: Alerts for mjolnir daemons from Needs review to in progress on the Discovery-Search (Current work) board.
Tue, Jun 4, 5:17 PM · Icinga, Discovery-Search (Current work)
Mathew.onipe triaged T224967: Find a better partitioning scheme for maps as High priority.
Tue, Jun 4, 8:56 AM · Operations, Maps
Mathew.onipe updated the task description for T224967: Find a better partitioning scheme for maps.
Tue, Jun 4, 8:55 AM · Operations, Maps
Mathew.onipe created T224967: Find a better partitioning scheme for maps.
Tue, Jun 4, 8:55 AM · Operations, Maps

Mon, Jun 3

Mathew.onipe added a comment to T224874: Maps2004 ran into disk space issues again after reimaging with new partitioning scheme.

Looking deep into maps2004 postgres database, the problem was traced to gis.planet_osm_line table being larger than normal when compared with its eqiad(maps1004) version.
We are still investigating why this is so.

Mon, Jun 3, 12:48 PM · Operations, Maps
Mathew.onipe triaged T224874: Maps2004 ran into disk space issues again after reimaging with new partitioning scheme as High priority.
Mon, Jun 3, 11:49 AM · Operations, Maps
Mathew.onipe created T224874: Maps2004 ran into disk space issues again after reimaging with new partitioning scheme.
Mon, Jun 3, 11:41 AM · Operations, Maps

Sun, Jun 2

Mathew.onipe added a project to T224829: WDQS internal servers started lagging behind: Operations.
Sun, Jun 2, 3:29 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Restricted Application added a project to T224829: WDQS internal servers started lagging behind: Wikidata.
Sun, Jun 2, 3:29 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Mathew.onipe added a comment to T214494: Alerts for mjolnir daemons.

@Dzahn This check alerts if scalar(sum(increase(mjolnir_bulk_action_total{result="failed"}[24h] is greater than 0. That is, we should not have mjolnir failure. Normally the value for warning and critical could 1, but check_prometheus does not allow that which makes sense.

Sun, Jun 2, 2:47 PM · Icinga, Discovery-Search (Current work)

Fri, May 31

Mathew.onipe added a comment to T224395: Maps[12]004 /srv disk space is critical.

On trying to initialize maps2001, It encountered the same disk space issues like maps2004. I hold on now on others. We will have to reimage others (maps200[1-3]) before we can proceed.
So maps2001 is out from codfw cluster but we still have maps2004 and maps200[23].

Fri, May 31, 7:38 AM · Operations, Maps

Tue, May 28

Mathew.onipe claimed T207676: Increase deployment window of wdqs or parallelize scap deployment.
Tue, May 28, 5:26 PM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Mathew.onipe moved T224385: Create WDQS reboot cookbook from in progress to Needs review on the Discovery-Search (Current work) board.
Tue, May 28, 5:22 PM · Patch-For-Review, Discovery-Search (Current work), Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe edited projects for T224385: Create WDQS reboot cookbook, added: Discovery-Search (Current work); removed Discovery-Search.
Tue, May 28, 10:28 AM · Patch-For-Review, Discovery-Search (Current work), Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe moved T218932: Keep elasticsearch crosscluster settings in puppet from Needs review to Done on the Discovery-Search (Current work) board.
Tue, May 28, 10:28 AM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch

Mon, May 27

Mathew.onipe lowered the priority of T224395: Maps[12]004 /srv disk space is critical from Unbreak Now! to High.
Mon, May 27, 5:10 PM · Operations, Maps
Mathew.onipe triaged T224395: Maps[12]004 /srv disk space is critical as Unbreak Now! priority.
Mon, May 27, 6:58 AM · Operations, Maps
Mathew.onipe created T224395: Maps[12]004 /srv disk space is critical.
Mon, May 27, 6:58 AM · Operations, Maps
Mathew.onipe moved T224385: Create WDQS reboot cookbook from needs triage to Ops / SRE on the Discovery-Search board.
Mon, May 27, 1:10 AM · Patch-For-Review, Discovery-Search (Current work), Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe triaged T224385: Create WDQS reboot cookbook as Normal priority.
Mon, May 27, 1:09 AM · Patch-For-Review, Discovery-Search (Current work), Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe created T224385: Create WDQS reboot cookbook.
Mon, May 27, 1:09 AM · Patch-For-Review, Discovery-Search (Current work), Operations-Software-Development, User-jijiki, User-Joe, Operations

Thu, May 23

Mathew.onipe moved T221832: Create Cookbook to restart WDQS from Needs review to Waiting/Blocked on the Discovery-Search (Current work) board.
Thu, May 23, 4:52 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Mathew.onipe moved T221832: Create Cookbook to restart WDQS from in progress to Needs review on the Discovery-Search (Current work) board.
Thu, May 23, 4:52 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Mathew.onipe closed T224074: Cleanup puppet hieradata for logstash as Resolved.
Thu, May 23, 4:51 PM · Discovery-Search (Current work), Operations

Wed, May 22

Mathew.onipe renamed T224072: Create cookbook to reboot Maps from Create cookbook to restart Maps to Create cookbook to reboot Maps.
Wed, May 22, 6:43 AM · Patch-For-Review, Maps, Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe triaged T224074: Cleanup puppet hieradata for logstash as Normal priority.
Wed, May 22, 2:29 AM · Discovery-Search (Current work), Operations
Mathew.onipe created T224074: Cleanup puppet hieradata for logstash.
Wed, May 22, 2:28 AM · Discovery-Search (Current work), Operations
Mathew.onipe moved T224073: Create Icinga plugin to check number of eligible masters from needs triage to Ops / SRE on the Discovery-Search board.
Wed, May 22, 2:28 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Icinga, Elasticsearch
Mathew.onipe triaged T224073: Create Icinga plugin to check number of eligible masters as Normal priority.
Wed, May 22, 2:15 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Icinga, Elasticsearch
Mathew.onipe created T224073: Create Icinga plugin to check number of eligible masters.
Wed, May 22, 2:15 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Icinga, Elasticsearch
Mathew.onipe triaged T224072: Create cookbook to reboot Maps as Normal priority.
Wed, May 22, 1:59 AM · Patch-For-Review, Maps, Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe created T224072: Create cookbook to reboot Maps.
Wed, May 22, 1:59 AM · Patch-For-Review, Maps, Operations-Software-Development, User-jijiki, User-Joe, Operations

Tue, May 21

Mathew.onipe closed T223734: nginx is failing to restart on cloudelastic100[1-2].wikimedia.org. Will also fail on cloudelastic100[3-4] when restart is attempted. as Resolved.
Tue, May 21, 3:28 AM · Patch-For-Review, Operations, Discovery-Search (Current work), Traffic
Mathew.onipe added a comment to T223734: nginx is failing to restart on cloudelastic100[1-2].wikimedia.org. Will also fail on cloudelastic100[3-4] when restart is attempted..

Things are Ok now. Thanks!

Tue, May 21, 3:28 AM · Patch-For-Review, Operations, Discovery-Search (Current work), Traffic

May 18 2019

Mathew.onipe triaged T223734: nginx is failing to restart on cloudelastic100[1-2].wikimedia.org. Will also fail on cloudelastic100[3-4] when restart is attempted. as High priority.
May 18 2019, 3:47 PM · Patch-For-Review, Operations, Discovery-Search (Current work), Traffic
Mathew.onipe created T223734: nginx is failing to restart on cloudelastic100[1-2].wikimedia.org. Will also fail on cloudelastic100[3-4] when restart is attempted..
May 18 2019, 3:46 PM · Patch-For-Review, Operations, Discovery-Search (Current work), Traffic

May 16 2019

Mathew.onipe added a comment to T223275: Create blubberfile for deploying kartotherian into docker environment..

We can use the main repo instead of using the package repo. It will align better with other docker related project at WMF.

May 16 2019, 4:04 PM · Release Pipeline, Patch-For-Review, Operations, Maps (Kartotherian)

May 14 2019

Mathew.onipe removed a project from T223275: Create blubberfile for deploying kartotherian into docker environment.: Epic.
May 14 2019, 2:01 PM · Release Pipeline, Patch-For-Review, Operations, Maps (Kartotherian)
Mathew.onipe triaged T223275: Create blubberfile for deploying kartotherian into docker environment. as Normal priority.
May 14 2019, 1:35 PM · Release Pipeline, Patch-For-Review, Operations, Maps (Kartotherian)
Mathew.onipe created T223275: Create blubberfile for deploying kartotherian into docker environment..
May 14 2019, 1:35 PM · Release Pipeline, Patch-For-Review, Operations, Maps (Kartotherian)
Mathew.onipe closed T206639: Switch to unix socket connections for osmupdater / osmimporter for postgresql on maps as Resolved.
May 14 2019, 1:33 PM · Patch-For-Review, Operations, Maps
Mathew.onipe closed T215521: Load OSM data into maps2004 as Resolved.
May 14 2019, 1:32 PM · Reading-Infrastructure-Team-Backlog, Patch-For-Review, Maps
Mathew.onipe closed T215521: Load OSM data into maps2004, a subtask of T198622: migrate maps servers to stretch with the current style, as Resolved.
May 14 2019, 1:32 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Operations, Maps
Mathew.onipe closed T217531: Reshard Commons_wiki as Invalid.
May 14 2019, 12:20 PM · Elasticsearch, Operations, Discovery-Search

Apr 30 2019

Mathew.onipe triaged T221832: Create Cookbook to restart WDQS as Normal priority.
Apr 30 2019, 2:22 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Mathew.onipe added a comment to T221832: Create Cookbook to restart WDQS.

@Lucas_Werkmeister_WMDE Thanks! will keep that mind. Your reviews will be welcome when I submit a patch too.

Apr 30 2019, 2:21 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Mathew.onipe moved T221832: Create Cookbook to restart WDQS from needs triage to Ops / SRE on the Discovery-Search board.
Apr 30 2019, 2:20 PM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service

Apr 25 2019

Mathew.onipe added a parent task for T221832: Create Cookbook to restart WDQS: T203943: Spicerack cookbooks TODO list.
Apr 25 2019, 8:47 AM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Mathew.onipe added a subtask for T203943: Spicerack cookbooks TODO list: T221832: Create Cookbook to restart WDQS.
Apr 25 2019, 8:47 AM · Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe added a project to T221832: Create Cookbook to restart WDQS: Operations.
Apr 25 2019, 8:47 AM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Mathew.onipe created T221832: Create Cookbook to restart WDQS.
Apr 25 2019, 8:47 AM · Discovery-Search (Current work), Operations, Wikidata, Wikidata-Query-Service
Mathew.onipe added a parent task for T219507: Create cookbook to reindex into elasticsearch / cirrus: T203943: Spicerack cookbooks TODO list.
Apr 25 2019, 8:43 AM · Discovery-Search (Current work), Operations
Mathew.onipe added a subtask for T203943: Spicerack cookbooks TODO list: T219507: Create cookbook to reindex into elasticsearch / cirrus.
Apr 25 2019, 8:43 AM · Operations-Software-Development, User-jijiki, User-Joe, Operations

Apr 18 2019

Mathew.onipe moved T213401: Create a cookbook to copy data between WDQS servers from in progress to Done on the Discovery-Search (Current work) board.
Apr 18 2019, 8:32 AM · Discovery-Search (Current work), Patch-For-Review, Operations-Software-Development, Wikidata-Query-Service, Operations, Wikidata

Apr 16 2019

Mathew.onipe moved T213401: Create a cookbook to copy data between WDQS servers from Done to in progress on the Discovery-Search (Current work) board.
Apr 16 2019, 5:23 PM · Discovery-Search (Current work), Patch-For-Review, Operations-Software-Development, Wikidata-Query-Service, Operations, Wikidata
Mathew.onipe moved T213401: Create a cookbook to copy data between WDQS servers from Needs review to Done on the Discovery-Search (Current work) board.
Apr 16 2019, 5:23 PM · Discovery-Search (Current work), Patch-For-Review, Operations-Software-Development, Wikidata-Query-Service, Operations, Wikidata
Mathew.onipe closed T221013: prometheus-wmf-elasticsearch-exporter interferes with prometheus-wmf-elasticsearch-exporter-9* unit on elastic nodes as Resolved.
Apr 16 2019, 1:21 PM · Discovery-Search (Current work), Elasticsearch
Mathew.onipe edited projects for T221013: prometheus-wmf-elasticsearch-exporter interferes with prometheus-wmf-elasticsearch-exporter-9* unit on elastic nodes, added: Discovery-Search (Current work); removed Discovery-Search.
Apr 16 2019, 10:59 AM · Discovery-Search (Current work), Elasticsearch
Mathew.onipe added a comment to T221013: prometheus-wmf-elasticsearch-exporter interferes with prometheus-wmf-elasticsearch-exporter-9* unit on elastic nodes.

After investigating, I noticed prometheus-wmf-elasticsearch-exporter was created prior to multi-instance setup. This unit is no longer needed. It is present on some nodes and absent on others. It is probably absent on nodes that were setup after multi-instance. Here are some ways to get rid of it completely:

Apr 16 2019, 10:58 AM · Discovery-Search (Current work), Elasticsearch
Mathew.onipe triaged T221013: prometheus-wmf-elasticsearch-exporter interferes with prometheus-wmf-elasticsearch-exporter-9* unit on elastic nodes as High priority.
Apr 16 2019, 8:41 AM · Discovery-Search (Current work), Elasticsearch
Mathew.onipe triaged T221055: Collect metrics on maps cassandra as Normal priority.
Apr 16 2019, 8:41 AM · Operations, Maps, Cassandra
Mathew.onipe created T221055: Collect metrics on maps cassandra.
Apr 16 2019, 12:37 AM · Operations, Maps, Cassandra

Apr 15 2019

Mathew.onipe created T221013: prometheus-wmf-elasticsearch-exporter interferes with prometheus-wmf-elasticsearch-exporter-9* unit on elastic nodes.
Apr 15 2019, 4:02 PM · Discovery-Search (Current work), Elasticsearch
Mathew.onipe triaged T220946: Create cookbook for postgres initialization on maps cluster as Normal priority.
Apr 15 2019, 8:28 AM · Maps, Operations-Software-Development, User-jijiki, User-Joe, Operations
Mathew.onipe created T220946: Create cookbook for postgres initialization on maps cluster.
Apr 15 2019, 8:28 AM · Maps, Operations-Software-Development, User-jijiki, User-Joe, Operations

Apr 14 2019

Mathew.onipe edited projects for T213401: Create a cookbook to copy data between WDQS servers, added: Discovery-Search (Current work); removed Discovery-Search.
Apr 14 2019, 8:33 AM · Discovery-Search (Current work), Patch-For-Review, Operations-Software-Development, Wikidata-Query-Service, Operations, Wikidata

Apr 12 2019

Mathew.onipe closed T198622: migrate maps servers to stretch with the current style as Resolved.
Apr 12 2019, 10:01 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Operations, Maps
Mathew.onipe closed T198622: migrate maps servers to stretch with the current style, a subtask of T152196: Kartotherian snapshots always return low DPI images, as Resolved.
Apr 12 2019, 10:00 AM · Reading-Infrastructure-Team-Backlog (Kanban), Maps (Kartotherian)
Mathew.onipe added a comment to T198622: migrate maps servers to stretch with the current style.

This task is now complete and the lessons learnt have been documented here: https://wikitech.wikimedia.org/wiki/Maps-migration

Apr 12 2019, 10:00 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Operations, Maps

Apr 10 2019

Mathew.onipe added a comment to T218932: Keep elasticsearch crosscluster settings in puppet.

Keeping these configurations in puppet via elasti config file will not happen now due to many constrains. We will continue as it is now and then create icinga checks to alert when the remote clusters or seeds are not what they are in elastic.

Apr 10 2019, 11:43 AM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch

Apr 9 2019

Mathew.onipe added a comment to T219849: Tilerator crashed on maps200[1-3].codfw.wmnet.

I'm going to depool maps2003 until this is fixed

Apr 9 2019, 3:15 AM · Maps (Tilerator), Operations
Mathew.onipe added a comment to T219849: Tilerator crashed on maps200[1-3].codfw.wmnet.

This took another turn today. Restating tilerator did not work.
syslog showed a permission error:

Apr 9 2019, 3:13 AM · Maps (Tilerator), Operations
Mathew.onipe added a comment to T219849: Tilerator crashed on maps200[1-3].codfw.wmnet.

@MSantos ack

Apr 9 2019, 2:47 AM · Maps (Tilerator), Operations

Apr 6 2019

Mathew.onipe moved T219601: Create checks that alerts on cirrussearch update lags from in progress to Done on the Discovery-Search (Current work) board.
Apr 6 2019, 12:49 PM · Discovery-Search (Current work), Patch-For-Review, Wikimedia-Incident, Operations, CirrusSearch, Elasticsearch
Mathew.onipe moved T214921: Setup elasticsearch on cloudelastic100[1-4] from in progress to Done on the Discovery-Search (Current work) board.
Apr 6 2019, 12:49 PM · cloud-services-team (Kanban), Patch-For-Review, Discovery-Search (Current work), Cloud-VPS, Operations
Mathew.onipe moved T194186: rack/setup/install cloudelastic100[1-4].eqiad.wmnet systems from in progress to Done on the Discovery-Search (Current work) board.
Apr 6 2019, 12:49 PM · cloud-services-team (Kanban), Discovery-Search (Current work), Cloud-VPS, Operations

Apr 2 2019

Mathew.onipe edited projects for T213401: Create a cookbook to copy data between WDQS servers, added: Discovery-Search; removed Discovery-Search (Current work).
Apr 2 2019, 5:21 PM · Discovery-Search (Current work), Patch-For-Review, Operations-Software-Development, Wikidata-Query-Service, Operations, Wikidata
Mathew.onipe created T219849: Tilerator crashed on maps200[1-3].codfw.wmnet.
Apr 2 2019, 4:23 AM · Maps (Tilerator), Operations

Mar 29 2019

Mathew.onipe created T219601: Create checks that alerts on cirrussearch update lags.
Mar 29 2019, 9:51 AM · Discovery-Search (Current work), Patch-For-Review, Wikimedia-Incident, Operations, CirrusSearch, Elasticsearch

Mar 26 2019

Mathew.onipe moved T209812: Review Elastic/maps Grafana dashboards from needs triage to Ops / SRE on the Discovery-Search board.
Mar 26 2019, 5:30 PM · Discovery-Search, Maps, Elasticsearch, Operations
Mathew.onipe moved T216681: Enable nginx prometheus metrics for all elastic nodes from needs triage to Ops / SRE on the Discovery-Search board.
Mar 26 2019, 5:30 PM · Discovery-Search, Traffic, Patch-For-Review, Elasticsearch, Operations
Mathew.onipe edited projects for T216681: Enable nginx prometheus metrics for all elastic nodes, added: Discovery-Search; removed Discovery-Search (Current work).
Mar 26 2019, 5:29 PM · Discovery-Search, Traffic, Patch-For-Review, Elasticsearch, Operations
Mathew.onipe edited projects for T209812: Review Elastic/maps Grafana dashboards, added: Discovery-Search; removed Discovery-Search (Current work).
Mar 26 2019, 5:29 PM · Discovery-Search, Maps, Elasticsearch, Operations
Mathew.onipe moved T213940: Create extra elasticsearch clusters in beta cluster from in progress to Done on the Discovery-Search (Current work) board.
Mar 26 2019, 2:26 PM · Patch-For-Review, Discovery-Search (Current work), Operations, Discovery
Mathew.onipe added a comment to T213940: Create extra elasticsearch clusters in beta cluster.

Beta cluster is running three clusters now. Cluster state is fine for all them.

Mar 26 2019, 11:56 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Discovery
Mathew.onipe moved T214494: Alerts for mjolnir daemons from in progress to Done on the Discovery-Search (Current work) board.
Mar 26 2019, 11:51 AM · Icinga, Discovery-Search (Current work)
Mathew.onipe moved T215439: Convert check_elasticsearch.py icinga plugin to py3 from in progress to Done on the Discovery-Search (Current work) board.
Mar 26 2019, 7:09 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Elasticsearch

Mar 23 2019

Mathew.onipe created T219052: Blazegraph and updater failed on wdqs1009 .
Mar 23 2019, 5:31 AM · Wikidata, Discovery-Search, Operations, Wikidata-Query-Service

Mar 22 2019

Mathew.onipe claimed T218932: Keep elasticsearch crosscluster settings in puppet.
Mar 22 2019, 11:46 AM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch
Mathew.onipe renamed T215439: Convert check_elasticsearch.py icinga plugin to py3 from Convert check_elasticsearch_shards.py icinga plugin to py3 to Convert check_elasticsearch.py icinga plugin to py3.
Mar 22 2019, 2:03 AM · Patch-For-Review, Discovery-Search (Current work), Operations, Elasticsearch
Mathew.onipe closed T105409: Rewrite the elasticsearch rolling-restart scripts in something better than bash as Resolved.

I think this has been done via spicerack/cookbook. There's a rolling restart script: https://phabricator.wikimedia.org/T207919

Mar 22 2019, 12:36 AM · Discovery-Search, Discovery, CirrusSearch

Mar 19 2019

Mathew.onipe claimed T213940: Create extra elasticsearch clusters in beta cluster.
Mar 19 2019, 5:21 PM · Patch-For-Review, Discovery-Search (Current work), Operations, Discovery