Page MenuHomePhabricator
Create Task
Maniphest T322776

Deploy Ukrainian Analyzer Plugin
Closed, ResolvedPublic3 Estimated Story Points
Actions

Description

Now that the Ukrainian analysis plugin has been added to the extra plugin project, we should deploy the the new extra-analysis-ukrainian plugin following the Plugin Upload Process (P19522).

We also need to update the Cirrus Docker image, too.

(Later, once T318264 and this ticket are both complete, we need to re-index Ukrainian-language wikis.)

Acceptance Criteria:

  • extra-analysis-ukrainian plugin is deployed and available in production
  • the Cirrus Docker image is updated to include extra-analysis-ukrainian (or open a new ticket)

Details

SubjectRepoBranchLines +/-
Add extra-analysis-ukrainian and bump extra plugins to 7.10.2-wmf4operations/software/elasticsearch/pluginsmaster+33 -17
Customize query in gerrit

Related Objects
Search...

Event Timeline

TJones created this task.Nov 9 2022, 6:14 PM
Restricted Application added subscribers: Base, Aklapper. · View Herald TranscriptNov 9 2022, 6:14 PM
TJones added a project: Discovery-Search.Nov 9 2022, 6:14 PM
MPhamWMF moved this task from needs triage to Current work on the Discovery-Search board.Nov 14 2022, 4:24 PM
MPhamWMF edited projects, added Discovery-Search (Current work); removed Discovery-Search.
MPhamWMF set the point value for this task to 3.Nov 14 2022, 4:42 PM
MPhamWMF moved this task from Incoming to Ready for Dev -- SWE on the Discovery-Search (Current work) board.
gerritbot added a comment.Nov 21 2022, 2:46 PM

Change 859064 had a related patch set uploaded (by DCausse; author: DCausse):

[operations/software/elasticsearch/plugins@master] Add extra-analysis-ukrainian and bump extra plugins to 7.10.2-wmf4

https://gerrit.wikimedia.org/r/859064

gerritbot added a project: Patch-For-Review.Nov 21 2022, 2:46 PM
dcausse moved this task from Ready for Dev -- SWE to Ready for Dev -- SRE/Ops on the Discovery-Search (Current work) board.Nov 21 2022, 2:48 PM
dcausse subscribed.

Moving to SRE/Ops for the remaining work:

  • build the package
  • upload the package to apt
  • restart the whole fleet with the new package installed
TJones mentioned this in T323927: Reindex Ukrainian-language wikis to enable unpacked analysis.Nov 28 2022, 4:32 PM
gerritbot added a comment.Dec 8 2022, 7:40 PM

Change 859064 merged by Bking:

[operations/software/elasticsearch/plugins@master] Add extra-analysis-ukrainian and bump extra plugins to 7.10.2-wmf4

https://gerrit.wikimedia.org/r/859064

RKemper subscribed.Dec 8 2022, 7:55 PM

Plugin build/upload is complete and visible here: https://apt.wikimedia.org/wikimedia/dists/bullseye-wikimedia/thirdparty/elastic710/

RKemper updated the task description. (Show Details)Dec 8 2022, 7:57 PM
Stashbot added a comment.Dec 8 2022, 7:59 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T19:59:12Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 8 2022, 7:59 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T19:59:53Z] <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 8 2022, 8:09 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T20:09:13Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 8 2022, 8:21 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T20:21:42Z] <ryankemper@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on 6 hosts with reason: Plugin upgrade for T322776

Stashbot added a comment.Dec 8 2022, 8:21 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T20:21:58Z] <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on 6 hosts with reason: Plugin upgrade for T322776

Stashbot added a comment.Dec 8 2022, 8:22 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T20:22:11Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Maintenance_bot removed a project: Patch-For-Review.Dec 8 2022, 8:30 PM
Stashbot added a comment.Dec 8 2022, 8:31 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T20:31:02Z] <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 8 2022, 8:35 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T20:35:18Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 8 2022, 9:15 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T21:15:05Z] <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 8 2022, 9:23 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T21:23:07Z] <ryankemper@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 8 2022, 9:23 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T21:23:59Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 8 2022, 10:29 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-08T22:29:55Z] <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 9 2022, 3:51 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-09T03:51:39Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: search_eqiad elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 9 2022, 4:09 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-09T04:09:00Z] <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: search_eqiad elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 9 2022, 5:03 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-09T05:03:21Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: search_eqiad elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 9 2022, 5:10 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-09T05:10:51Z] <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: search_eqiad elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 9 2022, 5:13 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-09T05:13:33Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: search_eqiad elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 9 2022, 5:28 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-09T05:28:29Z] <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: search_eqiad elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 9 2022, 11:39 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-09T23:39:16Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: search_eqiad elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 10 2022, 1:21 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-10T01:21:22Z] <ryankemper@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: search_eqiad elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 10 2022, 2:00 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-10T02:00:23Z] <ryankemper@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on 49 hosts with reason: Plugin upgrade for T322776

Stashbot added a comment.Dec 10 2022, 2:00 AM

Mentioned in SAL (#wikimedia-operations) [2022-12-10T02:00:56Z] <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on 49 hosts with reason: Plugin upgrade for T322776

Gehel assigned this task to RKemper.Dec 12 2022, 4:57 PM
Gehel moved this task from Ready for Dev -- SRE/Ops to In Progress on the Discovery-Search (Current work) board.
Stashbot added a comment.Dec 13 2022, 8:10 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-13T20:10:12Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 13 2022, 8:10 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-13T20:10:51Z] <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

RKemper added a comment.EditedDec 13 2022, 8:15 PM

Audited plugin versions like so:

curl -s localhost:9200/_cat/plugins | grep "extra-analysis-ukrainian"'

Eqiad audit:

elastic1100-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1075-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1076-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1080-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1077-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1065-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1064-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1101-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1054-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1053-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1091-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1087-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1102-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1086-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1063-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1056-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1095-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1067-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1092-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1071-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1059-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1062-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1068-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1088-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1060-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1083-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1069-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1079-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1066-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1073-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1094-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1057-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1082-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1098-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1061-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1084-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1074-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1097-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1058-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4
elastic1055-production-search-eqiad extra-analysis-ukrainian 7.10.2-wmf4

codfw audit:

ryankemper@elastic2052:~$ curl -s localhost:9200/_cat/plugins | grep extra-analysis-ukrain
elastic2066-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2061-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2052-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2067-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2081-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2046-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2076-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2053-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2083-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2057-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2047-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2071-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2077-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2060-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2048-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2085-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2079-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2062-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2038-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2054-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2044-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2037-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2042-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2069-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2082-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2064-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2055-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2075-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2084-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2086-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2070-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2045-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2080-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2068-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2063-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2059-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2078-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2065-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2050-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2039-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2051-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2040-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2058-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2056-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2041-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2043-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2072-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2074-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4
elastic2073-production-search-codfw extra-analysis-ukrainian 7.10.2-wmf4

cloudelastic audit:

ryankemper@cloudelastic1001:~$ curl -s localhost:9200/_cat/plugins | grep extra-analysis-ukrain
cloudelastic1006-cloudelastic-chi-eqiad extra-analysis-ukrainian 7.10.2-wmf4
cloudelastic1002-cloudelastic-chi-eqiad extra-analysis-ukrainian 7.10.2-wmf4
cloudelastic1001-cloudelastic-chi-eqiad extra-analysis-ukrainian 7.10.2-wmf4
cloudelastic1003-cloudelastic-chi-eqiad extra-analysis-ukrainian 7.10.2-wmf4
cloudelastic1004-cloudelastic-chi-eqiad extra-analysis-ukrainian 7.10.2-wmf4
Stashbot added a comment.Dec 13 2022, 8:17 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-13T20:17:30Z] <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

Stashbot added a comment.Dec 13 2022, 8:20 PM

Mentioned in SAL (#wikimedia-operations) [2022-12-13T20:20:02Z] <ryankemper@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776

RKemper moved this task from In Progress to Needs Reporting on the Discovery-Search (Current work) board.Dec 13 2022, 8:39 PM

Plugin deployed everywhere.

Gehel closed this task as Resolved.Jan 13 2023, 9:53 AM
TJones added a parent task: T318264: Investigate Unpacking Ukrainian Analyzer.May 1 2023, 6:03 PM
TJones added a subtask: T323927: Reindex Ukrainian-language wikis to enable unpacked analysis.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL