The currently packaged version of opensearch 1 in apt.wikimedia.org looks to be 1.2.4, prior to migrating we should update this to the latest version, 1.3.20. Might require verifying nothing is using opensearch 1 and would be unexpectedly updated.
Description
Description
Details
Details
- Other Assignee
- brouberol
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T370147 [Epic] Migration of the Elasticsearch 7.10 search cluster to replacement backend search engine | |||
| Resolved | bking | T379312 Release packages for opensearch 1.3.20 | |||
| Resolved | dcausse | T385005 Build all search platform plugins for opensearch 1.3.20 |
Event Timeline
Comment Actions
Per IRC conversation with @dcausse , we should be able to publish the packages to the opensearch13 apt component . This is preferable to using the Opensearch 1 thirdparty repo , as that would affect current users of Opensearch 1 (currently limited to datahubsearch hosts, which are also owned by my team, Data Platform SRE).
We'll build the package using these instructions provided by Observability. Note that they are using Opensearch 2, so we'll need to modify them slightly.
Comment Actions
Per today's pairing with @RKemper , we built the Opensearch 1.3.20 Debian package using the process described above. The list of files created is here .
Note that we built the current Opensearch plugins against Opensearch 1.3.19 (see T380395), whereas the Openstack package we built is for 1.3.20. We definitely want to go with the .20 Opensearch release (see this nasty bug for justification) .
We need to verify the current plugins package will work with 1.3.20 and update it if not.
Comment Actions
We have published the Opensearch 1.3.20 Debian package to apt.wikimedia.org's thirdparty/opensearch1 repo
bking@datahubsearch1001:~$ apt policy opensearch
opensearch:
Installed: 1.2.4
Candidate: 1.3.20
Version table:
1.3.20 1001The next step is to build our opensearch plugin package . This will require updating each individual plugin's repo, as David mentioned above.
See T372769 for a list of repos. I'm also working on documenting this process .
Comment Actions
Do we need to update https://gitlab.wikimedia.org/repos/search-platform/opensearch-analysis-stconvert ? It seems that it was built for opensearch 2.11.1, but not for 1.3.20.
Comment Actions
@brouberol sorry I forgot to link T385005 from here, plugins should be ready to be packaged in https://gerrit.wikimedia.org/r/c/operations/software/opensearch/plugins/+/1118553
stconvert has its own 1.3.x branch at https://gitlab.wikimedia.org/repos/search-platform/opensearch-analysis-stconvert/-/tree/1.3.x?ref_type=heads
Comment Actions
brouberol@apt1002:~$ sudo -i root@apt1002:~# cd /home/bking/ root@apt1002:/home/bking# GNUPGHOME=/root/.gnupg REPREPRO_BASE_DIR=/srv/wikimedia export GNUPGHOME export REPREPRO_BASE_DIR root@apt1002:/home/bking# sudo -E reprepro -C component/opensearch13 include bullseye-wikimedia wmf-opensearch-search-plugins_1.3.20-0/wmf-opensearch-search-plugins_1.3.20-0_amd64.changes Exporting indices... Deleting files no longer referenced... root@apt1002:/home/bking# reprepro ls wmf-opensearch-search-plugins wmf-opensearch-search-plugins | 1.3.20-0~bullseye | bullseye-wikimedia | amd64, i386 wmf-opensearch-search-plugins | 1.3.20-0 | bullseye-wikimedia | source
I think this can be called done!