Page MenuHomePhabricator

Global Search is down: 500: Internal Server Error / Could not resolve host: cloudelastic1004.wikimedia.org
Closed, ResolvedPublic

Description

URL: https://global-search.toolforge.org/?namespaces=2,4,8

Search query: "meta notifications"

Event Timeline

matmarex renamed this task from 500: Internal Server Error on (Gadgets-definition|.*\.(js|css|json)) to Global Search is down: 500: Internal Server Error / Could not resolve host: cloudelastic1004.wikimedia.org.Feb 23 2024, 1:36 AM

Okay, we're back up and running. I do not recall why we were querying cloudelastic1004.wikimedia.org directly instead of https://cloudelastic.wikimedia.org.

We're now querying the "chi" cluster at https://cloudelastic.wikimedia.org:8243. According to the docs, this includes "approximately the 200 largest wikis", but is missing some of the smaller wikis. I don't know if this means we have potentially incomplete results, compared to what we were getting before on cloudelastic1004.

Perhaps @EBernhardson could shed some light on how it all works. In order to be truly "global", should we be querying all three clusters and join the results?

I suspect at the time we initially setup global-search we didn't have the cloudelastic.wikimedia.org alias up and running yet, but now that that exists should certainly point at it instead of individual servers.

In terms of the other two search clusters, you are querying them through the cross-cluster search functionality. At query time the syntax *_content is searching indicies in the local cluster, and *:*_content is searching indices available over cross-cluster search.

MusikAnimal claimed this task.

I suspect at the time we initially setup global-search we didn't have the cloudelastic.wikimedia.org alias up and running yet, but now that that exists should certainly point at it instead of individual servers.

That was my suspicion as well.

In terms of the other two search clusters, you are querying them through the cross-cluster search functionality. At query time the syntax *_content is searching indicies in the local cluster, and *:*_content is searching indices available over cross-cluster search.

Awesome! So it sounds like no further adjustments are needed. Thank you for explaining :)

Resolving!