EBernhardson (EBernhardson)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 4:49 PM (206 w, 2 d)
Availability
Available
LDAP User
EBernhardson
MediaWiki User
EBernhardson (WMF) [ Global Accounts ]

Recent Activity

Yesterday

EBernhardson moved T204959: Add a way to configure timeouts of autocomplete queries from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Sep 20, 10:59 PM · MW-1.32-release-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch
EBernhardson added a comment to T204776: Investigate brief CirrusSearch outage (MW exception spike for api.php).

Potentially the reason this drug on longer than it should have is timeouts updating the cluster state: https://logstash.wikimedia.org/goto/1f67b952e7da4dec76fc66addb6b901b

Thu, Sep 20, 9:34 PM · Discovery-Search (Current work), MW-1.32-release-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, CirrusSearch, Wikimedia-Incident, Wikimedia-production-error
EBernhardson added a comment to T205005: Reindex produces a lot of Undefined index messages.

Is this from the task reindexing the same cluster that is having a restart (codfw, iirc)? I don't think elasticsearch tasks or scrolls are able to move between hosts and will fail in the face of one of the nodes participating restarting. The error message also means we don't detect that case, there is probably no particular error handling in the Cirrus side of the reindexing code to detect errors.

Thu, Sep 20, 8:16 PM · Discovery-Search
EBernhardson triaged T204982: Collect per-node latency statistics from each node separately as Normal priority.
Thu, Sep 20, 5:40 PM · Discovery-Search (Current work)
EBernhardson added a comment to T143396: Display translated page title in search results.

This is now blocked until roughly december waiting for data to populate the indices before it can be used

Thu, Sep 20, 5:27 PM · Discovery-Search (Current work), Patch-For-Review, MediaWiki-Search, Discovery, MediaWiki-extensions-Translate
EBernhardson moved T143396: Display translated page title in search results from In progress to Waiting/Blocked on the Discovery-Search (Current work) board.
Thu, Sep 20, 5:27 PM · Discovery-Search (Current work), Patch-For-Review, MediaWiki-Search, Discovery, MediaWiki-extensions-Translate
EBernhardson moved T204363: Modify elasticsearch_shard_size_check plugin to display only indices and shard size from Needs triage to This Quarter on the Discovery-Search board.
Thu, Sep 20, 5:15 PM · Operations, Discovery-Search, Elasticsearch
EBernhardson moved T204776: Investigate brief CirrusSearch outage (MW exception spike for api.php) from Needs triage to Current work on the Discovery-Search board.
Thu, Sep 20, 5:15 PM · Discovery-Search (Current work), MW-1.32-release-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, CirrusSearch, Wikimedia-Incident, Wikimedia-production-error
EBernhardson moved T204868: Long single-token Unicode searches report regex error from Needs triage to This Quarter on the Discovery-Search board.
Thu, Sep 20, 5:05 PM · Discovery-Search
EBernhardson triaged T204868: Long single-token Unicode searches report regex error as Low priority.
Thu, Sep 20, 5:05 PM · Discovery-Search
EBernhardson updated the task description for T147505: [Recurring task] CirrusSearch: what is updated during re-indexing.
Thu, Sep 20, 4:13 PM · Discovery-Search (Current work), Discovery

Wed, Sep 19

EBernhardson moved T203622: Upgrade saneitizer to constantly re-index documents from Needs review to Done on the Discovery-Search (Current work) board.
Wed, Sep 19, 10:52 PM · MW-1.32-release-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch
EBernhardson added a comment to T204776: Investigate brief CirrusSearch outage (MW exception spike for api.php).

Yet another thing to look into. Our dashboard for poolcounter rejections only went up to a few hundred per minute, but logstash recorded orders of magnitude more pool counter rejections. At a minimum perhaps that graph is in rejections/sec and not the labeled rejections/min?

Wed, Sep 19, 12:56 AM · Discovery-Search (Current work), MW-1.32-release-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, CirrusSearch, Wikimedia-Incident, Wikimedia-production-error
EBernhardson updated subscribers of T204776: Investigate brief CirrusSearch outage (MW exception spike for api.php).
Wed, Sep 19, 12:50 AM · Discovery-Search (Current work), MW-1.32-release-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, CirrusSearch, Wikimedia-Incident, Wikimedia-production-error
EBernhardson added a comment to T204776: Investigate brief CirrusSearch outage (MW exception spike for api.php).

Looking at percentiles we can see tail latency spiked around the same time as this error: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles-prometheus?orgId=1&from=1537301173784&to=1537303336668&var-cluster=codfw&var-smoothing=1

Wed, Sep 19, 12:40 AM · Discovery-Search (Current work), MW-1.32-release-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, CirrusSearch, Wikimedia-Incident, Wikimedia-production-error

Tue, Sep 18

EBernhardson added a comment to T204776: Investigate brief CirrusSearch outage (MW exception spike for api.php).

At a high level, these logs are saying the connection pools filled up on API application servers.

Tue, Sep 18, 10:27 PM · Discovery-Search (Current work), MW-1.32-release-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, CirrusSearch, Wikimedia-Incident, Wikimedia-production-error
EBernhardson moved T189242: [Bug] Image clicks are ignored by searchSatisfaction from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Sep 18, 5:18 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T191961: Investigate why interwiki cache hit/miss is no longer reported from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Sep 18, 5:17 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson claimed T143396: Display translated page title in search results.
Tue, Sep 18, 5:17 PM · Discovery-Search (Current work), Patch-For-Review, MediaWiki-Search, Discovery, MediaWiki-extensions-Translate
EBernhardson moved T143396: Display translated page title in search results from Backlog to In progress on the Discovery-Search (Current work) board.
Tue, Sep 18, 5:17 PM · Discovery-Search (Current work), Patch-For-Review, MediaWiki-Search, Discovery, MediaWiki-extensions-Translate
EBernhardson edited projects for T143396: Display translated page title in search results, added: Discovery-Search (Current work); removed Discovery-Search.
Tue, Sep 18, 5:17 PM · Discovery-Search (Current work), Patch-For-Review, MediaWiki-Search, Discovery, MediaWiki-extensions-Translate

Mon, Sep 17

EBernhardson closed T89682: Improving static analysis tools for MediaWiki as Resolved.

Task is completed, the extra analysis checks have proven themselves useful in a variety of circumstances.

Mon, Sep 17, 4:45 PM · MediaWiki-Codesniffer (MediaWiki-Codesniffer-GSoC-2016), Outreachy-Round-12, Google-Summer-of-Code (2016)
EBernhardson closed T153252: Fix PHP issues in MediaWiki core found by Phan (static code analysis) as Resolved.

This task has no clear closing criteria, but plenty has been done and completed some time ago. Calling it done.

Mon, Sep 17, 4:44 PM · MW-1.30-release-notes, Need-volunteer, Patch-For-Review, MediaWiki-General-or-Unknown
EBernhardson closed T153252: Fix PHP issues in MediaWiki core found by Phan (static code analysis), a subtask of T133664: Statically analyse MinervaNeue codebases with Phan, as Resolved.
Mon, Sep 17, 4:44 PM · Readers-Web-Backlog (Tracking), Technical-Debt (RW-Tech-Debt), MobileFrontend
EBernhardson moved T204148: Cirrus MLT cache has 0% hit rate on switchover from Needs review to Done on the Discovery-Search (Current work) board.
Mon, Sep 17, 4:08 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Datacenter-Switchover-2018, Discovery-Search (Current work)

Fri, Sep 14

EBernhardson updated subscribers of T114849: Log lines on flourine overflow at 8092 bytes..

Indeed the original problem here was that two log lines were merged into one. I haven't seen this problem with the logstash infrastructure, but that doesn't mean it doesn't exist. The logs I was looking at in this ticket are not sent to logstash due to volume, and at the time were only available on the text log server. Since this task was filed those logs are now available in kafka, but there are still logs generated that only end up on mwlog* machines. If the bug still exists there it seems reasonable to keep open.

Fri, Sep 14, 6:30 PM · Wikimedia-Logstash, Operations
EBernhardson added a comment to T191961: Investigate why interwiki cache hit/miss is no longer reported.

It turns out the cache has been disabled. We've been running without it likely since oct 2017, does it matter to put back in place? The patch above tries to fix the cache, but we could alternatively remove it.

Fri, Sep 14, 6:01 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson added a comment to T143396: Display translated page title in search results.

While mostly a hack, the most direct method to deal with this would be some integration to make redirects from the translated name to the actual page.

Fri, Sep 14, 3:25 PM · Discovery-Search (Current work), Patch-For-Review, MediaWiki-Search, Discovery, MediaWiki-extensions-Translate

Thu, Sep 13

EBernhardson closed T155559: Use implicit feedback to improve search rankings as Resolved.

This is generally done. There is a pipeline that attempts to extract user satisfaction from the click logs, and then runs an MLR pipeline that optimizes for ranking by expected satisfaction.

Thu, Sep 13, 10:39 PM · artificial-intelligence, Discovery-Search, Research ideas
EBernhardson moved T150030: [UI] Add "reason for skipping" to Discernatron skip button from This Quarter to Later on the Discovery-Search board.
Thu, Sep 13, 10:37 PM · Discovery-Search, Discovery, CirrusSearch
EBernhardson renamed T138156: Searching for a file name by name can fail due to handling of the extension from CirrusSearch: can't find files with only a interchanged word (and/or exact title inside/metadata) to Searching for a file name by name can fail due to handling of the extension.
Thu, Sep 13, 10:37 PM · Discovery-Search, Discovery, CirrusSearch
EBernhardson closed T139586: Remove deprecated code after the switch to BM25 on all wikis as Declined.

This has been nicely refactored behind a similarity profile and doesn't need to be dropped currently.

Thu, Sep 13, 10:34 PM · Discovery-Search, Discovery, CirrusSearch
EBernhardson closed T139586: Remove deprecated code after the switch to BM25 on all wikis, a subtask of T139575: EPIC: Plan to enable BM25 on fulltext search, as Declined.
Thu, Sep 13, 10:34 PM · Discovery-Search (Current work), Epic, Discovery, CirrusSearch
EBernhardson closed T139585: Reindex all wikis with the new BM25 settings as Resolved.

Everything that's going to bm25 has been done some time ago.

Thu, Sep 13, 10:33 PM · Discovery-Search, Discovery, CirrusSearch
EBernhardson closed T139585: Reindex all wikis with the new BM25 settings, a subtask of T139575: EPIC: Plan to enable BM25 on fulltext search, as Resolved.
Thu, Sep 13, 10:33 PM · Discovery-Search (Current work), Epic, Discovery, CirrusSearch
EBernhardson closed T139585: Reindex all wikis with the new BM25 settings, a subtask of T151173: Search engine does not find "ai dû" on the French Wiktionary., as Resolved.
Thu, Sep 13, 10:33 PM · Discovery-Search (Current work), Discovery, CirrusSearch
EBernhardson moved T174073: [Q1 2017-18 Objective] Update advanced search on Commons to support specific media search filters from This Quarter to Watching/Waiting on the Discovery-Search board.
Thu, Sep 13, 10:32 PM · Discovery-Search, Goal, Search-Platform-Programs
EBernhardson moved T174072: [Q1 2017-18 Objective] Extend Commons search to support media via structured data from This Quarter to Watching/Waiting on the Discovery-Search board.
Thu, Sep 13, 10:32 PM · Discovery-Search, Goal, Search-Platform-Programs
EBernhardson moved T174069: [Q1 2017-18 Objective] Language analyzer research from This Quarter to Watching/Waiting on the Discovery-Search board.
Thu, Sep 13, 10:32 PM · Discovery-Search, Goal, Search-Platform-Programs
EBernhardson moved T174067: [Q1 2017-18 Objective] Deploy newly automated models from This Quarter to Watching/Waiting on the Discovery-Search board.
Thu, Sep 13, 10:32 PM · Discovery-Search, Goal, Search-Platform-Programs
EBernhardson moved T174070: [Q1 2017-18 Objective] Deploy language analyzers in progress from This Quarter to Watching/Waiting on the Discovery-Search board.
Thu, Sep 13, 10:32 PM · I18n, Discovery-Search, Goal, Search-Platform-Programs
EBernhardson moved T174066: [Q1 2017-18 Objective] Perform load and A/B tests on new models (interleaved search results) from This Quarter to Watching/Waiting on the Discovery-Search board.
Thu, Sep 13, 10:32 PM · Discovery-Search, Goal, Search-Platform-Programs
EBernhardson closed T197960: Upgrade plugins to elastic 6.3 as Resolved.
Thu, Sep 13, 9:59 PM · Discovery-Search (Current work), Discovery, CirrusSearch, Epic
EBernhardson closed T197960: Upgrade plugins to elastic 6.3, a subtask of T194199: [Epic] Prepare for Elasticsearch 6 upgrade, as Resolved.
Thu, Sep 13, 9:59 PM · Epic, Discovery-Search (Current work)
EBernhardson moved T197960: Upgrade plugins to elastic 6.3 from Backlog to Done on the Discovery-Search (Current work) board.
Thu, Sep 13, 9:59 PM · Discovery-Search (Current work), Discovery, CirrusSearch, Epic
EBernhardson edited projects for T197960: Upgrade plugins to elastic 6.3, added: Discovery-Search (Current work); removed Discovery-Search.
Thu, Sep 13, 9:58 PM · Discovery-Search (Current work), Discovery, CirrusSearch, Epic
EBernhardson moved T191961: Investigate why interwiki cache hit/miss is no longer reported from In progress to Needs review on the Discovery-Search (Current work) board.
Thu, Sep 13, 9:57 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson claimed T191961: Investigate why interwiki cache hit/miss is no longer reported.
Thu, Sep 13, 8:25 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson moved T191961: Investigate why interwiki cache hit/miss is no longer reported from Backlog to In progress on the Discovery-Search (Current work) board.
Thu, Sep 13, 8:25 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson moved T204148: Cirrus MLT cache has 0% hit rate on switchover from Backlog to Needs review on the Discovery-Search (Current work) board.
Thu, Sep 13, 8:08 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Datacenter-Switchover-2018, Discovery-Search (Current work)
EBernhardson updated subscribers of T174057: Namespaces are shown in the local language rather than in the user interface language.

@Amire80 any thoughts?

Thu, Sep 13, 7:03 PM · Patch-For-Review, Discovery-Search (Current work), MediaWiki-Interface, I18n
EBernhardson moved T189242: [Bug] Image clicks are ignored by searchSatisfaction from In progress to Needs review on the Discovery-Search (Current work) board.
Thu, Sep 13, 7:03 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T190010: JavaScript redirect shows irrelevant internal information in search page from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Sep 13, 6:16 PM · Performance-Team (Radar), MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-Search, Discovery

Wed, Sep 12

EBernhardson added a comment to T174057: Namespaces are shown in the local language rather than in the user interface language.

I disagree this should be the same in every place. I think it really depends on the use case. Giving a user a list of some thing that exists might make sense to be in the content language. Asking a user to choose items from a list they can't read seems a distinct issue.

Wed, Sep 12, 9:48 PM · Patch-For-Review, Discovery-Search (Current work), MediaWiki-Interface, I18n
EBernhardson moved T182452: Searching for strings starting with a # should not redirect to main page from Needs review to Done on the Discovery-Search (Current work) board.
Wed, Sep 12, 9:44 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson moved T73123: can't use incategory: or intitle: when category or title contains double quotes from Needs review to Done on the Discovery-Search (Current work) board.
Wed, Sep 12, 9:44 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), TestMe, Discovery, MediaWiki-Search
EBernhardson moved T190010: JavaScript redirect shows irrelevant internal information in search page from Backlog to Needs review on the Discovery-Search (Current work) board.
Wed, Sep 12, 9:44 PM · Performance-Team (Radar), MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-Search, Discovery
EBernhardson added a comment to T190010: JavaScript redirect shows irrelevant internal information in search page.

Pulled a test set of browsers reporting to search eventlogging for sept 1-12 in P7539. This is not the same data as is collected in the code for this ticket, but is a close enough representative sample that is very easy to query. That data additionally isn't perfect since there is a target sampling rate (x events per wiki per day) rather than some percentage of all requests, but it's probably close enough. It will essentially down-weight some of the largest wikis in the stats. Below is everything with >1% of distinct search sessions for sept 1-14, as classified by our eventlogging user agent classifier.

Wed, Sep 12, 9:35 PM · Performance-Team (Radar), MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-Search, Discovery
EBernhardson edited P7539 TestSearchSatisfcation browser breakdown sept 1-12 2018.
Wed, Sep 12, 8:46 PM
EBernhardson added a comment to T204148: Cirrus MLT cache has 0% hit rate on switchover.

A warmup wouldn't be enough, the cache holds a value per mediawiki content page across all wikis. Mirroring the existing cache across dc's seems the most direct solution. Note that this cache is in the mediawiki side, and not in elastic itself which makes this relatively painless.

Wed, Sep 12, 8:33 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Datacenter-Switchover-2018, Discovery-Search (Current work)
EBernhardson created P7539 TestSearchSatisfcation browser breakdown sept 1-12 2018.
Wed, Sep 12, 8:05 PM
EBernhardson updated the task description for T204148: Cirrus MLT cache has 0% hit rate on switchover.
Wed, Sep 12, 6:50 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Datacenter-Switchover-2018, Discovery-Search (Current work)
EBernhardson updated the task description for T204148: Cirrus MLT cache has 0% hit rate on switchover.
Wed, Sep 12, 6:49 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Datacenter-Switchover-2018, Discovery-Search (Current work)
EBernhardson added a comment to T204135: Warn when CirrusSearch is not configured to use local DCfor an extended time.

We almost have an api for that, the CirrusSearchDefaultCluster key. Unfortunately by the time that code runs though local has been replaced with whatever is the actual local datacenter. There is a $wmgCirrusSearchDefaultCluster global which looks to still be set to local, at least in mwrepl on the debug servers, which i suppose we could find a way to report here. But by default the config system has no capability to handle wmg* keys.

Wed, Sep 12, 6:42 PM · Patch-For-Review, Discovery-Search (Current work), Datacenter-Switchover-2018, Operations
EBernhardson created T204148: Cirrus MLT cache has 0% hit rate on switchover.
Wed, Sep 12, 6:29 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Datacenter-Switchover-2018, Discovery-Search (Current work)

Tue, Sep 11

Quiddity awarded T195071: Add chronological sorting by-page-creation-timestamp for search results a Love token.
Tue, Sep 11, 9:25 PM · MW-1.32-release-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), Discovery-Search (Current work), Patch-For-Review, Wikimedia-Hackathon-2018, CirrusSearch, Discovery
EBernhardson claimed T189242: [Bug] Image clicks are ignored by searchSatisfaction.
Tue, Sep 11, 8:53 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T189242: [Bug] Image clicks are ignored by searchSatisfaction from Done to In progress on the Discovery-Search (Current work) board.
Tue, Sep 11, 8:53 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T73123: can't use incategory: or intitle: when category or title contains double quotes from Done to Needs review on the Discovery-Search (Current work) board.
Tue, Sep 11, 8:53 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), TestMe, Discovery, MediaWiki-Search
EBernhardson moved T73123: can't use incategory: or intitle: when category or title contains double quotes from In progress to Done on the Discovery-Search (Current work) board.
Tue, Sep 11, 8:53 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), TestMe, Discovery, MediaWiki-Search
EBernhardson moved T189242: [Bug] Image clicks are ignored by searchSatisfaction from Backlog to Done on the Discovery-Search (Current work) board.
Tue, Sep 11, 8:52 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson added a comment to T78705: Send Jenkins build log and results to ElasticSearch.

If that is the case, an exception has to be granted by netops to allow that production <-> WMCS communication. Else, we would need an ElasticSearch instance in the production network.

The instance does live in the production network, much like the cloud mysql replicas. There is already a network exception for traffic from cloud to relforge

Tue, Sep 11, 7:15 PM · Release-Engineering-Team (Next), Wikimedia-Hackathon-2017, Patch-For-Review, Wikimedia-Logstash, Jenkins, Continuous-Integration-Infrastructure
EBernhardson moved T73123: can't use incategory: or intitle: when category or title contains double quotes from Backlog to In progress on the Discovery-Search (Current work) board.
Tue, Sep 11, 6:51 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), TestMe, Discovery, MediaWiki-Search
EBernhardson claimed T73123: can't use incategory: or intitle: when category or title contains double quotes.

Ran a new test and at least on hebrew the analysis chain doesn't seem to be getting in the way. I issued a simplified version of our production query (P7534) and got back two results:

{
  "title": [
    "תנועת אומ\"ץ"
  ]
}
{
  "redirect.title": [
    "אומ\"ץ ישראלי"
  ]
}
Tue, Sep 11, 6:50 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), TestMe, Discovery, MediaWiki-Search
EBernhardson updated the title for P7534 hebrew intitle with " from untitled to hebrew intitle with ".
Tue, Sep 11, 6:48 PM
EBernhardson created P7534 hebrew intitle with ".
Tue, Sep 11, 6:48 PM
EBernhardson added a comment to T78705: Send Jenkins build log and results to ElasticSearch.

That is still the address for our testing servers, yes. The server is setup to be accessible from the production and cloud networks, I guess contint1001 must be in yet another network? TBH I'm not too familiar with how CI is separated from the rest of things, i would have assumed it was part of cloud but maybe not?

Tue, Sep 11, 5:51 PM · Release-Engineering-Team (Next), Wikimedia-Hackathon-2017, Patch-For-Review, Wikimedia-Logstash, Jenkins, Continuous-Integration-Infrastructure
EBernhardson closed T164288: CirrusSearch should be able to keep its index upto date in most cases as Resolved.

Resolved via T203622

Tue, Sep 11, 5:26 PM · CirrusSearch, Discovery-Search, Epic, Discovery
EBernhardson moved T73123: can't use incategory: or intitle: when category or title contains double quotes from This Quarter to Current work on the Discovery-Search board.
Tue, Sep 11, 5:25 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), TestMe, Discovery, MediaWiki-Search
EBernhardson closed T195192: Missing search results when using contentmodel filter as Resolved.

The reindexing will be resolved by T203622. The first pass through should be finished mid-december which will reindex all pages missing content models.

Tue, Sep 11, 5:23 PM · Discovery-Search, Discovery, CirrusSearch
EBernhardson moved T189242: [Bug] Image clicks are ignored by searchSatisfaction from Later to Current work on the Discovery-Search board.
Tue, Sep 11, 5:22 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T189242: [Bug] Image clicks are ignored by searchSatisfaction from This Quarter to Later on the Discovery-Search board.
Tue, Sep 11, 5:22 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T191961: Investigate why interwiki cache hit/miss is no longer reported from Up Next to Current work on the Discovery-Search board.
Tue, Sep 11, 5:21 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson added a comment to T189708: Investigate the list of writers to elasticsearch.

Randomly thinking about this, it seems the most obvious way would be to have clients send appropriate user agent's in the http requests, and track the set of unique user agents and their request rates. If the user agents are fairly obvious we should be able to see what is doing what, and be able to ask for user agents to be clarified where necessary.

Tue, Sep 11, 5:18 PM · Discovery-Search
EBernhardson claimed T190010: JavaScript redirect shows irrelevant internal information in search page.
Tue, Sep 11, 5:15 PM · Performance-Team (Radar), MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-Search, Discovery
EBernhardson added a comment to T195071: Add chronological sorting by-page-creation-timestamp for search results.

create_date_asc and create_date_desc will be populated by T203622, which will eventually unblock this task. That will likely be deployed after the DC switchover and will then need 8-10 weeks to iterate over the full document set and reindex everything. That basically means everything should be populated by mid-december or so.

Tue, Sep 11, 4:57 PM · MW-1.32-release-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), Discovery-Search (Current work), Patch-For-Review, Wikimedia-Hackathon-2018, CirrusSearch, Discovery
EBernhardson moved T191485: [[MediaWiki:Cirrussearch-completion-profile-fuzzy-pref-desc/ml]] i18n issue from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Sep 11, 4:54 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Discovery-Search (Current work), Patch-For-Review, CirrusSearch, Discovery, I18n
EBernhardson moved T191493: CirrusSearch should handle gracefully a missing plugins section in elasticsearch response from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Sep 11, 4:54 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Easy, Discovery
EBernhardson edited projects for T156137: Reduce impact of GC pauses on elasticsearch response time, added: Discovery-Search; removed Discovery-Search (Current work).
Tue, Sep 11, 4:53 PM · Discovery-Search, Discovery, Elasticsearch

Mon, Sep 10

EBernhardson moved T195389: Text content of wiki page in search index can merge words making them unfindable. from In progress to Needs review on the Discovery-Search (Current work) board.
Mon, Sep 10, 11:41 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson added a comment to T195389: Text content of wiki page in search index can merge words making them unfindable..

The explanation is boils down to this:

$text = <<<EOD
<dl>
  <dd>foo</dd>
  <dd>bar</dd>
</dl> 
<p>baz</p>
EOD;
Mon, Sep 10, 11:12 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson claimed T195389: Text content of wiki page in search index can merge words making them unfindable..
Mon, Sep 10, 9:16 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson moved T195389: Text content of wiki page in search index can merge words making them unfindable. from Backlog to In progress on the Discovery-Search (Current work) board.
Mon, Sep 10, 9:16 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson moved T182452: Searching for strings starting with a # should not redirect to main page from In progress to Needs review on the Discovery-Search (Current work) board.
Mon, Sep 10, 9:15 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson added a comment to T182452: Searching for strings starting with a # should not redirect to main page.

Attached patch resolves the issue where typing #anything into the search box sends the user to the main page. For the issue regarding "exactly this text" i've added a comment referencing this from T182856 which i believe is a task for this issue in particular.

Mon, Sep 10, 9:14 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson added a comment to T182856: Add current issues to "exactly this text" helptext.

Can the field "Exactly this text" use insource, when a "ß" is involved?

Mon, Sep 10, 9:13 PM · TCB-Team, Advanced-Search
EBernhardson claimed T182452: Searching for strings starting with a # should not redirect to main page.
Mon, Sep 10, 8:17 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson moved T182452: Searching for strings starting with a # should not redirect to main page from Backlog to In progress on the Discovery-Search (Current work) board.
Mon, Sep 10, 8:17 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
EBernhardson moved T174057: Namespaces are shown in the local language rather than in the user interface language from In progress to Needs review on the Discovery-Search (Current work) board.
Mon, Sep 10, 8:17 PM · Patch-For-Review, Discovery-Search (Current work), MediaWiki-Interface, I18n
EBernhardson claimed T174057: Namespaces are shown in the local language rather than in the user interface language.
Mon, Sep 10, 8:03 PM · Patch-For-Review, Discovery-Search (Current work), MediaWiki-Interface, I18n