Page MenuHomePhabricator

EBernhardson (EBernhardson)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 4:49 PM (254 w, 1 d)
Availability
Available
LDAP User
EBernhardson
MediaWiki User
EBernhardson (WMF) [ Global Accounts ]

Recent Activity

Yesterday

EBernhardson moved T220625: Initialize CirrusSearch on cloudelastic from in progress to Done on the Discovery-Search (Current work) board.
Wed, Aug 21, 4:40 PM · MW-1.34-notes (1.34.0-wmf.4; 2019-05-07), Discovery-Search (Current work), Cloud-Services, Elasticsearch, Discovery

Tue, Aug 20

EBernhardson added a comment to T229882: Point discovery dashboards at SearchSatisfaction eventlogging table.

@mpopov Any movement here? No huge rush but this will let us stop generating all events twice

Tue, Aug 20, 5:25 PM · Discovery-Search (Current work), Product-Analytics
EBernhardson added a comment to T230495: Partition CirrusSearch mediawiki jobs by cluster.

We need to rework our updater a little bit to share some expensive work before the partitioned jobs, but pull the ContentHandler data per-job. Shouldn't be that much work, but needs to be done on our end so the cirrusSearchElasticaWrite job can be partitioned

Tue, Aug 20, 3:47 PM · Core Platform Team Workboards (Clinic Duty Team), Discovery-Search, Cloud-Services, Elasticsearch, Discovery
EBernhardson committed rWDANa787f6bf7438: Rename glent partition spec part -> date (authored by EBernhardson).
Rename glent partition spec part -> date
Tue, Aug 20, 9:02 AM

Mon, Aug 19

EBernhardson added a comment to T230746: rack/setup/install elastic10[53-67].eqiad.wmnet.

Try to evenly space out elastic nodes in the row evenly in 1G racks.

Mon, Aug 19, 8:25 PM · Operations, ops-eqiad
EBernhardson committed rWDAN68db615cb2b9: Tweaks to glent swift upload for final subworkflow (authored by EBernhardson).
Tweaks to glent swift upload for final subworkflow
Mon, Aug 19, 8:34 AM
EBernhardson committed rECIR1c4351bb011d: Implement a random sort order (authored by EBernhardson).
Implement a random sort order
Mon, Aug 19, 7:38 AM

Fri, Aug 16

EBernhardson committed rECIRfaef47a4a0bd: Fix highlighting of grapheme clusters in search snippets (authored by TJones).
Fix highlighting of grapheme clusters in search snippets
Fri, Aug 16, 8:10 PM

Thu, Aug 15

EBernhardson moved T229027: search of related images on wikidata (for structured data on commons) from needs triage to making others happy on the Discovery-Search board.
Thu, Aug 15, 5:14 PM · Structured-Data-Backlog, Structured Data Engineering, SDC General, Wikidata, Discovery-Search
EBernhardson moved T230175: Provide search functionality to find all files that have at least 1 structured data statement from watching / waiting to Current work on the Discovery-Search board.
Thu, Aug 15, 5:13 PM · Discovery-Search (Current work), Structured-Data-Backlog, SDC General, Wikidata
EBernhardson moved T230175: Provide search functionality to find all files that have at least 1 structured data statement from needs triage to watching / waiting on the Discovery-Search board.
Thu, Aug 15, 5:13 PM · Discovery-Search (Current work), Structured-Data-Backlog, SDC General, Wikidata
EBernhardson moved T89151: SearchHighlighter::highlightText() should not be checking if Cite is installed from needs triage to elastic / cirrus on the Discovery-Search board.
Thu, Aug 15, 5:12 PM · MW-1.34-notes (1.34.0-wmf.20; 2019-08-27), Discovery-Search, Technical-Debt, MediaWiki-Search
EBernhardson moved T230409: Spicerack: extend elasticsearch_cluster module by allowing us to wait for write queue to go empty from needs triage to Ops / SRE on the Discovery-Search board.
Thu, Aug 15, 5:12 PM · Discovery-Search, Elasticsearch

Wed, Aug 14

EBernhardson added a comment to T230472: Search index not updated for nl.wikipedia.org.

Known problem related to recent deployment, currently updates are backlogged about 12 hours. The plan to deal with this is T230495, while some short term hacks are being worked on to alleviate the current backlog.

Wed, Aug 14, 9:20 PM · Discovery-Search (Current work)
EBernhardson created T230495: Partition CirrusSearch mediawiki jobs by cluster.
Wed, Aug 14, 4:08 PM · Core Platform Team Workboards (Clinic Duty Team), Discovery-Search, Cloud-Services, Elasticsearch, Discovery
EBernhardson added a comment to T71658: Make subphrase matching the default search option on all Wikisources.

It looks like enwikisource has added a suggestion to Special:Search to enable subphrase completion matching. This has resulted in ~421 users that have turned it on, and we don't see any that have turned it back off for the default. This suggests we could possibly move forward with making subphrase matching the default on wikisource.

Wed, Aug 14, 3:59 PM · Discovery-Search, Wikimedia-Site-requests, Discovery, Wikisource, CirrusSearch

Thu, Aug 8

EBernhardson moved T229807: cookbook sre.elasticsearch.rolling-restart failed with cluster relforge from in progress to Needs review on the Discovery-Search (Current work) board.
Thu, Aug 8, 5:14 PM · Discovery-Search (Current work), Operations, SRE-tools, Elasticsearch
EBernhardson closed T158627: oozie job "transfer_to_es" should send email on error as Invalid.
Thu, Aug 8, 5:09 PM · Discovery-Search, Discovery
EBernhardson added a comment to T220625: Initialize CirrusSearch on cloudelastic.

All wikis are writing to cloudelastic now. Still be a few days to catchup on writes since july 29, the day the dump was made. Also somehow importing commonswiki_file only imported ~25M out of 50M items. The saneitizer is working on fixing that, but will take a bit.

Thu, Aug 8, 3:22 PM · MW-1.34-notes (1.34.0-wmf.4; 2019-05-07), Discovery-Search (Current work), Cloud-Services, Elasticsearch, Discovery

Wed, Aug 7

EBernhardson committed rECIR29774bd07f5b: Mark DeleteArchive jobs as handling private_data (authored by EBernhardson).
Mark DeleteArchive jobs as handling private_data
Wed, Aug 7, 11:21 PM
EBernhardson moved T229937: Prometheus not collecting cloudelastic metrics from Needs review to Done on the Discovery-Search (Current work) board.
Wed, Aug 7, 10:14 PM · Discovery-Search (Current work), Operations

Tue, Aug 6

EBernhardson moved T229937: Prometheus not collecting cloudelastic metrics from in progress to Needs review on the Discovery-Search (Current work) board.
Tue, Aug 6, 8:00 PM · Discovery-Search (Current work), Operations
EBernhardson moved T229937: Prometheus not collecting cloudelastic metrics from needs triage to Current work on the Discovery-Search board.
Tue, Aug 6, 8:00 PM · Discovery-Search (Current work), Operations
EBernhardson claimed T229937: Prometheus not collecting cloudelastic metrics.
Tue, Aug 6, 8:00 PM · Discovery-Search (Current work), Operations
EBernhardson added a comment to T229937: Prometheus not collecting cloudelastic metrics.

Think i found it:

Tue, Aug 6, 8:00 PM · Discovery-Search (Current work), Operations
EBernhardson added a comment to T229937: Prometheus not collecting cloudelastic metrics.

Looked into this a little bit (on cloudelastic1001.wikimedia.org), no solution yet:

Tue, Aug 6, 7:37 PM · Discovery-Search (Current work), Operations
EBernhardson moved T227364: Adjust mjolnir bulk_daemon to import glent swift uploads from in progress to Needs review on the Discovery-Search (Current work) board.
Tue, Aug 6, 5:45 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T220625: Initialize CirrusSearch on cloudelastic from Waiting/Blocked to in progress on the Discovery-Search (Current work) board.
Tue, Aug 6, 5:44 PM · MW-1.34-notes (1.34.0-wmf.4; 2019-05-07), Discovery-Search (Current work), Cloud-Services, Elasticsearch, Discovery
EBernhardson updated the task description for T229937: Prometheus not collecting cloudelastic metrics.
Tue, Aug 6, 4:04 PM · Discovery-Search (Current work), Operations
EBernhardson created T229937: Prometheus not collecting cloudelastic metrics.
Tue, Aug 6, 4:03 PM · Discovery-Search (Current work), Operations
EBernhardson moved T224324: LB for cloudelastic from in progress to Done on the Discovery-Search (Current work) board.
Tue, Aug 6, 3:53 PM · Discovery-Search (Current work), Cloud-Services, Elasticsearch, Discovery

Mon, Aug 5

EBernhardson added a comment to T228925: Fix documentation of boolean operators.

I reviewed the draft on mw.org, everything there looks accurate as far as I'm aware. I didn't realize that implicit and explciit AND behave differently. The on-wiki documentation doesn't feel scary enough for what's really going on, but I'm not sure how to make it more explicit that this thing is funny and not what they think it is.

Mon, Aug 5, 11:08 PM · Discovery-Search (Current work)
EBernhardson added a comment to T229861: Can't reach cloudelastic.wikimedia.org via IPv6.

Resolution: The ipv6 address I set, which was the ipv6 version of the ipv4 address, was incorrect. Rather a new ipv6 address within the LVS range needed to be used. Brandon applied a fix with https://gerrit.wikimedia.org/r/#/c/528215/ and https://gerrit.wikimedia.org/r/#/c/528216/ and everything now looks to be working as expected wrt ipv6

Mon, Aug 5, 10:01 PM · Operations, Traffic, Discovery-Search (Current work)
EBernhardson moved T229882: Point discovery dashboards at SearchSatisfaction eventlogging table from in progress to Waiting/Blocked on the Discovery-Search (Current work) board.
Mon, Aug 5, 9:59 PM · Discovery-Search (Current work), Product-Analytics
EBernhardson moved T229882: Point discovery dashboards at SearchSatisfaction eventlogging table from needs triage to Current work on the Discovery-Search board.
Mon, Aug 5, 9:59 PM · Discovery-Search (Current work), Product-Analytics
EBernhardson moved T229861: Can't reach cloudelastic.wikimedia.org via IPv6 from in progress to Done on the Discovery-Search (Current work) board.
Mon, Aug 5, 9:49 PM · Operations, Traffic, Discovery-Search (Current work)
EBernhardson created T229882: Point discovery dashboards at SearchSatisfaction eventlogging table.
Mon, Aug 5, 8:32 PM · Discovery-Search (Current work), Product-Analytics
EBernhardson added a comment to T229861: Can't reach cloudelastic.wikimedia.org via IPv6.

@EBernhardson im not sure where the data above came from but i suspect a typo somewhere 2620:0:860::ed1a::1 dose not exist anywhere in the puppet repo. however 2620:0:860:ed1a::1 (notice the missing ':') is valid and is routed to the lvs eqiad servers. That said it does look like most lvs services are in the 2620:0:860:ed1a:: prefix an the servers i have found in the 2620:0:861:1:: prefix seem to be real machines so i suspect that the ipv6 address may be incorrect

Mon, Aug 5, 6:24 PM · Operations, Traffic, Discovery-Search (Current work)
EBernhardson added a comment to T229861: Can't reach cloudelastic.wikimedia.org via IPv6.

Something suspicious i noticed, in lvs/configuration.yaml we define our ipv6 address in a different format than the others. Table below contains example addresses for a few services. In particular note that addresses like 2620:0:860::ed1a::1 are not valid ipv6 addresses, I'm not actually sure what they are.

Mon, Aug 5, 6:05 PM · Operations, Traffic, Discovery-Search (Current work)
EBernhardson committed rWDAN268552babfa9: Import dym search satisfaction to druid (authored by EBernhardson).
Import dym search satisfaction to druid
Mon, Aug 5, 5:38 PM
EBernhardson edited P8862 TestSearchSatisfaction2_backfill_2019_08_01.py.
Mon, Aug 5, 5:20 PM · Discovery-Search
EBernhardson moved T229268: Build superset dashboard for search satisfaction did you mean metrics from Needs review to Done on the Discovery-Search (Current work) board.
Mon, Aug 5, 4:59 PM · Discovery-Search (Current work)
EBernhardson moved T229614: tons of errors on eventlogging events from Needs review to Done on the Discovery-Search (Current work) board.
Mon, Aug 5, 4:57 PM · MW-1.34-notes (1.34.0-wmf.17; 2019-08-06), Discovery-Search (Current work), Discovery, Analytics
EBernhardson added a comment to T229614: tons of errors on eventlogging events .

Backfill was done as follows, with guidance from https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging/Backfilling#Backfilling_a_kafka_eventlogging_%3CSchema%3E_topic

Mon, Aug 5, 4:57 PM · MW-1.34-notes (1.34.0-wmf.17; 2019-08-06), Discovery-Search (Current work), Discovery, Analytics
EBernhardson created P8862 TestSearchSatisfaction2_backfill_2019_08_01.py.
Mon, Aug 5, 4:33 PM · Discovery-Search

Fri, Aug 2

EBernhardson created T229675: some TestSearchSatisfaction2 events failing event validation.
Fri, Aug 2, 4:22 PM · Discovery-Search (Current work)

Thu, Aug 1

EBernhardson updated the task description for T229584: Run swift-object-expirer as part of the swift cluster.
Thu, Aug 1, 10:36 PM · Research-Backlog, Operations, Discovery, Analytics
EBernhardson moved T228496: EventBusMonologHandler: Malformed UTF-8 characters, possibly incorrectly encoded. Aborting send. from Needs review to Waiting/Blocked on the Discovery-Search (Current work) board.
Thu, Aug 1, 8:15 PM · MW-1.34-notes (1.34.0-wmf.17; 2019-08-06), Wikimedia-production-error, Discovery-Search (Current work), CirrusSearch
EBernhardson moved T229614: tons of errors on eventlogging events from in progress to Needs review on the Discovery-Search (Current work) board.
Thu, Aug 1, 8:14 PM · MW-1.34-notes (1.34.0-wmf.17; 2019-08-06), Discovery-Search (Current work), Discovery, Analytics
EBernhardson triaged T229614: tons of errors on eventlogging events as High priority.
Thu, Aug 1, 8:14 PM · MW-1.34-notes (1.34.0-wmf.17; 2019-08-06), Discovery-Search (Current work), Discovery, Analytics
EBernhardson added a comment to T229037: Phrase search should not match terms in different fields.

Actually, it looks like wikidata has two separate staements on Q30099997):

  • the use of social media by Donald Trump, 45th President of the United States
  • Donald Trump's use of social media...
Thu, Aug 1, 5:12 PM · Discovery-Search, Wikidata
EBernhardson added a comment to T229037: Phrase search should not match terms in different fields.

For Trump travel ban (Q30949469) we have:

english description: A travel ban by the 45th President of ***the United States, Donald*** J Trump",
Thu, Aug 1, 5:08 PM · Discovery-Search, Wikidata
EBernhardson created T229584: Run swift-object-expirer as part of the swift cluster.
Thu, Aug 1, 3:52 PM · Research-Backlog, Operations, Discovery, Analytics

Tue, Jul 30

EBernhardson added a comment to T220282: Investigate CirrusSearch as a Suggested Edits suggestions backend.

In a quick test over a few dozen queries it looks like this is faster than our existing ranking. On a rethink it makes sense, before we had to lookup various term statistics and perform rescore queries, but here we generate a random number for each visited document. Uploaded a patch that adds the random rescore functionality.

Tue, Jul 30, 9:26 PM · Patch-For-Review, MW-1.34-notes (1.34.0-wmf.4; 2019-05-07), Discovery-Search (Current work), Reading-Infrastructure-Team-Backlog (Kanban), WikimediaEditorTasks
EBernhardson added a comment to T229027: search of related images on wikidata (for structured data on commons).

I suppose there is also the significant terms aggregation, it's similar to the aggregation above but this tries to take into account the frequency in the total document collection vs the frequency in the result set. Essentially this orders structured data statements by how much more likely they are to be found in the result set vs the overall document collection:

Tue, Jul 30, 6:24 PM · Structured-Data-Backlog, Structured Data Engineering, SDC General, Wikidata, Discovery-Search
EBernhardson added a comment to T228063: Intermittent connect timeout for CirrusSearch connections.

It all depends on which code path gets the gateway timeout. Essentially all possible places cirrus talks to elasticsearch can end up erroring out. In terms of the most common code paths:

Tue, Jul 30, 6:04 PM · serviceops, Discovery-Search, CirrusSearch
EBernhardson moved T224324: LB for cloudelastic from Waiting/Blocked to in progress on the Discovery-Search (Current work) board.
Tue, Jul 30, 5:22 PM · Discovery-Search (Current work), Cloud-Services, Elasticsearch, Discovery
EBernhardson moved T228925: Fix documentation of boolean operators from in progress to Needs review on the Discovery-Search (Current work) board.
Tue, Jul 30, 5:21 PM · Discovery-Search (Current work)
EBernhardson added a comment to T229027: search of related images on wikidata (for structured data on commons).

Script used to collect above results. Note this needs access to elasticsearch directly as cirrussearch does not yet support this query: P8829

Tue, Jul 30, 4:30 PM · Structured-Data-Backlog, Structured Data Engineering, SDC General, Wikidata, Discovery-Search
EBernhardson created P8829 structured data aggregations on commons in elasticsearch.
Tue, Jul 30, 4:24 PM
EBernhardson closed T228063: Intermittent connect timeout for CirrusSearch connections, a subtask of T227691: Fatal from CirrusSearch\Job\LinksUpdate: "Call to a member function getLogVariables() on null", as Resolved.
Tue, Jul 30, 4:17 PM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Discovery-Search, CirrusSearch, Wikimedia-production-error
EBernhardson closed T228063: Intermittent connect timeout for CirrusSearch connections as Resolved.
Tue, Jul 30, 4:17 PM · serviceops, Discovery-Search, CirrusSearch
EBernhardson reopened T228063: Intermittent connect timeout for CirrusSearch connections, a subtask of T227691: Fatal from CirrusSearch\Job\LinksUpdate: "Call to a member function getLogVariables() on null", as Open.
Tue, Jul 30, 4:17 PM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Discovery-Search, CirrusSearch, Wikimedia-production-error
EBernhardson reopened T228063: Intermittent connect timeout for CirrusSearch connections as "Open".

Checked back into this and it's looking much better. july 16 had 2500 gateway timeouts per 12 hours, since deploying the highest 12 hour period is 250 gateway timeouts. Might be worth continuing to look into, but knocking this down an order of magnitude is probably sufficient.

Tue, Jul 30, 4:16 PM · serviceops, Discovery-Search, CirrusSearch
EBernhardson moved T216058: Spike. Load search data into turnilo to test whether exploratory data can do away with some of the dashboards from Waiting/Blocked to Done on the Discovery-Search (Current work) board.
Tue, Jul 30, 4:06 PM · Analytics-Kanban, Discovery-Search (Current work), Analytics
EBernhardson committed rWDAN3ad9232559c9: Use python3 for tox (authored by EBernhardson).
Use python3 for tox
Tue, Jul 30, 1:01 PM
EBernhardson committed rWDAN02fddbfc949b: Convert transfer_to_es to export over swift (authored by EBernhardson).
Convert transfer_to_es to export over swift
Tue, Jul 30, 8:59 AM
EBernhardson committed rEWLCfa9eb3cf1d02: Fix tests to use the dispatch service (authored by dcausse).
Fix tests to use the dispatch service
Tue, Jul 30, 12:47 AM
EBernhardson moved T228626: Extract interfaces and base classes from SearchResultSet and SearchResult from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Jul 30, 12:14 AM · MW-1.34-notes (1.34.0-wmf.20; 2019-08-27), Patch-For-Review, Discovery-Search (Current work), Discovery, CirrusSearch
EBernhardson moved T229215: CI fails for WikibaseLexemeCirrusSearch unit tests due to missing class exported by WikibaseLexeme from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Jul 30, 12:14 AM · MW-1.34-notes (1.34.0-wmf.16; 2019-07-30), Discovery-Search (Current work), CirrusSearch

Mon, Jul 29

EBernhardson moved T229268: Build superset dashboard for search satisfaction did you mean metrics from in progress to Needs review on the Discovery-Search (Current work) board.
Mon, Jul 29, 8:20 PM · Discovery-Search (Current work)
EBernhardson added a comment to T229268: Build superset dashboard for search satisfaction did you mean metrics.

Dashboard with daily dym metrics over last 7 days: https://superset.wikimedia.org/superset/dashboard/40/

Mon, Jul 29, 8:20 PM · Discovery-Search (Current work)
EBernhardson created T229268: Build superset dashboard for search satisfaction did you mean metrics.
Mon, Jul 29, 8:18 PM · Discovery-Search (Current work)
EBernhardson claimed T216058: Spike. Load search data into turnilo to test whether exploratory data can do away with some of the dashboards.

Evaluated with respect to our did you mean suggestions and this seems like a plausible path forward. Since this was only a spike will create a separate task to put together the appropriate oozie workflows to generate the data in an ongoing basis.

Mon, Jul 29, 8:14 PM · Analytics-Kanban, Discovery-Search (Current work), Analytics
EBernhardson updated subscribers of T229027: search of related images on wikidata (for structured data on commons).

@Ramsey-WMF This is basically what we can get "for free" from elasticsearch as related-structured data. Essentially this just counts and displays the top N structured data statements over the search results set.

Mon, Jul 29, 7:16 PM · Structured-Data-Backlog, Structured Data Engineering, SDC General, Wikidata, Discovery-Search
EBernhardson committed rECIR8ac391dbc415: Use auto expand replicas for templated index (authored by EBernhardson).
Use auto expand replicas for templated index
Mon, Jul 29, 3:48 PM
EBernhardson merged T229234: superset login failure: AttributeError: 'bool' object has no attribute 'login_count' into T229233: DCausse: can't log into Superset.
Mon, Jul 29, 2:58 PM · Analytics
EBernhardson merged task T229234: superset login failure: AttributeError: 'bool' object has no attribute 'login_count' into T229233: DCausse: can't log into Superset.
Mon, Jul 29, 2:58 PM · Analytics
EBernhardson created T229234: superset login failure: AttributeError: 'bool' object has no attribute 'login_count'.
Mon, Jul 29, 2:57 PM · Analytics

Thu, Jul 25

EBernhardson added a comment to T228981: Deletion of limn-flow-data repository.

I haven't worked with flow in 3 or 4 years, my understanding is no one is interested in these metrics and the future of structured discussions is something different. I think these are safe to be cleaned up.

Thu, Jul 25, 9:50 PM · Cleanup, Analytics
EBernhardson added a comment to T227257: Move refinery to hive 2 actions.

@EBernhardson hi! Can we restart the coordinators listed in https://gerrit.wikimedia.org/r/523212 to pick up the new changes?

Thu, Jul 25, 2:51 PM · Analytics-Kanban, User-Elukey, Analytics

Wed, Jul 24

EBernhardson added a comment to T227896: Make oozie swift upload emit event to Kafka about swift object upload complete.

I hadn't previously thought about re-publishing a new version of the same dataset. It does seem possible. For the purposes of my implementation the actual prefix is immaterial. The container is used to decide what kind of upload this is, the exact prefix is only an implementation detail.

Wed, Jul 24, 5:48 PM · Patch-For-Review, Analytics-Kanban, Research-Backlog, Operations, Discovery, Analytics
EBernhardson added a comment to T228226: Evaluate DYM metrics available in current search satisfaction logging.

Metrics we should use moving forward

Wed, Jul 24, 3:59 PM · Discovery-Search (Current work), Discovery

Tue, Jul 23

EBernhardson merged T224494: Add maint script to import data from swift to elasticsearch into T227364: Adjust mjolnir bulk_daemon to import glent swift uploads.
Tue, Jul 23, 6:17 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson merged task T224494: Add maint script to import data from swift to elasticsearch into T227364: Adjust mjolnir bulk_daemon to import glent swift uploads.
Tue, Jul 23, 6:17 PM · Discovery-Search, CirrusSearch
EBernhardson updated the task description for T227364: Adjust mjolnir bulk_daemon to import glent swift uploads.
Tue, Jul 23, 6:16 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson added a comment to T220637: [Bug] Unexpected result set returned by Elasticsearch.

We left this in waiting/blocked because we weren't sure there the 5xx's were coming from. It looks probable this has the same root cause as T228063, so closing this for now. Can re-open if the problem persists.

Tue, Jul 23, 6:09 PM · MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), Discovery-Search (Current work), Readers-Web-Backlog (Tracking), Elasticsearch, GeoData
EBernhardson added a comment to T228226: Evaluate DYM metrics available in current search satisfaction logging.

Followup will be in T216058 to test import the backing data into druid and evaluate if one of the druid interfaces can visualize our metrics.

Tue, Jul 23, 6:04 PM · Discovery-Search (Current work), Discovery
EBernhardson added a comment to T216058: Spike. Load search data into turnilo to test whether exploratory data can do away with some of the dashboards.

reference druid schema for mediawiki history: https://docs.google.com/document/d/1jzrE3xdyEHed4Ek5ORRedOlEeH-i111hdmG3tBTF8QU/edit#

Tue, Jul 23, 5:43 PM · Analytics-Kanban, Discovery-Search (Current work), Analytics
EBernhardson moved T228626: Extract interfaces and base classes from SearchResultSet and SearchResult from in progress to Needs review on the Discovery-Search (Current work) board.
Tue, Jul 23, 5:38 PM · MW-1.34-notes (1.34.0-wmf.20; 2019-08-27), Patch-For-Review, Discovery-Search (Current work), Discovery, CirrusSearch
EBernhardson moved T220637: [Bug] Unexpected result set returned by Elasticsearch from Waiting/Blocked to Done on the Discovery-Search (Current work) board.
Tue, Jul 23, 5:25 PM · MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), Discovery-Search (Current work), Readers-Web-Backlog (Tracking), Elasticsearch, GeoData
EBernhardson moved T227364: Adjust mjolnir bulk_daemon to import glent swift uploads from Needs review to in progress on the Discovery-Search (Current work) board.
Tue, Jul 23, 5:24 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T224324: LB for cloudelastic from Needs review to Waiting/Blocked on the Discovery-Search (Current work) board.
Tue, Jul 23, 5:20 PM · Discovery-Search (Current work), Cloud-Services, Elasticsearch, Discovery
EBernhardson moved T228226: Evaluate DYM metrics available in current search satisfaction logging from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Jul 23, 5:19 PM · Discovery-Search (Current work), Discovery

Jul 22 2019

EBernhardson committed rECIRb315ee0df17b: Use ISearchResultSet (authored by dcausse).
Use ISearchResultSet
Jul 22 2019, 10:13 PM
EBernhardson updated subscribers of T224324: LB for cloudelastic.

@Andrew Talked to @BBlack today and he said you two had talked about taking a different direction in terms of networking to expose bare metal services to cloud. The situation today is:

Jul 22 2019, 8:55 PM · Discovery-Search (Current work), Cloud-Services, Elasticsearch, Discovery
EBernhardson moved T228171: InvalidArgumentException: Invalid sort: last_edit_asc=1 from in progress to Needs review on the Discovery-Search (Current work) board.
Jul 22 2019, 7:16 PM · MW-1.34-notes (1.34.0-wmf.16; 2019-07-30), Discovery-Search (Current work), CirrusSearch, MediaWiki-Search, Wikimedia-production-error

Jul 20 2019

EBernhardson moved T227262: Adapt IndexLookupFallbackMethod for glent requirements from Needs review to Done on the Discovery-Search (Current work) board.
Jul 20 2019, 12:24 AM · MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Discovery-Search (Current work), CirrusSearch
EBernhardson moved T228226: Evaluate DYM metrics available in current search satisfaction logging from in progress to Needs review on the Discovery-Search (Current work) board.
Jul 20 2019, 12:23 AM · Discovery-Search (Current work), Discovery
EBernhardson claimed T228226: Evaluate DYM metrics available in current search satisfaction logging.
Jul 20 2019, 12:22 AM · Discovery-Search (Current work), Discovery