EBernhardson (EBernhardson)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 4:49 PM (217 w, 6 d)
Availability
Available
LDAP User
EBernhardson
MediaWiki User
EBernhardson (WMF) [ Global Accounts ]

Recent Activity

Fri, Dec 7

EBernhardson moved T208917: Build pipeline to transform elastic explains into feature vectors and a tf graph from Needs review to Done on the Discovery-Search (Current work) board.
Fri, Dec 7, 6:47 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson added a comment to T211033: Analyze wbsearchentities AB test from nov/doc.

Summary: Improved Clicks@1 from 80% to 84% with no change to abandonment rate of number of characters typed.

Fri, Dec 7, 4:43 PM · Discovery-Search (Current work), CirrusSearch, Wikidata, Discovery
EBernhardson moved T211033: Analyze wbsearchentities AB test from nov/doc from In progress to Done on the Discovery-Search (Current work) board.
Fri, Dec 7, 4:42 PM · Discovery-Search (Current work), CirrusSearch, Wikidata, Discovery
EBernhardson updated the name of F27421972: wbsearchentities nov 2018 AB test analysis.pdf from "wbsearchentities nov 2018 AB test analysis" to "wbsearchentities nov 2018 AB test analysis.pdf".
Fri, Dec 7, 4:42 PM

Thu, Dec 6

EBernhardson moved T211033: Analyze wbsearchentities AB test from nov/doc from Backlog to In progress on the Discovery-Search (Current work) board.
Thu, Dec 6, 9:56 PM · Discovery-Search (Current work), CirrusSearch, Wikidata, Discovery
EBernhardson added a comment to T210908: Regex to list all pages without internal links inside it while ignoring any [[Category:*]] links inside pages.

I'm not sure regex search can solve this problem. Due to the way we accelerate regex's in the backend it will be impossible for the suggested regex's to ever finish (basically the acceleration does nothing for these queries)

Thu, Dec 6, 7:07 PM · Discovery-Search, CirrusSearch
EBernhardson claimed T211033: Analyze wbsearchentities AB test from nov/doc.
Thu, Dec 6, 6:14 PM · Discovery-Search (Current work), CirrusSearch, Wikidata, Discovery
EBernhardson moved T211033: Analyze wbsearchentities AB test from nov/doc from Needs triage to Current work on the Discovery-Search board.
Thu, Dec 6, 6:14 PM · Discovery-Search (Current work), CirrusSearch, Wikidata, Discovery
EBernhardson moved T211306: Huge drop in search CTR as of Nov 30 2018 from Needs triage to Current work on the Discovery-Search board.
Thu, Dec 6, 6:12 PM · Discovery-Search (Current work), CirrusSearch

Wed, Dec 5

EBernhardson closed T211163: Cannot instantiate multiprocessing.RLock as Resolved.

Solved! I had to fully shutdown my jupyterhub-singleuser and restart it from the hub. After that multiprocessing looks to work as expected.

Wed, Dec 5, 8:15 PM · Patch-For-Review, Analytics, Analytics-SWAP
EBernhardson added a comment to T211163: Cannot instantiate multiprocessing.RLock.

I figured out how to get jupyterhub to inject strace in front of the kernel it runs, the appropriate part is:

stat("/usr/lib/python3.5/multiprocessing", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
stat("/usr/lib/python3.5/multiprocessing/synchronize.py", {st_mode=S_IFREG|0644, st_size=12052, ...}) = 0
stat("/usr/lib/python3.5/multiprocessing/synchronize.py", {st_mode=S_IFREG|0644, st_size=12052, ...}) = 0
open("/usr/lib/python3.5/multiprocessing/__pycache__/synchronize.cpython-35.pyc", O_RDONLY|O_CLOEXEC) = 39
statfs("/dev/shm/", {f_type=TMPFS_MAGIC, f_bsize=4096, f_blocks=8235303, f_bfree=8235303, f_bavail=8235303, f_files=8235303, f_ffree=8235302, f_fsid={val=[0, 0]}, f_namelen=255, f_frsize=4096, f_flags=ST_VALID|ST_RDONLY|ST_NOSUID|ST_NODEV}) = 0
lstat("/dev/shm/p3Razq", 0x7ffde34c3100) = -1 ENOENT (No such file or directory)
open("/dev/shm/p3Razq", O_RDWR|O_CREAT|O_EXCL, 0600) = -1 EROFS (Read-only file system)
Wed, Dec 5, 12:43 AM · Patch-For-Review, Analytics, Analytics-SWAP
EBernhardson added a comment to T211163: Cannot instantiate multiprocessing.RLock.

I can also note that PAWS is running the same version of jupyterhub as SWAP, that is 5.5.0. On PAWS multiprocessing.RLock works as expected. So this isn't specifically a jupyterhub issue, but something with the installation of it on the notebook servers?

Wed, Dec 5, 12:05 AM · Patch-For-Review, Analytics, Analytics-SWAP

Tue, Dec 4

EBernhardson created T211163: Cannot instantiate multiprocessing.RLock.
Tue, Dec 4, 11:47 PM · Patch-For-Review, Analytics, Analytics-SWAP

Mon, Dec 3

EBernhardson moved T210623: CirrusSearch dumps for the Norwegian Bokmål Wikipedia link to the Italian Wikipedia from In progress to Done on the Discovery-Search (Current work) board.
Mon, Dec 3, 8:31 PM · Discovery-Search (Current work), Dumps-Generation, CirrusSearch
EBernhardson added a comment to T210623: CirrusSearch dumps for the Norwegian Bokmål Wikipedia link to the Italian Wikipedia.

Looking at the dump itself, I can't find anything suspicious. I poked around to figure out what software they were likely using, it seems like: https://github.com/attardi/wikiextractor/blob/master/cirrus-extract.py

Mon, Dec 3, 8:29 PM · Discovery-Search (Current work), Dumps-Generation, CirrusSearch
EBernhardson added a comment to T210623: CirrusSearch dumps for the Norwegian Bokmål Wikipedia link to the Italian Wikipedia.

These were being sent to archive.org before, but looks like that stopped in may: https://archive.org/search.php?query=cirrussearch&sort=-publicdate

Mon, Dec 3, 8:20 PM · Discovery-Search (Current work), Dumps-Generation, CirrusSearch
EBernhardson claimed T210623: CirrusSearch dumps for the Norwegian Bokmål Wikipedia link to the Italian Wikipedia.
Mon, Dec 3, 8:00 PM · Discovery-Search (Current work), Dumps-Generation, CirrusSearch
EBernhardson moved T210623: CirrusSearch dumps for the Norwegian Bokmål Wikipedia link to the Italian Wikipedia from Backlog to In progress on the Discovery-Search (Current work) board.
Mon, Dec 3, 8:00 PM · Discovery-Search (Current work), Dumps-Generation, CirrusSearch
EBernhardson moved T210597: Broken elasticsearch-prometheus-exporter service on logstash nodes after reboot from In progress to Backlog on the Discovery-Search (Current work) board.
Mon, Dec 3, 8:00 PM · Discovery-Search (Current work), Elasticsearch, Operations
EBernhardson moved T210597: Broken elasticsearch-prometheus-exporter service on logstash nodes after reboot from Backlog to In progress on the Discovery-Search (Current work) board.
Mon, Dec 3, 8:00 PM · Discovery-Search (Current work), Elasticsearch, Operations
EBernhardson moved T143396: Display translated page title in search results from Waiting/Blocked to Backlog on the Discovery-Search (Current work) board.
Mon, Dec 3, 7:44 PM · Discovery-Search (Current work), Patch-For-Review, MediaWiki-Search, Discovery, MediaWiki-extensions-Translate
EBernhardson added a comment to T143396: Display translated page title in search results.

This should be about ready to be unblocked (timeline is right, we can't actually check how many pages have display_title currently, since it's not in the mappings). Deploying this requires an in-place reindex across all wikis which can take a week to run. For this reason we should try and coordinate this with any other mapping changes that need to go out.

Mon, Dec 3, 7:44 PM · Discovery-Search (Current work), Patch-For-Review, MediaWiki-Search, Discovery, MediaWiki-extensions-Translate
EBernhardson moved T204255: Introduce rewrite/second-try strategies from Needs review to Done on the Discovery-Search (Current work) board.
Mon, Dec 3, 7:33 PM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), MW-1.32-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, Discovery-Search (Current work), Discovery, CirrusSearch
EBernhardson moved T209402: A/B testing plan for wbsearchentities, context=item from Needs review to Done on the Discovery-Search (Current work) board.
Mon, Dec 3, 5:17 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)
EBernhardson removed a project from T211033: Analyze wbsearchentities AB test from nov/doc: Epic.
Mon, Dec 3, 5:17 PM · Discovery-Search (Current work), CirrusSearch, Wikidata, Discovery
EBernhardson triaged T211033: Analyze wbsearchentities AB test from nov/doc as Normal priority.
Mon, Dec 3, 5:17 PM · Discovery-Search (Current work), CirrusSearch, Wikidata, Discovery

Thu, Nov 29

EBernhardson added a comment to T210717: Find an alternative to HHVM curl connection pooling for PHP 7.

Throwing some ideas out there:

Thu, Nov 29, 6:42 PM · Discovery-Search, CirrusSearch, Operations
EBernhardson moved T210545: Repair transfer_to_es analytics job from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Nov 29, 5:56 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson assigned T208248: Intermittent json parse failures in comp suggest to dcausse.
Thu, Nov 29, 5:56 PM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), Discovery-Search (Current work), Patch-For-Review, Wikimedia-production-error
EBernhardson moved T208248: Intermittent json parse failures in comp suggest from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Nov 29, 5:56 PM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), Discovery-Search (Current work), Patch-For-Review, Wikimedia-production-error

Wed, Nov 28

EBernhardson added a comment to T210668: Elasticsearch health check for shards icinga check shows OK status when cluster health is yellow.

the problem is yellow cluster status is part of normal operations. For example when a new index is created the cluster first goes to yellow as only the primary exists, then the replicas get allocated and the cluster comes back to green.

Wed, Nov 28, 9:29 PM · Operations, Discovery-Search, Elasticsearch, monitoring
EBernhardson updated subscribers of T208248: Intermittent json parse failures in comp suggest.

@dcausse you might have an idea of how completion suggester could have no requests?

Wed, Nov 28, 9:27 PM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), Discovery-Search (Current work), Patch-For-Review, Wikimedia-production-error
EBernhardson added a comment to T208248: Intermittent json parse failures in comp suggest.

Rather than track this at the mediawiki level, i recorded all the http traffic coming into the eqiad search cluster, waited for some error messages to come in (~ 30 minutes) and then dug parse exceptions out of the req/response pairs.

Wed, Nov 28, 9:25 PM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), Discovery-Search (Current work), Patch-For-Review, Wikimedia-production-error
EBernhardson added a comment to T208917: Build pipeline to transform elastic explains into feature vectors and a tf graph.

Not sure it would be worth figuring out, but I realized while testing the deployed AB code that this model doesn't take into account how likely the user is to even see a set of suggestions. It assumes users see the results for each and every letter they type, while in the real world some users type the entire label before search comes back with a result. To check this I compared the number of characters actually typed vs expected in the eventlogging:

Wed, Nov 28, 2:49 AM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson added a comment to T209402: A/B testing plan for wbsearchentities, context=item.

Test is shipped out. 10% of english item searches will use the newly tuned parameters. Another 10% will use the classic SQL search. Test is intended to run one week, to be disabled on Dec 4.

Wed, Nov 28, 2:40 AM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)

Tue, Nov 27

EBernhardson added a comment to T209402: A/B testing plan for wbsearchentities, context=item.

This should be all ready to go. Will need to SWAT out the AB testing code from WikimediaEvents along with the testing configuration in mediawiki-config

Tue, Nov 27, 9:30 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)
EBernhardson updated the task description for T209402: A/B testing plan for wbsearchentities, context=item.
Tue, Nov 27, 9:29 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)
EBernhardson assigned T207195: Configure LVS endpoints for new elasticsearch clusters to Gehel.
Tue, Nov 27, 9:08 PM · Discovery-Search (Current work), Patch-For-Review
EBernhardson moved T210545: Repair transfer_to_es analytics job from Backlog to Needs review on the Discovery-Search (Current work) board.
Tue, Nov 27, 9:07 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson added a project to T210545: Repair transfer_to_es analytics job: Discovery-Search (Current work).
Tue, Nov 27, 9:06 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson created T210545: Repair transfer_to_es analytics job.
Tue, Nov 27, 9:06 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson closed T190963: search-mjolnir-tox-docker job in status ABORT somewhat regularly as Resolved.

seems reasonable lately. Lets call it good.

Tue, Nov 27, 7:19 PM · Continuous-Integration-Infrastructure (shipyard), Release-Engineering-Team
EBernhardson moved T174057: Namespaces are shown in the local language rather than in the user interface language from In progress to Backlog on the Discovery-Search (Current work) board.
Tue, Nov 27, 6:22 PM · Discovery-Search (Current work), MediaWiki-Interface, I18n
EBernhardson placed T174057: Namespaces are shown in the local language rather than in the user interface language up for grabs.
Tue, Nov 27, 6:22 PM · Discovery-Search (Current work), MediaWiki-Interface, I18n
EBernhardson moved T209402: A/B testing plan for wbsearchentities, context=item from In progress to Needs review on the Discovery-Search (Current work) board.
Tue, Nov 27, 6:21 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)
EBernhardson removed projects from T174057: Namespaces are shown in the local language rather than in the user interface language: MW-1.33-notes (1.33.0-wmf.4; 2018-11-13), Patch-For-Review.
Tue, Nov 27, 6:21 PM · Discovery-Search (Current work), MediaWiki-Interface, I18n
EBernhardson updated the name of F27316679: wbsearchentities tuning analysis.pdf from "wbsearchentities tuning analysis" to "wbsearchentities tuning analysis.pdf".
Tue, Nov 27, 4:15 PM
EBernhardson added a comment to T208917: Build pipeline to transform elastic explains into feature vectors and a tf graph.

There wasn't really a perfect ticket for this report, but the analysis of this first tuning run on item search in english is uploaded to phab: F27316679

Tue, Nov 27, 12:55 AM · Patch-For-Review, Discovery-Search (Current work)

Mon, Nov 26

EBernhardson added a comment to T209402: A/B testing plan for wbsearchentities, context=item.

Analysis of tuning process: F27315484

Mon, Nov 26, 6:29 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)

Fri, Nov 23

dcausse awarded P7837 (An Untitled Masterwork) a Yellow Medal token.
Fri, Nov 23, 8:40 AM

Thu, Nov 22

EBernhardson created P7837 (An Untitled Masterwork).
Thu, Nov 22, 9:47 PM

Wed, Nov 21

EBernhardson created P7835 wikis staying on the main elasticsearch cluster.
Wed, Nov 21, 4:45 PM
EBernhardson created T210095: Bulk elasticsearch update daemon in an omega/psi world.
Wed, Nov 21, 4:26 PM · Discovery-Search

Tue, Nov 20

EBernhardson added a comment to T157759: ElasticaWrite.php: Unsupported operand types error with CirrusSearch in runJobs.php.

I don't know if i appropriately coverted this above, but:

Tue, Nov 20, 5:22 PM · Discovery-Search, CirrusSearch, Discovery

Mon, Nov 19

EBernhardson updated the task description for T209859: Wikidata autocomplete (wbsearchentities) results with score <= 0.
Mon, Nov 19, 4:30 PM · Wikidata, Discovery-Search
EBernhardson updated the task description for T209859: Wikidata autocomplete (wbsearchentities) results with score <= 0.
Mon, Nov 19, 4:28 PM · Wikidata, Discovery-Search
EBernhardson created T209859: Wikidata autocomplete (wbsearchentities) results with score <= 0.
Mon, Nov 19, 4:28 PM · Wikidata, Discovery-Search

Thu, Nov 15

EBernhardson added a comment to T209621: Confirm perceived slowness in job queue for getting new captions available for searching in Commons.

This also depends on which jobs are triggered. Perhaps as a first step we should build a metric into cirrussearch that measures the actual time between when an edit was made and when we sent it to elasticsearch. The actual time it becomes available in search will be up to 30s after that moment (we won't know exactly when).

Thu, Nov 15, 7:01 PM · Discovery-Search (Current work)
EBernhardson moved T174057: Namespaces are shown in the local language rather than in the user interface language from Needs review to In progress on the Discovery-Search (Current work) board.
Thu, Nov 15, 5:01 PM · Discovery-Search (Current work), MediaWiki-Interface, I18n
EBernhardson moved T198352: Setup two elasticsearch clusters on relforge to test multi-instance from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Nov 15, 4:59 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T208255: Prefix search broken when using multiple namespaces and namespaces with $wgCapitalLinks = false; from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Nov 15, 4:59 PM · MW-1.31-release-notes, MW-1.33-notes (1.33.0-wmf.4; 2018-11-13), MW-1.32-notes, Patch-For-Review, Discovery-Search (Current work), User-Nikerabbit, MediaWiki-Search
EBernhardson moved T208650: Elastica dependencies need update to v5.3.2 from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Nov 15, 4:58 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Discovery-Search (Current work), Patch-For-Review, Elasticsearch
EBernhardson moved T208736: The experimental highlighter should not break unicode surrogate pairs when cutting the snippet. from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Nov 15, 4:58 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch
EBernhardson moved T209293: Prepare a deb package with the experimental highlighter 5.5.2.4 from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Nov 15, 4:58 PM · Patch-For-Review, Discovery-Search (Current work), Discovery
EBernhardson moved T209299: [Bug] Precondition failed: Trying to get token image at offset -1 from Needs review to Done on the Discovery-Search (Current work) board.
Thu, Nov 15, 4:58 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Patch-For-Review, Discovery-Search (Current work), Readers-Web-Backlog (Tracking), CirrusSearch

Tue, Nov 13

EBernhardson edited parent tasks for T209402: A/B testing plan for wbsearchentities, context=item, added: T193701: Explore using user clicks data to tune Wikidata search parameters; removed: T205111: [EPIC] Transform wikidata autocomplete click logs into a useful dataset.
Tue, Nov 13, 6:33 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)
EBernhardson added a subtask for T193701: Explore using user clicks data to tune Wikidata search parameters: T209402: A/B testing plan for wbsearchentities, context=item.
Tue, Nov 13, 6:33 PM · Discovery-Search (Current work), Epic, CirrusSearch, Wikidata, Discovery
EBernhardson removed a subtask for T205111: [EPIC] Transform wikidata autocomplete click logs into a useful dataset: T209402: A/B testing plan for wbsearchentities, context=item.
Tue, Nov 13, 6:33 PM · Discovery-Search (Current work), Epic
EBernhardson added a subtask for T193701: Explore using user clicks data to tune Wikidata search parameters: T205111: [EPIC] Transform wikidata autocomplete click logs into a useful dataset.
Tue, Nov 13, 6:32 PM · Discovery-Search (Current work), Epic, CirrusSearch, Wikidata, Discovery
EBernhardson added a parent task for T205111: [EPIC] Transform wikidata autocomplete click logs into a useful dataset: T193701: Explore using user clicks data to tune Wikidata search parameters.
Tue, Nov 13, 6:32 PM · Discovery-Search (Current work), Epic
EBernhardson moved T193701: Explore using user clicks data to tune Wikidata search parameters from Up Next to Current work on the Discovery-Search board.
Tue, Nov 13, 6:30 PM · Discovery-Search (Current work), Epic, CirrusSearch, Wikidata, Discovery
EBernhardson moved T209030: Fix elasticsearch_hot_threads on relforge (ImportError: No module named 'yaml') from In progress to Needs review on the Discovery-Search (Current work) board.
Tue, Nov 13, 6:23 PM · Discovery-Search (Current work)
EBernhardson moved T209030: Fix elasticsearch_hot_threads on relforge (ImportError: No module named 'yaml') from Tests & Analysis to In progress on the Discovery-Search (Current work) board.
Tue, Nov 13, 6:22 PM · Discovery-Search (Current work)
EBernhardson moved T209030: Fix elasticsearch_hot_threads on relforge (ImportError: No module named 'yaml') from Backlog to Tests & Analysis on the Discovery-Search (Current work) board.
Tue, Nov 13, 6:22 PM · Discovery-Search (Current work)
EBernhardson claimed T209402: A/B testing plan for wbsearchentities, context=item.
Tue, Nov 13, 6:19 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T209402: A/B testing plan for wbsearchentities, context=item from Backlog to In progress on the Discovery-Search (Current work) board.
Tue, Nov 13, 6:19 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)
EBernhardson added a comment to T209402: A/B testing plan for wbsearchentities, context=item.

For actually putting users into test buckets on the backend it looks like we will only need to modify the profile that comes back for {type=wikibase_prefix_querybuilder, context=wikibase_prefix_search}. Attaching an appropriate overrider should allow swapping out the name of the profile to use for one provided in the query string.

Tue, Nov 13, 6:12 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)
EBernhardson created T209402: A/B testing plan for wbsearchentities, context=item.
Tue, Nov 13, 5:59 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Wikidata, Patch-For-Review, Discovery-Search (Current work)

Sun, Nov 11

Liuxinyu970226 awarded T195071: Add chronological sorting by-page-creation-timestamp for search results a Love token.
Sun, Nov 11, 1:58 PM · MW-1.32-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), Discovery-Search (Current work), Patch-For-Review, Wikimedia-Hackathon-2018, Discovery, CirrusSearch

Nov 8 2018

EBernhardson moved T208650: Elastica dependencies need update to v5.3.2 from Backlog to Needs review on the Discovery-Search (Current work) board.
Nov 8 2018, 6:03 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Discovery-Search (Current work), Patch-For-Review, Elasticsearch
EBernhardson moved T208650: Elastica dependencies need update to v5.3.2 from Needs triage to Current work on the Discovery-Search board.
Nov 8 2018, 6:03 PM · MW-1.33-notes (1.33.0-wmf.6; 2018-11-27), Discovery-Search (Current work), Patch-For-Review, Elasticsearch
EBernhardson moved T209030: Fix elasticsearch_hot_threads on relforge (ImportError: No module named 'yaml') from Needs triage to Current work on the Discovery-Search board.
Nov 8 2018, 6:02 PM · Discovery-Search (Current work)

Nov 7 2018

EBernhardson created P7773 (An Untitled Masterwork).
Nov 7 2018, 10:51 PM
EBernhardson added a comment to T208917: Build pipeline to transform elastic explains into feature vectors and a tf graph.

I've run this a few times with a few different settings. All inputs start with the set of all logged english wikidata item autocompletes for october. Some configurations:

Nov 7 2018, 9:03 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T208917: Build pipeline to transform elastic explains into feature vectors and a tf graph from Backlog to Needs review on the Discovery-Search (Current work) board.
Nov 7 2018, 8:53 PM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson updated subscribers of T208932: Job cirrusSearchLinksUpdate: Failed creating job from description ("Page does not exist").
Nov 7 2018, 7:02 AM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Wikimedia-production-error
EBernhardson created T208917: Build pipeline to transform elastic explains into feature vectors and a tf graph.
Nov 7 2018, 12:33 AM · Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T205348: Calculate autocomplete examination probabilities from eventlogging data from Needs review to Done on the Discovery-Search (Current work) board.
Nov 7 2018, 12:30 AM · MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson moved T205348: Calculate autocomplete examination probabilities from eventlogging data from In progress to Needs review on the Discovery-Search (Current work) board.
Nov 7 2018, 12:30 AM · MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Patch-For-Review, Discovery-Search (Current work)
EBernhardson added a comment to T208830: Mail from/to discourse.wmflabs.org not working.

I didn't intend to, but must have reset this while cleaning up other things. I've reset this to a new randomized password via 2FA and updated settings in discourse. Please verify this fixes things.

Nov 7 2018, 12:07 AM · Cloud-Services, Discourse

Nov 6 2018

EBernhardson moved T189880: Introduce SearchQuery from Needs review to Done on the Discovery-Search (Current work) board.
Nov 6 2018, 6:19 PM · MW-1.33-notes (1.33.0-wmf.4; 2018-11-13), Patch-For-Review, Discovery-Search (Current work), Discovery, CirrusSearch

Nov 2 2018

EBernhardson moved T204686: cloudvps: search project trusty deprecation from Backlog to Done on the Discovery-Search (Current work) board.
Nov 2 2018, 8:16 PM · Discovery-Search (Current work), User-Smalyshev, Cloud-VPS (Ubuntu Trusty Deprecation)
EBernhardson updated the task description for T204686: cloudvps: search project trusty deprecation.
Nov 2 2018, 8:15 PM · Discovery-Search (Current work), User-Smalyshev, Cloud-VPS (Ubuntu Trusty Deprecation)
EBernhardson added a comment to T204686: cloudvps: search project trusty deprecation.

rel.search.eqiad.wmflabs runs discernatron.wmflabs.org. I'll see about moving it

Nov 2 2018, 6:10 PM · Discovery-Search (Current work), User-Smalyshev, Cloud-VPS (Ubuntu Trusty Deprecation)

Oct 31 2018

EBernhardson added a comment to T208467: Of the deployment-elastic instances, only 1 appears to be listening on the port MW expects to talk to.

Restarted nginx on both servers, they are now listening. Not sure why nginx was running but not listening.

Oct 31 2018, 8:55 PM · Beta-Cluster-Infrastructure
EBernhardson added a comment to T208248: Intermittent json parse failures in comp suggest.

Solution at this point will be to add additional logging to the CirrusSearch request pipeline. Any request that results in a parsing error should have it's request body logged so we can track down what the invalid thing was.

Oct 31 2018, 3:39 PM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), Discovery-Search (Current work), Patch-For-Review, Wikimedia-production-error
EBernhardson added a comment to T208248: Intermittent json parse failures in comp suggest.

logs: https://logstash.wikimedia.org/goto/ae616e77702e7f7f54510be60b01f4fb

Oct 31 2018, 3:31 PM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), Discovery-Search (Current work), Patch-For-Review, Wikimedia-production-error

Oct 30 2018

EBernhardson moved T205348: Calculate autocomplete examination probabilities from eventlogging data from Waiting/Blocked to In progress on the Discovery-Search (Current work) board.
Oct 30 2018, 5:35 PM · MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Patch-For-Review, Discovery-Search (Current work)

Oct 29 2018

EBernhardson added a comment to T201184: CirrusSearch jobs sometimes fail with "RemexHtml\Tokenizer\Tokenizer: pcre.backtrack_limit exhausted".

Looking over the last week of logs, these only seem to occur in cases of vandalism that create very non-standard wikitext pages. In principle, what is the desired outcome here?

Oct 29 2018, 9:25 PM · Core Platform Team Kanban (Done with CPT), Core Platform Team (Security, stability, performance and scalability (TEC1)), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Wikimedia-production-error, RemexHtml
EBernhardson moved T205558: Sister search / Cross-language search interaction with multicluster from Needs review to Done on the Discovery-Search (Current work) board.
Oct 29 2018, 8:51 PM · MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Patch-For-Review, Discovery-Search (Current work)