Smalyshev (Stas Malyshev)
Engineer in Discovery team

Projects (8)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Nov 28 2014, 7:04 AM (155 w, 4 d)
Availability
Available
IRC Nick
Smalyshev
LDAP User
Smalyshev
MediaWiki User
Smalyshev (WMF)

Recent Activity

Yesterday

Smalyshev moved T181016: Implement namespace aliases from In progress to Needs review on the Discovery-Wikidata-Query-Service-Sprint board.
Tue, Nov 21, 11:07 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev updated subscribers of T181106: Advanced search UI looks bad with Timeless skin.
Tue, Nov 21, 11:04 PM · Timeless, TCB-Team, Advanced-Search
Smalyshev added a comment to T181106: Advanced search UI looks bad with Timeless skin.

Tue, Nov 21, 11:03 PM · Timeless, TCB-Team, Advanced-Search
Smalyshev created T181106: Advanced search UI looks bad with Timeless skin.
Tue, Nov 21, 11:03 PM · Timeless, TCB-Team, Advanced-Search
Smalyshev moved T181016: Implement namespace aliases from Backlog to In progress on the Discovery-Wikidata-Query-Service-Sprint board.
Tue, Nov 21, 1:04 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev claimed T181016: Implement namespace aliases.
Tue, Nov 21, 1:04 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev created T181016: Implement namespace aliases.
Tue, Nov 21, 1:03 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service

Sat, Nov 18

Smalyshev moved T173980: Include hidden status in category RDF from Doing to Waiting on the User-Smalyshev board.
Sat, Nov 18, 12:25 AM · Patch-For-Review, User-Smalyshev, Wikidata, Discovery, Wikidata-Query-Service

Fri, Nov 17

Smalyshev moved T162371: Benchmark RDF dump with foreign ID mapping from Next to Waiting on the User-Smalyshev board.
Fri, Nov 17, 10:48 PM · User-WMDE-leszek, User-Smalyshev, User-Ladsgroup, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev moved T173980: Include hidden status in category RDF from Waiting to Doing on the User-Smalyshev board.
Fri, Nov 17, 8:58 PM · Patch-For-Review, User-Smalyshev, Wikidata, Discovery, Wikidata-Query-Service
Smalyshev moved T173980: Include hidden status in category RDF from Next to Waiting on the User-Smalyshev board.
Fri, Nov 17, 8:58 PM · Patch-For-Review, User-Smalyshev, Wikidata, Discovery, Wikidata-Query-Service
Smalyshev added a comment to T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query.

@Mahir256 Please note wmf.8 is still not deployed on www.wikidata.org - see https://phabricator.wikimedia.org/T178635.

Fri, Nov 17, 8:51 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata

Thu, Nov 16

Smalyshev added a comment to T175380: Queries with wikibase:statements or wikibase:sitelinks are slow.

The first query essentially has to go through all 38 millions of items and sort sitelink values for them. I don't think this can be done efficiently.

Thu, Nov 16, 6:30 AM · Discovery, Wikidata-Query-Service, Wikidata
Smalyshev moved T178851: Use label & description index for fulltext search from In progress to Needs review on the Discovery-Search (Current work) board.
Thu, Nov 16, 1:25 AM · User-Smalyshev, Patch-For-Review, Discovery, Discovery-Search (Current work), Wikidata
Smalyshev added a comment to T176593: Reload WDQS dataset.

Reload is now done.

Thu, Nov 16, 12:11 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev closed T176593: Reload WDQS dataset as Resolved.
Thu, Nov 16, 12:11 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev moved T176593: Reload WDQS dataset from In progress to Done on the Discovery-Wikidata-Query-Service-Sprint board.
Thu, Nov 16, 12:10 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Discovery, Wikidata, Wikidata-Query-Service

Wed, Nov 15

Smalyshev closed T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities as Resolved.

Should be fine now (requires new edit or reindex for missed ones, of course).

Wed, Nov 15, 8:57 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-extensions-WikibaseRepository, Elasticsearch, Regression, Wikidata, Discovery
Smalyshev closed T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities, a subtask of T46529: Wikidata search problems (tracking), as Resolved.
Wed, Nov 15, 8:57 PM · Wikidata, Tracking, Wikidata.org
Smalyshev closed T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query as Resolved.
Wed, Nov 15, 8:56 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev closed T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query, a subtask of T46529: Wikidata search problems (tracking), as Resolved.
Wed, Nov 15, 8:56 PM · Wikidata, Tracking, Wikidata.org
Smalyshev added a comment to T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query.

Seems to be working ok on test.wikidata.org, so closing. If it fails on wikidata when the train moves on, please reopen.

Wed, Nov 15, 8:55 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev added a comment to T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query.

@thiemowmde I think it should fix it but can't check since it's not deployed yet (not even on test). So I'd like to keep it open until we can verify the problem is indeed gone.

Wed, Nov 15, 6:32 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev added a comment to T162371: Benchmark RDF dump with foreign ID mapping.

I believe 1.5% slowdown is acceptable for the functionality. I will review the code soon and add my comments.

Wed, Nov 15, 6:03 PM · User-WMDE-leszek, User-Smalyshev, User-Ladsgroup, MediaWiki-extensions-WikibaseRepository, Wikidata

Tue, Nov 14

Smalyshev added a comment to T180539: wmf.8 still on old Wikidata branch.

make-wmf-branch's config.json requires manual updating

Tue, Nov 14, 11:46 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), User-Addshore, Patch-For-Review, Wikidata
Smalyshev created T180539: wmf.8 still on old Wikidata branch.
Tue, Nov 14, 11:19 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), User-Addshore, Patch-For-Review, Wikidata
Smalyshev added a comment to T179850: Run analysis of WDQS internal and external traffic.

do you have a list of bots that you've created or some that you know of?

Tue, Nov 14, 11:01 PM · Discovery, Discovery-Analysis (Current work), Discovery-Search (Current work)
Smalyshev moved T125500: [Epic] Index Wikidata labels and descriptions as separate fields in ElasticSearch from In progress to Needs review on the Discovery-Search (Current work) board.
Tue, Nov 14, 6:14 PM · Epic, Discovery-Search (Current work), Wikidata-Sprint-2016-08-02, Wikidata-Sprint-2016-07-19, Wikidata-Sprint-2016-07-05, Wikidata-Sprint-2016-05-24, Wikidata-Sprint-2016-05-10, Patch-For-Review, Wikidata-Sprint-2016-04-26, Wikidata-Sprint-2016-04-12, Wikidata-Sprint-2016-03-01, Wikidata-Sprint-2016-02-16, Wikidata, Discovery, CirrusSearch, Wikidata-Sprint-2016-02-02
Smalyshev moved T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Nov 14, 5:51 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev moved T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities from Needs review to Done on the Discovery-Search (Current work) board.
Tue, Nov 14, 5:51 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-extensions-WikibaseRepository, Elasticsearch, Regression, Wikidata, Discovery
Smalyshev moved T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities from Backlog to Needs review on the Discovery-Search (Current work) board.
Tue, Nov 14, 8:12 AM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-extensions-WikibaseRepository, Elasticsearch, Regression, Wikidata, Discovery
Smalyshev added a comment to T179850: Run analysis of WDQS internal and external traffic.

From the first graph I conclude the internal traffic is about 0.2-0.5 of the external one. Which means 3 or even 2 servers could serve it without much trouble, maybe even if we relax timeouts a bit. We also get some LDF traffic, but not too much, which means either keeping LDF server the same place or having another, internal, LDF server, is OK, but LDF is not really too popular with internal clients and running it off single server is ok.

Tue, Nov 14, 6:12 AM · Discovery, Discovery-Analysis (Current work), Discovery-Search (Current work)
Smalyshev added a parent task for T179850: Run analysis of WDQS internal and external traffic: Unknown Object (Task).
Tue, Nov 14, 2:04 AM · Discovery, Discovery-Analysis (Current work), Discovery-Search (Current work)
Smalyshev updated subscribers of T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities.

@dcausse can it be that we need to add noop hints for description field too?

Tue, Nov 14, 12:58 AM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-extensions-WikibaseRepository, Elasticsearch, Regression, Wikidata, Discovery

Mon, Nov 13

Smalyshev moved T179068: Support time zones in xsd:dateTime from All WDQS-related tasks to Ready for work on the Wikidata-Query-Service board.
Mon, Nov 13, 10:49 PM · Wikidata, Wikidata-primary-sources, Wikidata-Query-Service, Discovery
Smalyshev moved T179239: Make shorter timeout for Wikibase fetches from All WDQS-related tasks to Ready for work on the Wikidata-Query-Service board.
Mon, Nov 13, 10:47 PM · Discovery, Wikidata, Wikidata-Query-Service
Smalyshev triaged T180314: WDQS geof:distance() throws an error on some P625 value as Normal priority.
Mon, Nov 13, 10:46 PM · Patch-For-Review, Discovery, Wikidata-Query-Service, Wikidata
Smalyshev moved T180314: WDQS geof:distance() throws an error on some P625 value from All WDQS-related tasks to Ready for work on the Wikidata-Query-Service board.
Mon, Nov 13, 10:44 PM · Patch-For-Review, Discovery, Wikidata-Query-Service, Wikidata
Smalyshev moved T179991: Add a geo lookup service to WDQS based on the .map pages on Commons from All WDQS-related tasks to Need investigation on the Wikidata-Query-Service board.
Mon, Nov 13, 10:43 PM · Commons-Datasets, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev moved T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities from Needs triage to Current work on the Discovery-Search board.
Mon, Nov 13, 6:31 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Discovery-Search (Current work), MediaWiki-extensions-WikibaseRepository, Elasticsearch, Regression, Wikidata, Discovery
Smalyshev added a comment to T179991: Add a geo lookup service to WDQS based on the .map pages on Commons.

Also see https://wiki.blazegraph.com/wiki/index.php/QueryHints (esp. runFirst and runLast) for the way to control when service runs (you probably want runLast).

Mon, Nov 13, 8:55 AM · Commons-Datasets, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a comment to T179991: Add a geo lookup service to WDQS based on the .map pages on Commons.

Probably can be done as a service:

Mon, Nov 13, 8:53 AM · Commons-Datasets, Discovery, Wikidata, Wikidata-Query-Service

Sat, Nov 11

Smalyshev closed T172798: allow wdqs-admins to pool / depool wdqs servers as Resolved.

HOME=/root sudo depool seems to be working.

Sat, Nov 11, 2:30 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Discovery, Operations, Wikidata, Ops-Access-Requests

Fri, Nov 10

WalterKlossew awarded T112715: Enable different URL shorteners for WDQS a Cup of Joe token.
Fri, Nov 10, 8:57 AM · Discovery, Wikidata, Wikidata-Query-Service
Smalyshev moved T176593: Reload WDQS dataset from Backlog to In progress on the Discovery-Wikidata-Query-Service-Sprint board.
Fri, Nov 10, 8:24 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev closed T175948: Add normalized predicates to Blazegraph vocabulary as Resolved.
Fri, Nov 10, 8:23 AM · Patch-For-Review, User-Smalyshev, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a project to T176593: Reload WDQS dataset: Discovery-Wikidata-Query-Service-Sprint.
Fri, Nov 10, 8:23 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a comment to T172798: allow wdqs-admins to pool / depool wdqs servers.

@Dzahn it asks me for password then.

Fri, Nov 10, 8:20 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Discovery, Operations, Wikidata, Ops-Access-Requests
Smalyshev reopened T172798: allow wdqs-admins to pool / depool wdqs servers as "Open".

Doesn't look like it is working:

Fri, Nov 10, 7:36 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Discovery, Operations, Wikidata, Ops-Access-Requests
Smalyshev added a comment to T180048: Wikidata dump significantly slower than before.

I suspect something else than data growth is to blame here. As I said, the size changed by less than 1.5% since last week, but the dump time grew by 21 hours. The previous dump started on Monday at 23:00 and finished Wed 00:56 - 26 hours. The last one started, again, on Monday at 23:00 and Wed 22:19 - 47 hours. That's 80% growth in time for 1.5% growth in size. So I don't think size is the reason.

Fri, Nov 10, 2:27 AM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Dumps-Generation, Wikidata
Smalyshev triaged T179068: Support time zones in xsd:dateTime as Normal priority.

Supporting +00:00 would be easy. Supporting other TZs a bit harder I imagine.

Fri, Nov 10, 12:14 AM · Wikidata, Wikidata-primary-sources, Wikidata-Query-Service, Discovery

Thu, Nov 9

Smalyshev closed T180169: Make list of languages where using stemmed analyzer for Wikibase is beneficial as Resolved.

Thank you @TJones I think this is exactly what I needed.

Thu, Nov 9, 11:52 PM · MediaWiki-extensions-WikibaseRepository, Wikidata, Discovery-Search (Current work), Discovery
Smalyshev closed T180169: Make list of languages where using stemmed analyzer for Wikibase is beneficial, a subtask of T176903: Index wikidata descriptions, as Resolved.
Thu, Nov 9, 11:52 PM · Wikidata-Former-Sprint-Board, MediaWiki-extensions-WikibaseRepository, Wikidata, Patch-For-Review, Discovery-Search (Current work), Discovery
Smalyshev created T180177: Move wikidata dump generation 3 days ahead (or 4 days after).
Thu, Nov 9, 11:07 PM · Dumps-Generation, Wikidata
Smalyshev placed T180169: Make list of languages where using stemmed analyzer for Wikibase is beneficial up for grabs.

@TJones this is something you may want to look at I think :)

Thu, Nov 9, 9:58 PM · MediaWiki-extensions-WikibaseRepository, Wikidata, Discovery-Search (Current work), Discovery
Smalyshev updated the task description for T180169: Make list of languages where using stemmed analyzer for Wikibase is beneficial.
Thu, Nov 9, 9:57 PM · MediaWiki-extensions-WikibaseRepository, Wikidata, Discovery-Search (Current work), Discovery
Smalyshev updated subscribers of T180169: Make list of languages where using stemmed analyzer for Wikibase is beneficial.
Thu, Nov 9, 9:24 PM · MediaWiki-extensions-WikibaseRepository, Wikidata, Discovery-Search (Current work), Discovery
Smalyshev renamed T180169: Make list of languages where using stemmed analyzer for Wikibase is beneficial from Make list of languages where using custom analyzer for Wikibase is beneficial to Make list of languages where using stemmed analyzer for Wikibase is beneficial.
Thu, Nov 9, 9:23 PM · MediaWiki-extensions-WikibaseRepository, Wikidata, Discovery-Search (Current work), Discovery
Smalyshev created T180169: Make list of languages where using stemmed analyzer for Wikibase is beneficial.
Thu, Nov 9, 9:23 PM · MediaWiki-extensions-WikibaseRepository, Wikidata, Discovery-Search (Current work), Discovery
Smalyshev renamed T180048: Wikidata dump significantly slower than before from Wikidata dump either significantly slower or broken to Wikidata dump significantly slower than before.
Thu, Nov 9, 7:35 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Dumps-Generation, Wikidata
Smalyshev added a comment to T180048: Wikidata dump significantly slower than before.

The dump finally finished at 08-Nov-2017 22:19 for .gz, ws. 1-Nov-2017 00:56 for previous week. That's 21 hours slower than the previous week, with size 27577365639 vs. 27211647006 - less than 1.5% increase. Something has definitely changed.

Thu, Nov 9, 7:34 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Dumps-Generation, Wikidata

Wed, Nov 8

Smalyshev added a comment to T180048: Wikidata dump significantly slower than before.

So it's basically the same data size - the difference is less than 1% in size. However, the generation takes much longer than before - something is not working like it should be.

Wed, Nov 8, 10:02 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Dumps-Generation, Wikidata
Smalyshev removed a project from T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query: Patch-For-Review.
Wed, Nov 8, 7:03 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev moved T176903: Index wikidata descriptions from In progress to Needs review on the Discovery-Search (Current work) board.
Wed, Nov 8, 5:56 PM · Wikidata-Former-Sprint-Board, MediaWiki-extensions-WikibaseRepository, Wikidata, Patch-For-Review, Discovery-Search (Current work), Discovery
Smalyshev created T180048: Wikidata dump significantly slower than before.
Wed, Nov 8, 4:41 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, Dumps-Generation, Wikidata
Eloquence awarded T177275: Add ordinal variable to MWAPI service calls a Party Time token.
Wed, Nov 8, 8:22 AM · Patch-For-Review, User-Smalyshev, Discovery, Wikidata-Query-Service, Wikidata

Tue, Nov 7

Smalyshev moved T162371: Benchmark RDF dump with foreign ID mapping from Waiting to Next on the User-Smalyshev board.
Tue, Nov 7, 6:28 PM · User-WMDE-leszek, User-Smalyshev, User-Ladsgroup, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev placed T93213: Improve access to local language wikis by fixing bug in generation of hreflang tags in <head> of article pages up for grabs.
Tue, Nov 7, 6:26 PM · SEO, Patch-For-Review, MediaWiki-Internationalization, I18n
Smalyshev placed T151436: Country admin-levels as a graph up for grabs.
Tue, Nov 7, 6:25 PM · Discovery
Smalyshev closed T179453: Wikibase prefix search does not find other language label as Resolved.
Tue, Nov 7, 6:17 PM · MW-1.31-release-notes (WMF-deploy-2017-11-07 (1.31.0-wmf.7)), Patch-For-Review, Discovery-Search (Current work), Wikidata
Smalyshev changed the status of T179681: Add HDT dump of Wikidata from Open to Stalled.
Tue, Nov 7, 5:55 PM · Wikidata
Smalyshev moved T176593: Reload WDQS dataset from Backlog to Doing on the User-Smalyshev board.
Tue, Nov 7, 8:02 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev closed T177275: Add ordinal variable to MWAPI service calls as Resolved.
Tue, Nov 7, 7:59 AM · Patch-For-Review, User-Smalyshev, Discovery, Wikidata-Query-Service, Wikidata
Smalyshev updated the task description for T177275: Add ordinal variable to MWAPI service calls.
Tue, Nov 7, 7:59 AM · Patch-For-Review, User-Smalyshev, Discovery, Wikidata-Query-Service, Wikidata
Smalyshev edited projects for T179091: Add case-insensitive title match capability for Wikidata search, added: Technical-Debt; removed Regression.
Tue, Nov 7, 7:53 AM · Technical-Debt, MediaWiki-extensions-WikibaseRepository, User-Smalyshev, Wikidata, Discovery-Search
Smalyshev moved T176593: Reload WDQS dataset from All WDQS-related tasks to Ready for work on the Wikidata-Query-Service board.
Tue, Nov 7, 7:51 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev moved T178978: Include information about Wikidata dumps in Wikidata query service from All WDQS-related tasks to Ready for work on the Wikidata-Query-Service board.
Tue, Nov 7, 7:51 AM · Internet-Archive, Wikidata-Query-Service, Discovery, Wikidata

Mon, Nov 6

Smalyshev updated subscribers of T179879: Provide a 5-minute timeout in WDQS for trusted users using OAuth.
Mon, Nov 6, 10:47 PM · Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a comment to T178492: Create a more controlled WDQS cluster.

I think for now limiting it by IP should probably work? I think IP ranges from production hosts, labs and outside are segregated?

Mon, Nov 6, 7:30 PM · Services (watching), Discovery, Wikidata, Structured-Data-Commons, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service
Smalyshev closed T178533: Find out why nginx log in logstash has no 429s as Resolved.
Mon, Nov 6, 7:28 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service

Sun, Nov 5

Smalyshev added a comment to T162371: Benchmark RDF dump with foreign ID mapping.

The benchmark looks pretty good. I'll review the patches a bit later (I have a cold right now and it's hard for me to concentrate) and if the code is OK I see no reason not to merge it. We could also do another xhprof run before that to see if there are any other things we could improve.

Sun, Nov 5, 12:06 AM · User-WMDE-leszek, User-Smalyshev, User-Ladsgroup, MediaWiki-extensions-WikibaseRepository, Wikidata

Sat, Nov 4

Smalyshev triaged T178978: Include information about Wikidata dumps in Wikidata query service as Normal priority.
Sat, Nov 4, 12:57 AM · Internet-Archive, Wikidata-Query-Service, Discovery, Wikidata

Fri, Nov 3

Smalyshev claimed T178533: Find out why nginx log in logstash has no 429s.
Fri, Nov 3, 11:51 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev moved T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query from Backlog to Waiting on the User-Smalyshev board.
Fri, Nov 3, 11:50 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev moved T177275: Add ordinal variable to MWAPI service calls from Backlog to Doing on the User-Smalyshev board.
Fri, Nov 3, 11:50 PM · Patch-For-Review, User-Smalyshev, Discovery, Wikidata-Query-Service, Wikidata
Smalyshev added a project to T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query: User-Smalyshev.
Fri, Nov 3, 11:50 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev updated subscribers of T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query.

@Snaterlicious, @hoo, @thiemowmde Do you know why the check is there and what it meant to be doing? @tstarling raised the following concern:

Fri, Nov 3, 11:49 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev updated subscribers of T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query.
Fri, Nov 3, 11:46 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Wikidata-Former-Sprint-Board, User-Smalyshev, Discovery-Search (Current work), ValueView, MediaWiki-extensions-WikibaseRepository, Wikidata
Smalyshev moved T178533: Find out why nginx log in logstash has no 429s from Backlog to Needs review on the Discovery-Wikidata-Query-Service-Sprint board.
Fri, Nov 3, 11:35 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a comment to T178533: Find out why nginx log in logstash has no 429s.

Looks like I found the reason - we use proxy_intercept_errors which sends 429 to separate location block, and that block does not have logstash access log configured.

Fri, Nov 3, 11:32 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a comment to T178533: Find out why nginx log in logstash has no 429s.

From my tests on wdqs-test, looks like 429 is reported to /var/log/nginx/access.log but not into logstash or access log that is inside SPARQL location clause. Not sure why is that.

Fri, Nov 3, 11:27 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a comment to T179681: Add HDT dump of Wikidata.

it doesn’t even open the output file until it’s done converting

Fri, Nov 3, 11:02 PM · Wikidata
Smalyshev added a comment to T174298: Figure out a way for WDQS example parsing not rely on parsoid.

manually doing regex-style parsing of Wiki markup in JavaScript is a guaranteed path to hell

Fri, Nov 3, 10:41 PM · Patch-For-Review, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a comment to T178721: WDQS tests unstable with some thread leak errors.

@Gehel, do you have any thoughts on this?

Fri, Nov 3, 9:51 PM · Discovery-Wikidata-Query-Service-Sprint, Discovery, Wikidata, Wikidata-Query-Service
Smalyshev added a project to T177275: Add ordinal variable to MWAPI service calls: User-Smalyshev.
Fri, Nov 3, 12:00 AM · Patch-For-Review, User-Smalyshev, Discovery, Wikidata-Query-Service, Wikidata

Thu, Nov 2

Smalyshev removed a project from T178445: flapping monitoring for recommendation_api on scb: Wikidata-Query-Service.
Thu, Nov 2, 11:01 PM · Discovery, Recommendation-API, Services (watching), Wikidata, Operations, monitoring
Smalyshev added a comment to T178978: Include information about Wikidata dumps in Wikidata query service.

There's a bit of a problem here because technically WDQS dataset is not the same as any dump. It is live-updated, unlike dump that is updated once a week, and WDQS data set could be loaded from dump months ago and live-updated sine then, so WDQS has no way of knowing if there are any dumps that happened after that and where they can be found. We could just import https://dumps.wikimedia.org/wikidatawiki/entities/dcatap.rdf but I am not sure how useful that would be and what is the difference between that and just having it for downloading. Is it just because we could query it over SPARQL if we load it?

Thu, Nov 2, 10:59 PM · Internet-Archive, Wikidata-Query-Service, Discovery, Wikidata
Smalyshev moved T179228: geoPrecision exported to RDF as decimal, but is in fact float from GUI to Wikidata on the Wikidata-Query-Service board.
Thu, Nov 2, 10:50 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, User-Smalyshev, Wikidata-Query-Service, Discovery, Wikidata
Smalyshev moved T179228: geoPrecision exported to RDF as decimal, but is in fact float from All WDQS-related tasks to GUI on the Wikidata-Query-Service board.
Thu, Nov 2, 10:50 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, User-Smalyshev, Wikidata-Query-Service, Wikidata, Discovery
Smalyshev moved T179262: wikibase-docker wdqs-frontend The example button leads to the examples from Wikidata from All WDQS-related tasks to GUI on the Wikidata-Query-Service board.
Thu, Nov 2, 10:50 PM · User-Addshore, Wikibase-Containers, Wikidata-Query-Service, Discovery, Wikidata