Page MenuHomePhabricator

Mstyles (Maryum)
User

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Nov 18 2019, 7:30 PM (36 w, 6 d)
Availability
Available
LDAP User
Mstyles
MediaWiki User
MStyles (WMF) [ Global Accounts ]

Recent Activity

Wed, Jul 29

Mstyles placed T251515: Automate data reload for SPARQL Endpoint for Commons up for grabs.
Wed, Jul 29, 3:38 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Mon, Jul 27

Mstyles moved T256875: The streaming updater should support page deletions from Incoming to In Progress on the Discovery-Search (Current work) board.
Mon, Jul 27, 5:15 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Mstyles added a project to T256875: The streaming updater should support page deletions: Discovery-Search (Current work).
Mon, Jul 27, 5:15 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Mstyles claimed T256875: The streaming updater should support page deletions.
Mon, Jul 27, 5:14 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Mstyles closed T251515: Automate data reload for SPARQL Endpoint for Commons, a subtask of T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS, as Resolved.
Mon, Jul 27, 5:12 PM · Epic, Wikidata, Wikidata-Query-Service
Mstyles closed T251515: Automate data reload for SPARQL Endpoint for Commons as Resolved.
Mon, Jul 27, 5:12 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Tue, Jul 14

Mstyles claimed T257314: Add a Logout link to Wikimedia Commons Query Service.
Tue, Jul 14, 3:48 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Jun 30 2020

Mstyles added a comment to T251514: UI for SPARQL Endpoint for Commons.

Since the gui directory is overwritten by scap via symlinks, Guillaume proposed that the config files live in /etc/config and that they be symlinked to the gui directory. See more discussion here:https://gerrit.wikimedia.org/r/c/operations/puppet/+/606297. I want to remove the custom config file that lives in the gui-deploy repo to avoid any confusion of config files: https://gerrit.wikimedia.org/r/c/wikidata/query/gui-deploy/+/606545

Jun 30 2020, 11:38 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Jun 18 2020

Mstyles updated the task description for T147505: [EPIC][Recurring task] CirrusSearch: what is updated during re-indexing.
Jun 18 2020, 3:46 PM · Tracking-Neverending, Epic, Discovery-Search (Current work), Discovery

Jun 8 2020

Mstyles added a project to T251514: UI for SPARQL Endpoint for Commons: Discovery-Search (Current work).
Jun 8 2020, 5:41 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

May 29 2020

Mstyles moved T253271: Search down in Beta Cluster: "Search backend error during full_text search: index_not_found_exception" from Incoming to Ready for Development on the Discovery-Search (Current work) board.
May 29 2020, 5:20 PM · Discovery-Search (Current work), CirrusSearch
Mstyles edited projects for T253271: Search down in Beta Cluster: "Search backend error during full_text search: index_not_found_exception", added: Discovery-Search (Current work); removed Discovery-Search.

We need to disable testing profiles on the beta cluster. Could be changed in SearchSatisfaction or don't distribute the testing config to the beta cluster

May 29 2020, 5:20 PM · Discovery-Search (Current work), CirrusSearch
Mstyles moved T253612: Excessive HTML entity encoding in title tag from needs triage to watching / waiting on the Discovery-Search board.
May 29 2020, 5:12 PM · I18n, CirrusSearch, Discovery-Search
Mstyles added projects to T253612: Excessive HTML entity encoding in title tag: I18n, Language-Team.

It looks like this might be an issue with the translation, https://translatewiki.net/w/i.php?title=MediaWiki:Searchresults-title/wa&diff=9392337&oldid=1189285

May 29 2020, 5:11 PM · I18n, CirrusSearch, Discovery-Search

May 28 2020

Mstyles added a comment to T251500: oAuth authentication for SPARQL Endpoint for Commons.

Here is the nginx example -> https://github.com/nginxinc/NGINX-Demos/tree/master/oauth2-token-introspection-oss

May 28 2020, 10:34 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata, Wikidata-Query-Service

May 23 2020

Mstyles added a comment to T251500: oAuth authentication for SPARQL Endpoint for Commons.

Some notes for when/if we do oauth
Docs -> https://www.mediawiki.org/wiki/OAuth/For_Developers
we might be able to use this npm package for auth with mediawiki
This is an example of a tools project that uses auth and restricts who can log into the tool

May 23 2020, 12:00 AM · Discovery-Search (Current work), Patch-For-Review, Wikidata, Wikidata-Query-Service

May 18 2020

Mstyles updated subscribers of T251515: Automate data reload for SPARQL Endpoint for Commons.

As discussed in email with @Zbyszko the script should do the following

May 18 2020, 6:46 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Mstyles claimed T251515: Automate data reload for SPARQL Endpoint for Commons.
May 18 2020, 6:45 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

May 11 2020

Mstyles moved T248618: logspam: ReindexTask.php causing a bunch of Undefined index notices from Waiting to Needs Reporting on the Discovery-Search (Current work) board.
May 11 2020, 5:35 PM · MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), Discovery-Search (Current work), CirrusSearch, Wikimedia-production-error
Mstyles closed T248618: logspam: ReindexTask.php causing a bunch of Undefined index notices as Resolved.
May 11 2020, 5:35 PM · MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), Discovery-Search (Current work), CirrusSearch, Wikimedia-production-error
Mstyles moved T219534: Test MLR models for zhwiki, jawiki and kowiki from Waiting to Needs review on the Discovery-Search (Current work) board.
May 11 2020, 5:30 PM · Discovery-Search (Current work), Patch-For-Review, Chinese-Sites, CirrusSearch

May 5 2020

Mstyles closed T223046: Lack of case sensitivity with hastemplate: as Resolved.
May 5 2020, 4:58 PM · MW-1.35-notes (1.35.0-wmf.30; 2020-04-28), MediaWiki-Search, Discovery-Search (Current work)
Mstyles moved T223046: Lack of case sensitivity with hastemplate: from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.

Deployed and the example links work. Marking this as done

May 5 2020, 4:57 PM · MW-1.35-notes (1.35.0-wmf.30; 2020-04-28), MediaWiki-Search, Discovery-Search (Current work)
Mstyles updated the task description for T147505: [EPIC][Recurring task] CirrusSearch: what is updated during re-indexing.
May 5 2020, 4:54 PM · Tracking-Neverending, Epic, Discovery-Search (Current work), Discovery
Mstyles updated the task description for T147505: [EPIC][Recurring task] CirrusSearch: what is updated during re-indexing.
May 5 2020, 4:54 PM · Tracking-Neverending, Epic, Discovery-Search (Current work), Discovery

May 4 2020

Mstyles closed T247123: Migrate wikidata-query-rdf-release-silent release job to Docker as Resolved.
May 4 2020, 10:22 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)
Mstyles closed T247123: Migrate wikidata-query-rdf-release-silent release job to Docker, a subtask of T239981: Delete Jenkins label DebianJessie, as Resolved.
May 4 2020, 10:22 PM · Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), Continuous-Integration-Infrastructure (phase-out-jessie), Release-Engineering-Team (CI & Testing services)
Mstyles added a comment to T247123: Migrate wikidata-query-rdf-release-silent release job to Docker.

Docs are updated -> https://wikitech.wikimedia.org/wiki/Wikidata_query_service#Production_Deployment and I verified that the zip file from the latest version can be downloaded from Archiva

May 4 2020, 10:14 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)
Mstyles committed rDMTC358dfb6fec18: [maven-release-plugin] prepare release discovery-maven-tool-configs-1.13 (authored by Mstyles).
[maven-release-plugin] prepare release discovery-maven-tool-configs-1.13
May 4 2020, 9:29 PM
Mstyles committed rDMTCed45d4953cb0: [maven-release-plugin] prepare for next development iteration (authored by Mstyles).
[maven-release-plugin] prepare for next development iteration
May 4 2020, 9:29 PM
Mstyles committed rDPOM0a604c528ab8: [maven-release-plugin] prepare release discovery-parent-pom-1.39 (authored by Mstyles).
[maven-release-plugin] prepare release discovery-parent-pom-1.39
May 4 2020, 8:05 PM
Mstyles committed rDPOMc9bf19f7a3fd: [maven-release-plugin] prepare for next development iteration (authored by Mstyles).
[maven-release-plugin] prepare for next development iteration
May 4 2020, 8:05 PM
Mstyles committed rDPOMd1b25576027c: [maven-release-plugin] prepare for next development iteration (authored by Mstyles).
[maven-release-plugin] prepare for next development iteration
May 4 2020, 7:58 PM
Mstyles committed rDPOM09a283e7c497: [maven-release-plugin] prepare release discovery-parent-pom-1.38 (authored by Mstyles).
[maven-release-plugin] prepare release discovery-parent-pom-1.38
May 4 2020, 7:58 PM
Mstyles committed rDPOMf050072db70a: Rename deploy archiva profile repository Id (authored by Mstyles).
Rename deploy archiva profile repository Id
May 4 2020, 7:58 PM
Mstyles updated subscribers of T247123: Migrate wikidata-query-rdf-release-silent release job to Docker.

Talked to @Gehel and the issue is probably that the archiva credentials that come from analytics have different server ID's than the ones we use. https://github.com/wikimedia/wikimedia-discovery-discovery-parent-pom/blob/master/pom.xml#L917 vs https://github.com/wikimedia/analytics-refinery-source/blob/master/pom.xml#L96. We can either change our pom to match analytics or add a separate credential in jenkins. @Gehel prefers changing our pom to match analytics for uniformity

May 4 2020, 7:10 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)
Mstyles updated subscribers of T247123: Migrate wikidata-query-rdf-release-silent release job to Docker.
May 4 2020, 6:45 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)
Mstyles added a comment to T247123: Migrate wikidata-query-rdf-release-silent release job to Docker.

I know what that is, I forgot to add the archiva deployment profile. I'll put a patch out

May 4 2020, 4:26 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)

Apr 29 2020

Mstyles reopened T247123: Migrate wikidata-query-rdf-release-silent release job to Docker as "Open".
Apr 29 2020, 4:09 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)
Mstyles reopened T247123: Migrate wikidata-query-rdf-release-silent release job to Docker, a subtask of T239981: Delete Jenkins label DebianJessie, as Open.
Apr 29 2020, 4:09 PM · Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), Continuous-Integration-Infrastructure (phase-out-jessie), Release-Engineering-Team (CI & Testing services)
Mstyles added a comment to T247123: Migrate wikidata-query-rdf-release-silent release job to Docker.

@hashar the jenkins job failed due to no git auth to push. you can see it here: https://integration.wikimedia.org/ci/job/wikidata-query-rdf-maven-release-docker-wdqs/3/

Apr 29 2020, 4:09 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)

Apr 27 2020

Mstyles added a parent task for T219507: Create cookbook to reindex into elasticsearch / cirrus: T251149: [epic] Ryan's onboarding to the Search Platform team.
Apr 27 2020, 5:37 PM · Discovery-Search, Operations
Mstyles added a subtask for T251149: [epic] Ryan's onboarding to the Search Platform team: T219507: Create cookbook to reindex into elasticsearch / cirrus.
Apr 27 2020, 5:37 PM · Discovery-Search (Current work), Epic
Mstyles added a parent task for T178328: Create maintenance script to clean up stale indexes: T251149: [epic] Ryan's onboarding to the Search Platform team.
Apr 27 2020, 5:34 PM · Discovery-Search, CirrusSearch
Mstyles added a subtask for T251149: [epic] Ryan's onboarding to the Search Platform team: T178328: Create maintenance script to clean up stale indexes.
Apr 27 2020, 5:34 PM · Discovery-Search (Current work), Epic

Apr 20 2020

Mstyles edited projects for T247123: Migrate wikidata-query-rdf-release-silent release job to Docker, added: Discovery-Search (Current work); removed Discovery-Search.
Apr 20 2020, 5:39 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)

Apr 16 2020

Mstyles moved T178328: Create maintenance script to clean up stale indexes from elastic / cirrus to Ops / SRE on the Discovery-Search board.
Apr 16 2020, 4:10 PM · Discovery-Search, CirrusSearch

Apr 15 2020

Mstyles moved T248618: logspam: ReindexTask.php causing a bunch of Undefined index notices from Needs review to Waiting on the Discovery-Search (Current work) board.

This will still send a lot of logs next time we do a reindex. We should be doing one in the near future. I can leave this open until the extra logs are removed.

Apr 15 2020, 10:02 PM · MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), Discovery-Search (Current work), CirrusSearch, Wikimedia-production-error
Mstyles added a comment to P10980 (An Untitled Masterwork).

ended up tweaking it just a little bit so I'll leave that here just on the off chance someone else (or me) needs it

import elasticsearch
import sys
Apr 15 2020, 9:52 PM

Apr 13 2020

Mstyles added a comment to T222669: Normalize homoglyphs in mixed-script tokens when possible.

From the analysis chain analysis comparing the chain with and without the homoglyph token filter on a sample of 10,000 random articles for each language:

Apr 13 2020, 10:44 PM · MW-1.36-notes (1.36.0-wmf.2; 2020-07-28), Discovery-Search (Current work), Wikimedia-Hackathon-2019, I18n
Mstyles removed projects from T178328: Create maintenance script to clean up stale indexes: patch-welcome, good first task, Discovery-Search.

Discussed and this might be a task better served by SRE tooling and possibly for a future Search Platform SRE person

Apr 13 2020, 10:38 PM · Discovery-Search, CirrusSearch
Mstyles placed T178328: Create maintenance script to clean up stale indexes up for grabs.
Apr 13 2020, 10:37 PM · Discovery-Search, CirrusSearch

Apr 9 2020

Mstyles moved T248618: logspam: ReindexTask.php causing a bunch of Undefined index notices from Incoming to Needs review on the Discovery-Search (Current work) board.
Apr 9 2020, 5:30 PM · MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), Discovery-Search (Current work), CirrusSearch, Wikimedia-production-error
Mstyles claimed T247123: Migrate wikidata-query-rdf-release-silent release job to Docker.
Apr 9 2020, 5:30 PM · Discovery-Search (Current work), Patch-For-Review, Wikidata-Campsite, Wikidata-Query-Service, Wikidata, Continuous-Integration-Infrastructure (phase-out-jessie)

Apr 8 2020

Mstyles moved T246961: Add Kibana to Relforge from Needs review to Needs Reporting on the Discovery-Search (Current work) board.

I tested and everything works. Thanks @elukey so much for all of your help getting this done! I'm going to go ahead and mark this as closed.

Apr 8 2020, 6:21 PM · Discovery-Search (Current work)
Mstyles claimed T248618: logspam: ReindexTask.php causing a bunch of Undefined index notices.
Apr 8 2020, 4:57 PM · MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), Discovery-Search (Current work), CirrusSearch, Wikimedia-production-error

Apr 6 2020

Mstyles claimed T178328: Create maintenance script to clean up stale indexes.
Apr 6 2020, 5:02 PM · Discovery-Search, CirrusSearch

Apr 2 2020

Mstyles moved T222669: Normalize homoglyphs in mixed-script tokens when possible from Incoming to To Be Deployed on the Discovery-Search (Current work) board.
Apr 2 2020, 4:47 PM · MW-1.36-notes (1.36.0-wmf.2; 2020-07-28), Discovery-Search (Current work), Wikimedia-Hackathon-2019, I18n

Mar 18 2020

Mstyles renamed T246961: Add Kibana to Relforge from Add kibana to Relforge to Add Kibana to Relforge.
Mar 18 2020, 10:26 PM · Discovery-Search (Current work)

Mar 11 2020

Mstyles moved T222669: Normalize homoglyphs in mixed-script tokens when possible from Waiting to Incoming on the Discovery-Search (Current work) board.
Mar 11 2020, 7:38 PM · MW-1.36-notes (1.36.0-wmf.2; 2020-07-28), Discovery-Search (Current work), Wikimedia-Hackathon-2019, I18n
Mstyles moved T222669: Normalize homoglyphs in mixed-script tokens when possible from Incoming to Waiting on the Discovery-Search (Current work) board.
Mar 11 2020, 7:38 PM · MW-1.36-notes (1.36.0-wmf.2; 2020-07-28), Discovery-Search (Current work), Wikimedia-Hackathon-2019, I18n
Mstyles moved T219534: Test MLR models for zhwiki, jawiki and kowiki from Needs review to Waiting on the Discovery-Search (Current work) board.

Instead of filtering the query string queries, we want to move off of query string for spaceless languages and on to using the full text simple match query builder. This will help when we upgrade elastic search and no longer use query strings. In order to the make this move, the FTSM query builder has to be tested in relforge for Japanese. There's currently an upgrade going on with relforge, so this task will be paused until the python upgrade for relforge is complete.

Mar 11 2020, 7:37 PM · Discovery-Search (Current work), Patch-For-Review, Chinese-Sites, CirrusSearch

Mar 10 2020

Mstyles claimed T223046: Lack of case sensitivity with hastemplate:.
Mar 10 2020, 5:27 PM · MW-1.35-notes (1.35.0-wmf.30; 2020-04-28), MediaWiki-Search, Discovery-Search (Current work)

Mar 5 2020

Mstyles created T246961: Add Kibana to Relforge.
Mar 5 2020, 1:35 AM · Discovery-Search (Current work)

Feb 13 2020

Mstyles added a comment to T219534: Test MLR models for zhwiki, jawiki and kowiki.

Config changes have been deployed but due to a configuration conflict with jawiki using the default for wgCirrusSearchFullTextQueryBuilderProfile (see https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Spaceless_Writing_Systems_and_Wiki-Projects), some further changes will have to be made to have the model name show up here

Feb 13 2020, 9:55 PM · Discovery-Search (Current work), Patch-For-Review, Chinese-Sites, CirrusSearch
Mstyles moved T219534: Test MLR models for zhwiki, jawiki and kowiki from Incoming to Needs review on the Discovery-Search (Current work) board.
Feb 13 2020, 8:13 PM · Discovery-Search (Current work), Patch-For-Review, Chinese-Sites, CirrusSearch
Mstyles edited projects for T219534: Test MLR models for zhwiki, jawiki and kowiki, added: Discovery-Search (Current work); removed Discovery-Search.
Feb 13 2020, 6:55 PM · Discovery-Search (Current work), Patch-For-Review, Chinese-Sites, CirrusSearch

Feb 10 2020

Mstyles edited projects for T232589: Migrate CirrusSearch MediaWikiIntegrationTestCase tests to MediaWikiUnitTestCase, added: Discovery-Search; removed Discovery-Search (Current work).
Feb 10 2020, 6:55 PM · Discovery-Search, CirrusSearch, MW-1.35-notes (1.35.0-wmf.8; 2019-11-26), Release-Engineering-Team (Code Health), Code-Health
Mstyles moved T232589: Migrate CirrusSearch MediaWikiIntegrationTestCase tests to MediaWikiUnitTestCase from Incoming to Ready for Development on the Discovery-Search (Current work) board.
Feb 10 2020, 6:45 PM · Discovery-Search, CirrusSearch, MW-1.35-notes (1.35.0-wmf.8; 2019-11-26), Release-Engineering-Team (Code Health), Code-Health
Mstyles edited projects for T222669: Normalize homoglyphs in mixed-script tokens when possible, added: Discovery-Search (Current work); removed Discovery-Search.
Feb 10 2020, 6:43 PM · MW-1.36-notes (1.36.0-wmf.2; 2020-07-28), Discovery-Search (Current work), Wikimedia-Hackathon-2019, I18n
Mstyles claimed T222669: Normalize homoglyphs in mixed-script tokens when possible.
Feb 10 2020, 6:43 PM · MW-1.36-notes (1.36.0-wmf.2; 2020-07-28), Discovery-Search (Current work), Wikimedia-Hackathon-2019, I18n
Mstyles added a comment to T241291: Simplify WDQS Packaging.

@Jdforrester-WMF WMDE will be taking on responsibility for any new deployment methods. That work will be tracked in T192006 and T210286.

Feb 10 2020, 6:42 PM · Discovery-Search (Current work), Wikidata-Query-Service, Patch-For-Review, Wikidata, Discovery
Mstyles moved T241291: Simplify WDQS Packaging from Incoming to Needs Reporting on the Discovery-Search (Current work) board.
Feb 10 2020, 6:41 PM · Discovery-Search (Current work), Wikidata-Query-Service, Patch-For-Review, Wikidata, Discovery

Feb 7 2020

Mstyles updated the task description for T147505: [EPIC][Recurring task] CirrusSearch: what is updated during re-indexing.
Feb 7 2020, 5:59 PM · Tracking-Neverending, Epic, Discovery-Search (Current work), Discovery
Mstyles updated the task description for T147505: [EPIC][Recurring task] CirrusSearch: what is updated during re-indexing.
Feb 7 2020, 5:58 PM · Tracking-Neverending, Epic, Discovery-Search (Current work), Discovery

Jan 21 2020

Mstyles claimed T209812: Review Elastic/maps Grafana dashboards.
Jan 21 2020, 10:12 PM · Discovery-Search, Maps, Elasticsearch, Operations
Mstyles closed T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects as Resolved.
Jan 21 2020, 10:11 PM · Discovery-Search (Current work), Patch-For-Review, Code-Health
Mstyles closed T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects, a subtask of T237926: [Epic] Maryum's onboarding to the Search Platform team, as Resolved.
Jan 21 2020, 10:11 PM · Discovery-Search (Current work)
Mstyles moved T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects from Blocked to Needs Reporting on the Discovery-Search (Current work) board.
Jan 21 2020, 10:11 PM · Discovery-Search (Current work), Patch-For-Review, Code-Health
Mstyles moved T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects from Waiting to Blocked on the Discovery-Search (Current work) board.
Jan 21 2020, 10:10 PM · Discovery-Search (Current work), Patch-For-Review, Code-Health
Mstyles moved T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects from Incoming to Waiting on the Discovery-Search (Current work) board.
Jan 21 2020, 10:10 PM · Discovery-Search (Current work), Patch-For-Review, Code-Health
Mstyles added a comment to T241291: Simplify WDQS Packaging.

@Addshore that's correct, after removing the gui submodule, I won't be doing any further work

Jan 21 2020, 4:55 PM · Discovery-Search (Current work), Wikidata-Query-Service, Patch-For-Review, Wikidata, Discovery

Jan 17 2020

Mstyles added a comment to T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects.

very exciting to see it work here: https://gerrit.wikimedia.org/r/c/search/extra/+/563267. I know @Gehel mentioned trying to refactor where the same job runs for both pre-merge and post-merge but after chatting with @Jdforrester-WMF, it seems that convention is to have separate pre and post merge jobs. I would be happy to call this done.

Jan 17 2020, 8:26 PM · Discovery-Search (Current work), Patch-For-Review, Code-Health
Mstyles added a comment to T217742: Rework the data flow between logstash and cirrus elasticsearch cluster for ApiFeatureUsage.

Tabling this for now as it's not urgent

Jan 17 2020, 12:59 AM · Discovery-Search
Mstyles added a comment to T241291: Simplify WDQS Packaging.

After a bunch of discussion with the team, it's been decided that removing the gui submodule from the RDF repository will suffice for now. That will fix our broken build issues (see https://phabricator.wikimedia.org/T242640) @Ladsgroup I definitely think you should work on that patch and getting things going with service runner if you have the bandwidth.

Jan 17 2020, 12:41 AM · Discovery-Search (Current work), Wikidata-Query-Service, Patch-For-Review, Wikidata, Discovery

Jan 16 2020

Mstyles added a comment to T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects.

@kostajh do we still need to separate sonar args for master vs non master branches then? it seems that we should be able to send all of the same sonar args whether or not the branch is master. I'm not sure how to tell the bot if something is pre or post merge.

Jan 16 2020, 1:34 AM · Discovery-Search (Current work), Patch-For-Review, Code-Health

Jan 13 2020

Mstyles added a comment to T241291: Simplify WDQS Packaging.

Had a quick sync meeting with WMDE. The outcome of that was to use this node patch as a starting point for service runner. It's unclear whether or not blubber needs to be involved in this process. Also, ideally the public image for the WDQS UI would be eliminated in favor of the new image used for this new build process.

Jan 13 2020, 7:21 PM · Discovery-Search (Current work), Wikidata-Query-Service, Patch-For-Review, Wikidata, Discovery
Addshore awarded T241291: Simplify WDQS Packaging a 100 token.
Jan 13 2020, 7:18 PM · Discovery-Search (Current work), Wikidata-Query-Service, Patch-For-Review, Wikidata, Discovery

Jan 10 2020

Mstyles added a comment to T232006: LDF service does not Vary responses by Accept, sending incorrect cached responses to clients.

@Gehel I think we can consider this closed unless someone is able to reproduce

Jan 10 2020, 8:20 PM · Discovery-Search (Current work), Patch-For-Review, Operations, Traffic, Wikidata, Wikidata-Query-Service

Jan 9 2020

Mstyles added a comment to T241291: Simplify WDQS Packaging.

@akosiaris Could we possibly use miscweb in front of a VM as an interim to serve up the static files before moving to service template?

Jan 9 2020, 9:18 PM · Discovery-Search (Current work), Wikidata-Query-Service, Patch-For-Review, Wikidata, Discovery
Mstyles added a comment to T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects.

@kostajh everything has been merged, and the code health job runs with sonar analysis after a patch for java projects. However we're not seeing any results from bots in the test patch in search extra (https://gerrit.wikimedia.org/r/563250) with analysis here: https://sonarcloud.io/project/activity?id=org.wikimedia.search%3Aextra-parent. Does the bot know about java projects?

Jan 9 2020, 7:30 PM · Discovery-Search (Current work), Patch-For-Review, Code-Health
Mstyles added a comment to T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects.

you're right, it's a typo. It should be /run-java.sh. Pushing up a patch now

Jan 9 2020, 5:40 PM · Discovery-Search (Current work), Patch-For-Review, Code-Health
Mstyles added a comment to T237165: LDF server has 404 errors for JS and CSS resources.

for clarification the correct response will contain a list that looks like this

@prefix schema: <http://schema.org/> .
@prefix pq:    <http://www.wikidata.org/prop/qualifier/> .
@prefix pr:    <http://www.wikidata.org/prop/reference/> .
@prefix ps:    <http://www.wikidata.org/prop/statement/> .

and the incorrect response is HTML that looks similar to

<!DOCTYPE html><html lang="en" dir="ltr"><head><meta charset="utf-8"><meta http-equiv="X-UA-Compatible" content="IE=edge"><meta name="viewport" content="width=device-width,initial-scale=1,user-scalable=yes"><link rel="stylesheet" href="css/style.min.6c0e4865f687302c4d99.css"><link id="favicon" rel="shortcut icon"><script src="js/shim.min.6d0a3b4d4b50e4f73d3e.js"></script><style id="MJX-CHTML-styles">/* placeholder for MathJax */</style></head><body><div class="wikibase-queryservice container-fluid">
Jan 9 2020, 4:55 PM · Discovery-Search (Current work), Operations, Traffic, Wikidata, Wikidata-Query-Service, Discovery

Jan 8 2020

Mstyles added a comment to T237165: LDF server has 404 errors for JS and CSS resources.

from inside any of the WDQS machines ( 'wdqs1004.eqiad.wmnet','wdqs1005.eqiad.wmnet', 'wdqs1006.eqiad.wmnet','wdqs1007.eqiad.wmnet')
the following curls return the correct data
curl localhost:80/bigdata/ldf -> direct to nginx server on host
curl localhost:9999/bigdata/ldf -> direct to query service on host
but curl https://query.wikidata.org/bigdata/ldf is not working indicating some problem with routing traffic.
This could be the recent switch from varnish to apache.

Jan 8 2020, 10:25 PM · Discovery-Search (Current work), Operations, Traffic, Wikidata, Wikidata-Query-Service, Discovery
Mstyles added a project to T237165: LDF server has 404 errors for JS and CSS resources: Traffic.
Jan 8 2020, 8:50 PM · Discovery-Search (Current work), Operations, Traffic, Wikidata, Wikidata-Query-Service, Discovery

Dec 21 2019

Mstyles created T241291: Simplify WDQS Packaging.
Dec 21 2019, 12:52 AM · Discovery-Search (Current work), Wikidata-Query-Service, Patch-For-Review, Wikidata, Discovery

Dec 20 2019

Mstyles added a comment to T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects.

I am all for reducing duplication but in this case, perhaps we can see if we get it working first and then try to reduce the duplication?

Dec 20 2019, 1:27 AM · Discovery-Search (Current work), Patch-For-Review, Code-Health

Dec 18 2019

Mstyles added a comment to T238004: Implement sonarcloud integration for Java projects in the same way as PHP projects.

What I was trying to say is that all of the projects are currently sending their analysis to SonarQube, so I didn't want to change any postmerge jobs. I put what I thought in the patch

Dec 18 2019, 11:31 PM · Discovery-Search (Current work), Patch-For-Review, Code-Health
Mstyles claimed T217742: Rework the data flow between logstash and cirrus elasticsearch cluster for ApiFeatureUsage.
Dec 18 2019, 9:29 PM · Discovery-Search
Mstyles added a comment to T217742: Rework the data flow between logstash and cirrus elasticsearch cluster for ApiFeatureUsage.

I think specifically the updates are around this ticket, https://phabricator.wikimedia.org/T235833

Dec 18 2019, 9:24 PM · Discovery-Search