Page MenuHomePhabricator

Zbyszko (Zbyszko Papierski)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Dec 9 2019, 10:58 AM (46 w, 4 d)
Availability
Available
LDAP User
ZPapierski
MediaWiki User
ZPapierski (WMF) [ Global Accounts ]

Recent Activity

Yesterday

Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

Progress so far:

Fri, Oct 30, 3:03 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic

Tue, Oct 27

Zbyszko moved T266318: Clarify dependencies on codehale dropwizards from In Progress to Needs review on the Discovery-Search (Current work) board.
Tue, Oct 27, 2:32 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T266318: Clarify dependencies on codehale dropwizards.

After investigation I found that most metric plugins do not shade in codehale metrics; graphite plugin does this because it actually uses them in the code (other reporters access flink provided abstraction). Since it is the exception, I decided to shade in the dependency.

Tue, Oct 27, 2:32 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T265504: Create Blubberfile in WDQS repo.

I hope my answer helps as well.

Tue, Oct 27, 1:01 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
Zbyszko added a comment to T265504: Create Blubberfile in WDQS repo.

Could you elaborate on that a bit?

Sure, here goes: We are using Apache Flink[1] as a platform for our event processing we do to feed Wikidata Query Service. We've want to move to Flink deployment to Kubernetes, hence this ticket. Apache Flink provides it's own docker image[2] which, in other circumstances, we would build upon. What @Mstyles is doing now is basically replaying work original Flink contributors did for their docker image - which, according to our current knowledge is what we must do.
The actual docker file (with additional entry script) is here [3] - it would be great if we wouldn't need to make sure that we covered everything that is handled here with each Flink update.

Tue, Oct 27, 10:24 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
Zbyszko moved T266318: Clarify dependencies on codehale dropwizards from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Tue, Oct 27, 9:48 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T265504: Create Blubberfile in WDQS repo.

@akosiaris I see, makes sense. I still would like to solve the issue with replicating the original dockerfile - can we deploy Flink images to our registry - even if we'd need to fork Flink docker repo?

Tue, Oct 27, 8:16 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata-Query-Service, Wikidata

Mon, Oct 26

Zbyszko claimed T266318: Clarify dependencies on codehale dropwizards.
Mon, Oct 26, 6:52 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T252124: Scap configuration for WDQS should get server groups from a known source or truth from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Mon, Oct 26, 6:25 PM · Discovery-Search (Current work), Scap, Wikidata, Operations, Wikidata-Query-Service
Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

Great! thanks - I'll get on that.

Mon, Oct 26, 6:23 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic
Zbyszko moved T264042: Query service returns weird Commons links when asking for P50 (author) statement value from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Mon, Oct 26, 6:16 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko claimed T264659: Update BAG & BRT SPARQL endpoint in the whitelist.
Mon, Oct 26, 6:07 PM · Discovery-Search (Current work), Wikidata-Query-Service, Wikidata, Wikimedia-Site-requests
Zbyszko moved T264659: Update BAG & BRT SPARQL endpoint in the whitelist from In Progress to Needs review on the Discovery-Search (Current work) board.
Mon, Oct 26, 6:07 PM · Discovery-Search (Current work), Wikidata-Query-Service, Wikidata, Wikimedia-Site-requests
Zbyszko added a comment to T265504: Create Blubberfile in WDQS repo.

@akosiaris Can we base a blubber enabled project on a 3rd party docker image, provided on docker hub? I was wondering if we have to replicate original dockerfile here (I'd rather base of their image to reduce future maintenance).

Mon, Oct 26, 1:45 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
Zbyszko moved T264042: Query service returns weird Commons links when asking for P50 (author) statement value from Waiting to To Be Deployed on the Discovery-Search (Current work) board.
Mon, Oct 26, 10:20 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Thu, Oct 22

Zbyszko moved T264659: Update BAG & BRT SPARQL endpoint in the whitelist from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Thu, Oct 22, 10:07 AM · Discovery-Search (Current work), Wikidata-Query-Service, Wikidata, Wikimedia-Site-requests
Zbyszko moved T264042: Query service returns weird Commons links when asking for P50 (author) statement value from In Progress to Waiting on the Discovery-Search (Current work) board.
Thu, Oct 22, 10:06 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T264042: Query service returns weird Commons links when asking for P50 (author) statement value.

@Lucas_Werkmeister_WMDE little follow up to this - is it possible that this could be the result with opcache issues, like described here - https://phabricator.wikimedia.org/T255282 ? Date matches so we are wondering if those could be related.

Thu, Oct 22, 10:04 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Wed, Oct 21

Zbyszko added a comment to T264042: Query service returns weird Commons links when asking for P50 (author) statement value.

Little bit more on what I found:

  • Both eqiad and codfw were affected, but list of Q-entities was greatly different
  • While almost all issues were reported for truthy and reified statements, there was a single case for a reference. Interestingly, that case was also for author (P50). Broken reference query:
SELECT  ?p ?o WHERE {
Wed, Oct 21, 2:18 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

Thank you all for swift (pun intended) action!

Wed, Oct 21, 9:12 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic

Tue, Oct 20

Zbyszko added a comment to T264042: Query service returns weird Commons links when asking for P50 (author) statement value.

All the entities affected were refreshed and this:

SELECT ?p (COUNT(*) AS ?count) WHERE {
  ?s ?p <http://commons.wikimedia.org/wiki/Special:FilePath/>.
}
GROUP BY ?p
ORDER BY DESC(?count)

no longer returns any results.
All affected entitites had been updated on 12 June 2020. @Lucas_Werkmeister_WMDE, are you aware of any issue around that day concerning wikidata? I can't find anything on wdqs side that could produce that kind of a localized result.

Tue, Oct 20, 1:45 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T264042: Query service returns weird Commons links when asking for P50 (author) statement value.

According to this query:

SELECT DISTINCT ?item ?rev ?date WHERE {
      {
        ?st ps:P50|ps:P106|ps:P136|ps:P275|pq:P512|pq:P106 <http://commons.wikimedia.org/wiki/Special:FilePath/>.
        ?item ?p ?st 
      }
      UNION
      {
        ?item wdt:P50|wdt:P106|wdt:P136|wdt:P275 <http://commons.wikimedia.org/wiki/Special:FilePath/> .
      }
  ?item schema:version ?rev .
  ?item schema:dateModified ?date .
}

we have 119 entities affected which I will refresh. Results -

.

Tue, Oct 20, 8:18 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Mon, Oct 19

Zbyszko added a comment to T265891: Add Wikimedia Commons Query Service endpoint in the WDQS federation whitelist.

It's currently not possible - as long as Wikimedia Commons Query Service is in beta, OAuth authorization will not work with federation. We want to reevaluate this federation once we productionize WCQS.

Mon, Oct 19, 3:40 PM · Wikidata, Wikidata-Query-Service
Zbyszko added a parent task for T265914: Investigate Resource Needs for Commons and Wikidata Elasticsearch indices : T265621: [EPIC] Create a dedicated elasticsearch cluster for Commons and Wikidata.
Mon, Oct 19, 3:28 PM · Discovery-Search (Current work)
Zbyszko added a subtask for T265621: [EPIC] Create a dedicated elasticsearch cluster for Commons and Wikidata: T265914: Investigate Resource Needs for Commons and Wikidata Elasticsearch indices .
Mon, Oct 19, 3:28 PM · Discovery-Search (Current work)
Zbyszko created T265914: Investigate Resource Needs for Commons and Wikidata Elasticsearch indices .
Mon, Oct 19, 3:28 PM · Discovery-Search (Current work)
Zbyszko renamed T265621: [EPIC] Create a dedicated elasticsearch cluster for Commons and Wikidata from Create a dedicated elasticsearch cluster for Commons and Wikidata to [EPIC]Create a dedicated elasticsearch cluster for Commons and Wikidata.
Mon, Oct 19, 3:25 PM · Discovery-Search (Current work)
Zbyszko added a comment to T264042: Query service returns weird Commons links when asking for P50 (author) statement value.

First look at the issue - usual culpruits don't seem to apply here:

  • Munged dump is correct for one of the affected entitites
  • query, after loading the data into blazegraph is fine,too

Interestingly, every single entity I found with this, was updated on 12 June 2020 (though with correct data and by different users) - I'm not sure if there's a significance here yet or just a freak coincidence.

Mon, Oct 19, 1:29 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko claimed T264042: Query service returns weird Commons links when asking for P50 (author) statement value.
Mon, Oct 19, 8:46 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T264042: Query service returns weird Commons links when asking for P50 (author) statement value from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Mon, Oct 19, 8:46 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

I'm fine with the thanos cluster option - we can proceed with that. @Ottomata do you know if thanos swift cluster is accessible from hadoop?

Mon, Oct 19, 7:41 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic
Zbyszko moved T252124: Scap configuration for WDQS should get server groups from a known source or truth from Needs review to To Be Deployed on the Discovery-Search (Current work) board.
Mon, Oct 19, 7:39 AM · Discovery-Search (Current work), Scap, Wikidata, Operations, Wikidata-Query-Service
Zbyszko moved T256882: The streaming updater should support page undeletes from Needs review to To Be Deployed on the Discovery-Search (Current work) board.
Mon, Oct 19, 7:39 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Fri, Oct 9

Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

We lack precise data for production - we haven't really optimised yet and complete functionality isn't yet ready (it will soon, though). Rarely, we get around 8-9GB checkpoints (when bootstrapping for example), but they do not happen regularly. Normally, checkpoints are incremental and each 30 seconds they drop data of sub-1MB volume. We may change those values, but we'll still use incremental checkpoints.

Fri, Oct 9, 9:58 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic

Thu, Oct 8

Zbyszko placed T264042: Query service returns weird Commons links when asking for P50 (author) statement value up for grabs.
Thu, Oct 8, 2:20 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T264042: Query service returns weird Commons links when asking for P50 (author) statement value from In Progress to Ready for Development on the Discovery-Search (Current work) board.
Thu, Oct 8, 2:19 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko claimed T259674: Ship query completion indices from analytics to prod clusters.
Thu, Oct 8, 12:15 PM · Discovery-Search (Current work)

Tue, Oct 6

Zbyszko moved T261841: Tag WDQS query log with the source of the query (UI vs direct access) from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Tue, Oct 6, 1:53 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko removed a project from T256949: The streaming updater should support suppressed deletes: Patch-For-Review.
Tue, Oct 6, 6:42 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko claimed T264042: Query service returns weird Commons links when asking for P50 (author) statement value.
Tue, Oct 6, 6:30 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T264042: Query service returns weird Commons links when asking for P50 (author) statement value from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Tue, Oct 6, 6:30 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

@fgiunchedi Currently, Flink pipeline resides on the Analytics Hadoop cluster. As for the question whether Flink creates it's containers - I think not, it did complain when there was no container, so I assume it expects one.

Tue, Oct 6, 6:30 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic

Fri, Oct 2

Zbyszko added a comment to T263855: mvn package fails for wikidata-query-rdf on Mac OS 10.13.6 High Sierra.

The error you get:

Fri, Oct 2, 12:57 PM · Wikidata-Query-Service, Wikidata

Thu, Oct 1

Zbyszko moved T252124: Scap configuration for WDQS should get server groups from a known source or truth from In Progress to Needs review on the Discovery-Search (Current work) board.
Thu, Oct 1, 3:02 PM · Discovery-Search (Current work), Scap, Wikidata, Operations, Wikidata-Query-Service
Zbyszko moved T256882: The streaming updater should support page undeletes from In Progress to Needs review on the Discovery-Search (Current work) board.
Thu, Oct 1, 3:00 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Sep 29 2020

Zbyszko claimed T256882: The streaming updater should support page undeletes.
Sep 29 2020, 1:54 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T256882: The streaming updater should support page undeletes from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Sep 29 2020, 1:54 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

@fgiunchedi unfortunately, there is no docker on stat instances so I'm unable to test swift that way. I'd still prefer to have some container on a already running service (whichever is accessible from analytics cluster). Test we want to set up would involve longer running service, starting from longer intervals, going back to shorter ones. We want to set up full end to end solution, so it'd make sense to use a stable solution anyway.

Sep 29 2020, 1:06 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic
Zbyszko added a comment to T261119: Architecture review of Flink based WDQS Streaming Updater.

Architecture review will be done at the beginning of November.

Sep 29 2020, 12:55 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

@Ottomata There's some confusion on how to access Swift from Hadoop cluster - I understood that it isn't doable, but from what I hear, search pipeline results go there. Can we reuse the same mechanism here? I rather have a set up done with the current updater, so we have a working end-to-end poc before we go to production.

Sep 29 2020, 9:13 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic
Zbyszko updated the task description for T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.
Sep 29 2020, 8:33 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic
Zbyszko added a comment to T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.

@fgiunchedi We estimate we'd need around 500GB of storage for the streaming updater (not accounting for replicas). Our use case is almost always write only (checkpoints are read only on pipeline restarts, which ideally will be done rarely) - but we have a elasticity when it comes to configuration of the checkpoints interval.

Sep 29 2020, 8:29 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic

Sep 28 2020

Zbyszko moved T261119: Architecture review of Flink based WDQS Streaming Updater from Waiting to Blocked on the Discovery-Search (Current work) board.
Sep 28 2020, 5:31 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T261937: Add CPU load and query concurrency as context to event logging from WDQS from Needs review to To Be Deployed on the Discovery-Search (Current work) board.
Sep 28 2020, 5:29 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko added a comment to T252124: Scap configuration for WDQS should get server groups from a known source or truth.

@thcipriani - your proposal sounds reasonable (we don't really care if we're deploying public service before private one). One issue - we want to enable parallel deployments (https://phabricator.wikimedia.org/T207676) - to shorten the time and division available today sounds like a natural parallelisation. Are there other ways we could solve this?

Sep 28 2020, 8:56 AM · Discovery-Search (Current work), Scap, Wikidata, Operations, Wikidata-Query-Service

Sep 25 2020

Zbyszko added a comment to T252124: Scap configuration for WDQS should get server groups from a known source or truth.

@thcipriani I have the change in puppet (https://gerrit.wikimedia.org/r/630081). What else would I need to do to guarantee that generated lists in /etc/dsh/groups are picked up? I rather leave everything else configured as it is right now (https://github.com/wikimedia/wikidata-query-deploy/blob/master/scap/scap.cfg)

Sep 25 2020, 3:01 PM · Discovery-Search (Current work), Scap, Wikidata, Operations, Wikidata-Query-Service

Sep 24 2020

Zbyszko claimed T252124: Scap configuration for WDQS should get server groups from a known source or truth.
Sep 24 2020, 7:51 AM · Discovery-Search (Current work), Scap, Wikidata, Operations, Wikidata-Query-Service
Zbyszko moved T252124: Scap configuration for WDQS should get server groups from a known source or truth from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Sep 24 2020, 7:48 AM · Discovery-Search (Current work), Scap, Wikidata, Operations, Wikidata-Query-Service

Sep 22 2020

Zbyszko claimed T246004: Spike: Can/should Swift be used as Flink checkpoint backend?.
Sep 22 2020, 9:06 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic
Zbyszko moved T246004: Spike: Can/should Swift be used as Flink checkpoint backend? from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Sep 22 2020, 9:06 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic
Zbyszko added a comment to T261841: Tag WDQS query log with the source of the query (UI vs direct access).

It turns out that request headers already provide referrer (where available) in http.request-headers map. Is it required to provide it elsewhere to fulfill the need of analysts?

Sep 22 2020, 8:44 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Sep 21 2020

Zbyszko moved T262828: Near zero downtime Data reload for WCQS from Needs review to To Be Deployed on the Discovery-Search (Current work) board.
Sep 21 2020, 5:33 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T251096: [WDQS Streaming Updater] Organise module structure from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Sep 21 2020, 5:33 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T262265: Provide real-time updates for WCQS from Scaling to Current work on the Wikidata-Query-Service board.
Sep 21 2020, 3:56 PM · Wikidata-Query-Service, Wikidata
Zbyszko moved T246004: Spike: Can/should Swift be used as Flink checkpoint backend? from Scaling to Current work on the Wikidata-Query-Service board.
Sep 21 2020, 3:53 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, Epic
Zbyszko moved T256882: The streaming updater should support page undeletes from Scaling to Current work on the Wikidata-Query-Service board.
Sep 21 2020, 3:53 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T262907: EXISTS inside BIND always false when hint included from All WDQS-related tasks to Blazegraph on the Wikidata-Query-Service board.
Sep 21 2020, 3:49 PM · Wikidata-Query-Service, Wikidata
Zbyszko moved T262942: PoC on anomaly detection with Flink from All WDQS-related tasks to Current work on the Wikidata-Query-Service board.
Sep 21 2020, 3:46 PM · Discovery-Search (Current work), Analytics-Radar, Wikidata, Wikidata-Query-Service
Zbyszko moved T263088: Allow to download WDQS and WCQS results as Excel spreadsheet from All WDQS-related tasks to Feature Requests on the Wikidata-Query-Service board.
Sep 21 2020, 3:37 PM · Wikidata, Wikidata-Query-Service
Zbyszko moved T263110: Investigate the cause of: ChecksumError: offset=517789868032,nbytes=16,expected=-58390144,actual=535102966 while importing wikidata dumps from All WDQS-related tasks to Current work on the Wikidata-Query-Service board.
Sep 21 2020, 3:36 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T263125: Check for errors on wdqs1009 disks from All WDQS-related tasks to Current work on the Wikidata-Query-Service board.
Sep 21 2020, 3:35 PM · ops-eqiad, Operations, DC-Ops, Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
Zbyszko moved T261841: Tag WDQS query log with the source of the query (UI vs direct access) from In Progress to Needs review on the Discovery-Search (Current work) board.
Sep 21 2020, 10:24 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko claimed T261937: Add CPU load and query concurrency as context to event logging from WDQS.
Sep 21 2020, 10:24 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko claimed T261841: Tag WDQS query log with the source of the query (UI vs direct access).
Sep 21 2020, 6:27 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T261841: Tag WDQS query log with the source of the query (UI vs direct access) from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Sep 21 2020, 6:27 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Sep 18 2020

Zbyszko moved T261937: Add CPU load and query concurrency as context to event logging from WDQS from In Progress to Needs review on the Discovery-Search (Current work) board.
Sep 18 2020, 1:41 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Sep 17 2020

Zbyszko placed T261937: Add CPU load and query concurrency as context to event logging from WDQS up for grabs.
Sep 17 2020, 4:36 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko claimed T261937: Add CPU load and query concurrency as context to event logging from WDQS.
Sep 17 2020, 4:36 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T261937: Add CPU load and query concurrency as context to event logging from WDQS from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Sep 17 2020, 9:40 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Sep 15 2020

Zbyszko moved T259637: Gather information about the volume of queries on WCQS from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Sep 15 2020, 2:07 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T261097: WDQS Categories reload is failing on thankyouwiki from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Sep 15 2020, 2:05 PM · Discovery-Search (Current work), Operations, Wikidata-Query-Service, Wikidata
Zbyszko moved T261119: Architecture review of Flink based WDQS Streaming Updater from In Progress to Waiting on the Discovery-Search (Current work) board.
Sep 15 2020, 1:07 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T262828: Near zero downtime Data reload for WCQS from In Progress to Needs review on the Discovery-Search (Current work) board.
Sep 15 2020, 1:07 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko triaged T262828: Near zero downtime Data reload for WCQS as High priority.
Sep 15 2020, 7:41 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko claimed T262828: Near zero downtime Data reload for WCQS.
Sep 15 2020, 7:41 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T262828: Near zero downtime Data reload for WCQS from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Sep 15 2020, 7:40 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Sep 14 2020

Zbyszko moved T262178: One week after SDC edits the data still shows up in WCQS queries from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Sep 14 2020, 5:51 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, SDC General
Zbyszko moved T262828: Near zero downtime Data reload for WCQS from All WDQS-related tasks to Current work on the Wikidata-Query-Service board.
Sep 14 2020, 3:39 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko created T262828: Near zero downtime Data reload for WCQS.
Sep 14 2020, 3:39 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T262178: One week after SDC edits the data still shows up in WCQS queries from Needs review to To Be Deployed on the Discovery-Search (Current work) board.
Sep 14 2020, 2:16 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, SDC General
Zbyszko claimed T261119: Architecture review of Flink based WDQS Streaming Updater.
Sep 14 2020, 9:39 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T261119: Architecture review of Flink based WDQS Streaming Updater from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Sep 14 2020, 9:39 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T258240: Refactor Options handling in Streaming Updater from In Progress to Needs review on the Discovery-Search (Current work) board.
Sep 14 2020, 9:38 AM · Discovery-Search (Current work), Wikidata-Query-Service, Wikidata

Sep 10 2020

Zbyszko claimed T258240: Refactor Options handling in Streaming Updater .
Sep 10 2020, 9:25 AM · Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
Zbyszko moved T258240: Refactor Options handling in Streaming Updater from Ready for Development to In Progress on the Discovery-Search (Current work) board.
Sep 10 2020, 9:25 AM · Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
Zbyszko added a comment to T261097: WDQS Categories reload is failing on thankyouwiki.

@RKemper we should be able to retry categories reload after deploying this.

Sep 10 2020, 9:25 AM · Discovery-Search (Current work), Operations, Wikidata-Query-Service, Wikidata
Zbyszko moved T261097: WDQS Categories reload is failing on thankyouwiki from In Progress to To Be Deployed on the Discovery-Search (Current work) board.
Sep 10 2020, 9:24 AM · Discovery-Search (Current work), Operations, Wikidata-Query-Service, Wikidata
Zbyszko added a comment to T261097: WDQS Categories reload is failing on thankyouwiki.

I went with the fix for wikidata/query/rdf scripts - it made most sense to me, since issues with a single wiki should block updates for others. Once it's merged, I'll add an entry on that to runbook

Sep 10 2020, 8:27 AM · Discovery-Search (Current work), Operations, Wikidata-Query-Service, Wikidata

Sep 9 2020

Zbyszko moved T251096: [WDQS Streaming Updater] Organise module structure from Needs Reporting to To Be Deployed on the Discovery-Search (Current work) board.
Sep 9 2020, 1:51 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
Zbyszko moved T251096: [WDQS Streaming Updater] Organise module structure from Needs review to Needs Reporting on the Discovery-Search (Current work) board.
Sep 9 2020, 1:50 PM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service