GWicke (Gabriel Wicke)
User

Projects (33)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 31 2014, 3:23 AM (159 w, 4 d)
Availability
Available
LDAP User
GWicke
MediaWiki User
Unknown

Recent Activity

Thu, Nov 9

Liuxinyu970226 awarded T122942: RFC: Support language variants in the REST API a Like token.
Thu, Nov 9, 10:09 AM · Reading-Infrastructure-Team-Backlog, User-mobrovac, Chinese-Sites, Services (next), I18n, TechCom-Has-shepherd, RfC, Mobile-Content-Service, Parsing-Team, TechCom-RfC, RESTBase, Blocked-on-Parsoid, Parsoid

Oct 16 2017

GWicke added a comment to T130873: Clarify data requirements for basic VE rendering.

I don't think we are clear on the data requirements yet. However, the data-mw separation has been delayed repeatedly, so this hasn't been an issue yet.

Oct 16 2017, 4:13 PM · User-Ryasmeen, Services (watching), VisualEditor-MediaWiki, Cite, Parsing-Team, VisualEditor

Oct 14 2017

GWicke added a comment to T176627: Trial replacing Electron with headless Chromium in the render service.

It might be worth focusing more on robustness than simple-page latency, as that is the more critical issue with Electron. Previously, I tested with a few very large articles (see T142226#2537844). This tested timeout enforcement. Testing with a simulated overload (many concurrent requests for huge pages) could also be useful to ensure that concurrency limits and resource usage limits are thoroughly enforced.

Oct 14 2017, 12:48 AM · Services (watching), Patch-For-Review, Readers-Web-Kanban-Board, Readers-Web-Backlog, Proton, Electron-PDFs

Oct 11 2017

GWicke placed T105845: Page components / content widgets up for grabs.
Oct 11 2017, 10:33 PM · TechCom-Has-shepherd, RfC, Wikidata, Wikimedia-Developer-Summit-2016, TechCom-RfC, Contributors-Team, Parsoid
GWicke placed T106099: RFC: Page composition using service workers and server-side JS fall-back up for grabs.
Oct 11 2017, 10:33 PM · Services (designing), RfC, TechCom-RfC
GWicke added a comment to T106099: RFC: Page composition using service workers and server-side JS fall-back.

There is now a commercial product offering ServiceWorker execution at the CDN level: https://blog.cloudflare.com/introducing-cloudflare-workers/

Oct 11 2017, 10:32 PM · Services (designing), RfC, TechCom-RfC
GWicke reassigned T115876: High-traffic API endpoints to cover in RESTBase from GWicke to mobrovac.
Oct 11 2017, 10:30 PM · Readers-Web-Backlog (Tracking), Services (next), Parsoid, RESTBase-API, RESTBase
GWicke placed T173447: Generalized rate limiting, deduplication, and job scheduling module up for grabs.
Oct 11 2017, 10:29 PM · EventBus, MediaWiki-JobQueue, Analytics, ChangeProp, Services (doing)
GWicke placed T125226: [feature request] Redirect root API path to docs page up for grabs.
Oct 11 2017, 10:29 PM · Operations, Traffic, Patch-For-Review, RESTBase-API
GWicke placed T128040: Document and implement the REST API format versioning and negotiation policy up for grabs.
Oct 11 2017, 10:28 PM · Services (next), Documentation, Patch-For-Review, Services-next, RESTBase
GWicke reassigned T137350: Create general guidelines & processes to ensure thorough fault testing of services from GWicke to mobrovac.
Oct 11 2017, 10:28 PM · Services (designing), Wikimedia-Incident
GWicke closed T150200: Prototype localizing the wikipedia portal in an offline-enabled serviceworker as Declined.

This isn't going to happen any more.

Oct 11 2017, 10:27 PM · Offline-Working-Group, Wikimedia-Portals, Services (next), Discovery
GWicke placed T175206: 2017/18 Annual Plan Program 8: Multi-datacenter support up for grabs.
Oct 11 2017, 10:26 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke placed T175213: 2017/18 Annual Plan Program 8: Multi-datacenter support, Q2 goals up for grabs.
Oct 11 2017, 10:26 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke closed T169140: ChangeProp: Enhance if-modified-since support; possibly integrate into rate limiting / deduplication logic as Resolved.

If-unmodified-since support is implemented in https://github.com/wikimedia/budgeteer.

Oct 11 2017, 10:25 PM · ChangeProp, RESTBase, Services (designing)
GWicke closed T169140: ChangeProp: Enhance if-modified-since support; possibly integrate into rate limiting / deduplication logic, a subtask of T173447: Generalized rate limiting, deduplication, and job scheduling module, as Resolved.
Oct 11 2017, 10:25 PM · EventBus, MediaWiki-JobQueue, Analytics, ChangeProp, Services (doing)
GWicke added a comment to T173447: Generalized rate limiting, deduplication, and job scheduling module.

Basic implementation: https://github.com/wikimedia/budgeteer.

Oct 11 2017, 10:23 PM · EventBus, MediaWiki-JobQueue, Analytics, ChangeProp, Services (doing)
GWicke placed T99088: [RFC] Evolving our content platform: Content adaptability, structured data and caching up for grabs.
Oct 11 2017, 10:20 PM · RfC, Wikidata, Wikimedia-Developer-Summit-2016, Architecture
GWicke reassigned T122825: Service Ownership and Maintenance from GWicke to mobrovac.
Oct 11 2017, 10:18 PM · User-mobrovac, Services (attic), TechCom-Has-shepherd, RfC, TechCom-RfC, Operations

Oct 2 2017

GWicke added a comment to T176627: Trial replacing Electron with headless Chromium in the render service.

See T172815 for our general thinking on robust PDF rendering based on the experience with OCG and Electron. It boils down to using a fresh render process per request & thoroughly controlling its resource consumption and maximum runtime.

Oct 2 2017, 5:40 PM · Services (watching), Patch-For-Review, Readers-Web-Kanban-Board, Readers-Web-Backlog, Proton, Electron-PDFs
GWicke added a comment to T176627: Trial replacing Electron with headless Chromium in the render service.

Electron hangs have little to do with high rates, and very much to do with specific requests for very large / complex pages, and a single backend worker being used for many consecutive requests.

Oct 2 2017, 5:32 PM · Services (watching), Patch-For-Review, Readers-Web-Kanban-Board, Readers-Web-Backlog, Proton, Electron-PDFs
GWicke added a comment to T148592: Switch to restrictions-based access control.

@Pchelolo, agreed that the race is not critical. It is essentially just the normal delay in propagating new restrictions, and should be short in any case.

Oct 2 2017, 5:04 PM · Services (next), RESTBase

Sep 29 2017

GWicke added a comment to T176627: Trial replacing Electron with headless Chromium in the render service.

Queues caused many of the issues with OCG. I would really advise you to stick to a simple stateless HTTP service. Such a service offers sane error handling, provides back-pressure, integrates well with caching and rate / concurrency limiting infrastructure, and is easy to test and reason about. Once you add a queue & separate request from response, you lose all of this.

Sep 29 2017, 5:25 PM · Services (watching), Patch-For-Review, Readers-Web-Kanban-Board, Readers-Web-Backlog, Proton, Electron-PDFs

Sep 28 2017

Krinkle awarded T176520: Pageimage property (and possibly other page properties) not updated reliably after reverts a Orange Medal token.
Sep 28 2017, 11:37 PM · Readers-Web-Backlog (Tracking), MediaWiki-Database, PageImages, Services (watching)

Sep 27 2017

GWicke added a comment to T176785: Add action api counts to graphite-restbase job.

This metric would perfectly complement the REST equivalent in https://grafana.wikimedia.org/dashboard/db/api-summary?orgId=1, and as a result give us direct information on overall API use.

Sep 27 2017, 5:38 PM · Services (watching), Analytics-Kanban

Sep 26 2017

GWicke added a comment to T148592: Switch to restrictions-based access control.

In today's team sync meeting, we briefly touched on the possibility of combining the migration to the restriction table with the move to Cassandra 3. I think combining the two is attractive, as it lets us leverage the parallel double write / read testing we are doing anyway to test the new restriction storage as well. Doing this migration also lets us drop the revision table, in favor of action API requests for the few direct requests to the /title/{title} endpoint (T158100).

Sep 26 2017, 9:12 PM · Services (next), RESTBase

Sep 25 2017

GWicke edited projects for T176672: Purge stored restbase content for dewikitionary pages, added: Services (next); removed Services.

All wiktionaries combined are only about 20m pages of typically moderate complexity and relatively low access volume. I think in this case it might be fine to just nuke all wiktionary content.

Sep 25 2017, 9:14 PM · Services (done), RESTBase, Parsoid

Sep 22 2017

GWicke updated subscribers of T176520: Pageimage property (and possibly other page properties) not updated reliably after reverts.

@Tgr added this on a related mail thread:

Sep 22 2017, 9:16 PM · Readers-Web-Backlog (Tracking), MediaWiki-Database, PageImages, Services (watching)
GWicke updated the task description for T176520: Pageimage property (and possibly other page properties) not updated reliably after reverts.
Sep 22 2017, 9:13 PM · Readers-Web-Backlog (Tracking), MediaWiki-Database, PageImages, Services (watching)
GWicke updated subscribers of T176520: Pageimage property (and possibly other page properties) not updated reliably after reverts.
Sep 22 2017, 9:10 PM · Readers-Web-Backlog (Tracking), MediaWiki-Database, PageImages, Services (watching)
GWicke added projects to T176520: Pageimage property (and possibly other page properties) not updated reliably after reverts: Services (watching), PageImages.
Sep 22 2017, 8:55 PM · Readers-Web-Backlog (Tracking), MediaWiki-Database, PageImages, Services (watching)
GWicke created T176520: Pageimage property (and possibly other page properties) not updated reliably after reverts.
Sep 22 2017, 8:55 PM · Readers-Web-Backlog (Tracking), MediaWiki-Database, PageImages, Services (watching)

Sep 20 2017

GWicke updated subscribers of T173821: Investigate exposing content styles needed via API vs as HTML tags.
Sep 20 2017, 6:23 PM · RESTBase-API, Services (watching), Reading-Infrastructure-Team-Backlog (Kanban), Page Content Service
GWicke added a comment to T173821: Investigate exposing content styles needed via API vs as HTML tags.

If I recall correctly, ResourceLoader client code on desktop already looks at a list of modules needed in a given page, checks client side caches, and fetches the remaining modules from the RL API (in a single call), and caches those modules separately in localstorage. Given that this discussion is making no reference to this, I am getting the impression that this understanding might be wrong. Could you clarify?

Sep 20 2017, 6:22 PM · RESTBase-API, Services (watching), Reading-Infrastructure-Team-Backlog (Kanban), Page Content Service
GWicke added a comment to T173821: Investigate exposing content styles needed via API vs as HTML tags.

@Fjalapeno, that comment touches on 1), but as I said to me it looks like the API focused discussion has moved to 2). Either way, I am not sure we need a new API for either 1) or 2).

Sep 20 2017, 5:50 PM · RESTBase-API, Services (watching), Reading-Infrastructure-Team-Backlog (Kanban), Page Content Service
GWicke added a comment to T123854: Set up action API latency / error rate metrics & alerts.

FTR, this is the graph with the alert I mentioned: https://grafana.wikimedia.org/dashboard/db/restbase?panelId=12&fullscreen&orgId=1

Sep 20 2017, 4:12 PM · Services (watching), MediaWiki-API, Traffic, monitoring, Operations

Sep 19 2017

GWicke added a comment to T172224: Consider partitioning local_group_wikipedia even more.

At today's team sync we agreed with @Pchelolo's proposal:

Sep 19 2017, 8:06 PM · User-mobrovac, Services (done), Cassandra, RESTBase
GWicke added a comment to T175210: Select candidate jobs for transferring to the new infrastucture.

I honestly don't have a strong preference between the other "hearted" tasks. Given that all of them are fairly low volume, would it make sense to just deploy all of the hearted ones in the next wave?

Sep 19 2017, 6:10 PM · Patch-For-Review, Services (doing), MediaWiki-JobQueue, ChangeProp, EventBus, Analytics, Operations, User-Joe, User-Elukey

Sep 18 2017

GWicke added a comment to T173821: Investigate exposing content styles needed via API vs as HTML tags.

It sounds like there are two separate questions:

Sep 18 2017, 8:01 PM · RESTBase-API, Services (watching), Reading-Infrastructure-Team-Backlog (Kanban), Page Content Service
GWicke added a comment to T175882: Requesting access to scb* and pdfrender-admin for tgr.

I strongly support @Tgr's access request as well.

Sep 18 2017, 3:23 PM · Operations, Ops-Access-Requests
GWicke added a comment to T175957: Options for implementing JobQueue statistics methods.

Added the "fetch metrics from graphite / prometheus" option.

Sep 18 2017, 2:54 PM · Services (designing), MediaWiki-JobQueue, User-mobrovac, Analytics, ChangeProp, EventBus
GWicke updated the task description for T175957: Options for implementing JobQueue statistics methods.
Sep 18 2017, 2:53 PM · Services (designing), MediaWiki-JobQueue, User-mobrovac, Analytics, ChangeProp, EventBus

Sep 14 2017

GitHub <noreply@github.com> committed rMSCP1a5e44f940a9: Merge pull request #205 from Pchelolo/job_tests (authored by GWicke).
Merge pull request #205 from Pchelolo/job_tests
Sep 14 2017, 7:56 PM
GitHub <noreply@github.com> committed rMSCPe4d63f6de369: Merge pull request #207 from Pchelolo/more_frequent_stats (authored by GWicke).
Merge pull request #207 from Pchelolo/more_frequent_stats
Sep 14 2017, 7:56 PM
GWicke added a comment to T175316: Very large jobs posted by Wikidata.

Looks like adding the JSON_UNESCAPED_UNICODE flag should do it: http://php.net/manual/en/function.json-encode.php

Sep 14 2017, 7:14 PM · MW-1.30-release-notes (WMF-deploy-2017-09-19 (1.30.0-wmf.19)), Patch-For-Review, EventBus, Analytics, Services (designing), Wikidata

Sep 13 2017

GWicke added a comment to T175210: Select candidate jobs for transferring to the new infrastucture.

Given the useful information we have in this task, I am proposing to widen the scope beyond the first job, towards generally coordinating the order of migrating individual jobs. @mobrovac, does that sound reasonable to you?

Sep 13 2017, 5:57 PM · Patch-For-Review, Services (doing), MediaWiki-JobQueue, ChangeProp, EventBus, Analytics, Operations, User-Joe, User-Elukey
GWicke lowered the priority of T175800: Allow easy tuning of the jobqueue concurrency. from Normal to Low.

We briefly discussed this during today's sync meeting. While there are ways to set up targeted processing priorities for specific jobs (by wiki, type, or other criteria), we realized that there will likely be less of a need for this in the new setup. The Redis job queue divides processing throughput evenly between projects. This makes it relatively likely for individual projects to accumulate large backlogs, which would then need manual intervention (re-prioritization) to address.

Sep 13 2017, 5:46 PM · Services (designing), MediaWiki-JobQueue, User-mobrovac, Analytics, ChangeProp, EventBus
GWicke added a comment to T175316: Very large jobs posted by Wikidata.

Raised priority, as this is a) blocking the migration to the Kafka job queue backend (T157088), and b) is likely already causing performance and possibly reliability issues in the current job queue.

Sep 13 2017, 5:30 PM · MW-1.30-release-notes (WMF-deploy-2017-09-19 (1.30.0-wmf.19)), Patch-For-Review, EventBus, Analytics, Services (designing), Wikidata
GWicke raised the priority of T175316: Very large jobs posted by Wikidata from Normal to High.
Sep 13 2017, 5:11 PM · MW-1.30-release-notes (WMF-deploy-2017-09-19 (1.30.0-wmf.19)), Patch-For-Review, EventBus, Analytics, Services (designing), Wikidata
GitHub <noreply@github.com> committed rMSCPbabbc777cf62: Merge pull request #204 from Pchelolo/redis_key_prefix (authored by GWicke).
Merge pull request #204 from Pchelolo/redis_key_prefix
Sep 13 2017, 12:11 PM
GitHub <noreply@github.com> committed rMSCP22cda1868f4f: Merge pull request #201 from Pchelolo/node_v8 (authored by GWicke).
Merge pull request #201 from Pchelolo/node_v8
Sep 13 2017, 12:11 PM

Sep 12 2017

GWicke updated subscribers of T174993: Vandalism in "In the news" articles persisting in the app' ?.

As far as I can tell, the page image(s) are handled as part of deferred linksUpdate processing. This means that the updates would be executed after the main web request, but on the same PHP thread that handled the original edit request.

Sep 12 2017, 6:49 PM · Reading-Infrastructure-Team-Backlog, Services (watching), Mobile, Wikipedia-iOS-App-Backlog, Wikipedia-Android-App-Backlog, iOS-app-Bugs, Android-app-Bugs
GWicke added a comment to T172224: Consider partitioning local_group_wikipedia even more.

Considering the scalability limits of Cassandra's schema synchronization we see in production, I think it would be good to reduce the number of storage groups more aggressively. Perhaps something like this?

Sep 12 2017, 5:20 PM · User-mobrovac, Services (done), Cassandra, RESTBase

Sep 11 2017

GWicke closed T170319: End of August milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure. as Resolved.

Update from our month-end check-in:

Sep 11 2017, 10:01 PM · Services (doing), User-Joe, User-Elukey, Goal, Epic
GWicke closed T170319: End of August milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure., a subtask of T169937: Services Q1 2017/18 goal: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure., as Resolved.
Sep 11 2017, 10:01 PM · Services (done), Operations, User-Joe, User-Elukey, Goal, Epic
GWicke created T175637: End of September milestone: Migrate first production use case.
Sep 11 2017, 9:59 PM · Services (done), Operations, User-Joe, User-Elukey, Goal, Epic
GWicke added a comment to T175210: Select candidate jobs for transferring to the new infrastucture.

IMHO, updateBetaFeaturesUserCounts is the perfect candidate here. It's very lightweight (one SELECT, one UPDATE), it's idempotent and low-volume.

Sep 11 2017, 7:16 PM · Patch-For-Review, Services (doing), MediaWiki-JobQueue, ChangeProp, EventBus, Analytics, Operations, User-Joe, User-Elukey
GWicke added a comment to T175305: mobile-sections: Cannot read property 'indexOf' of undefined in markReferenceSections.

@bearND, MediaWiki's section edit feature is implemented without knowledge of a DOM, so <div> wrappers do not suppress edit sections. Example: https://en.wikipedia.org/wiki/User:GWicke/TestSections with source

Sep 11 2017, 7:12 PM · Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban)
GWicke added a comment to T174993: Vandalism in "In the news" articles persisting in the app' ?.

I believe it was the pageimages designation for those articles I mentioned above. Not exactly sure what happened on wiki since the revisions have been deleted from public archives (and I don't have the permission to view it).

Sep 11 2017, 5:51 PM · Reading-Infrastructure-Team-Backlog, Services (watching), Mobile, Wikipedia-iOS-App-Backlog, Wikipedia-Android-App-Backlog, iOS-app-Bugs, Android-app-Bugs
GWicke added a comment to T174993: Vandalism in "In the news" articles persisting in the app' ?.

Just to clarify what exactly happened here: The offending edits were adding an image to the featured page itself, and also nominated that image to be the pageimage?

Sep 11 2017, 4:59 PM · Reading-Infrastructure-Team-Backlog, Services (watching), Mobile, Wikipedia-iOS-App-Backlog, Wikipedia-Android-App-Backlog, iOS-app-Bugs, Android-app-Bugs
GWicke added a comment to T175281: Separate off ChangePropagation for JobQueue as a new deployment.

Yay! 🎆

Sep 11 2017, 4:01 PM · Services (done), User-mobrovac, Service-deployment-requests, Operations, MediaWiki-JobQueue, EventBus, ChangeProp, Analytics
GWicke added a comment to T120242: Reliable (atomic) MediaWiki event production.

@Ottomata, from a cursory look at those connectors, it looks like they all aim to capture all SQL updates (update, insert, delete). They don't seem to be targeted at emitting specific semantic events, such as the ones we are interested in for EventBus. This is where the SQL comment idea could help, by letting us essentially embed the events we want to have emitted in the statement, rather than trying to reverse-engineer an event from raw SQL statement(s).

Sep 11 2017, 3:58 PM · Services (later)
GWicke updated subscribers of T175316: Very large jobs posted by Wikidata.
Sep 11 2017, 3:49 PM · MW-1.30-release-notes (WMF-deploy-2017-09-19 (1.30.0-wmf.19)), Patch-For-Review, EventBus, Analytics, Services (designing), Wikidata
GWicke updated subscribers of T174982: Sourcemap is incorrect in RESTBase help page.
Sep 11 2017, 3:40 PM · Services (later), RESTBase-API, RESTBase
GWicke added a comment to T174982: Sourcemap is incorrect in RESTBase help page.

Looking at the three custom changes we did on top of upstream in https://github.com/wikimedia/swagger-ui/commits/master, it seems that the build process we ran after each did not update the source map. However, the gulpfile defines "dist" to be part of the default task (see https://github.com/wikimedia/swagger-ui/blob/master/gulpfile.js#L188). Perhaps we "just" forgot to check in the updated source maps? /cc @Pchelolo

Sep 11 2017, 3:40 PM · Services (later), RESTBase-API, RESTBase
GWicke added a comment to T175305: mobile-sections: Cannot read property 'indexOf' of undefined in markReferenceSections.

In terms of document structure, the behavior in line two (add section around <div>-wrapped heading) seems to make sense. I think it also matches edit section behavior, which should ignore the <div> completely (as it is not DOM-based).

Sep 11 2017, 3:13 PM · Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban)

Sep 8 2017

GWicke updated the task description for T169116: Support flagged revisions in RESTBase.
Sep 8 2017, 9:23 PM · Patch-For-Review, Services (doing), RESTBase-API, RESTBase, VisualEditor, Reading-Infrastructure-Team-Backlog, Mobile-Content-Service
GWicke added a comment to T156829: Remove must-revalidate cache-control header from mobile-sections-lead and mobile-sections-remaining responses.

From a practical perspective, I think the biggest question is how common clients behave these days when must-revalidate is omitted, and the client cache timeout expires. My memory on this is rather foggy, but I *think* in the dark ages behavior in that area was inconsistent, with early IE versions not re-validating even when they were online. If we can verify that all browsers we care about do the right thing (check as if must-revalidate was set when connected), then dropping must-revalidate in the headers would be harmless.

Sep 8 2017, 6:48 PM · Reading-Infrastructure-Team-Backlog, RESTBase, Mobile-Content-Service, Android-app-Bugs, Wikipedia-Android-App-Backlog
GWicke added a comment to T76541: Somehow(?) load document-level data (e.g. internal lists, meta lists) for the whole document but only the content for a part of the document.

We already support fetching specific HTML sections by ID in the REST API (see https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_html_title), but until consistent <section> wrapping with a sensible granularity & perhaps a predictable section ID for the lead section are implemented in Parsoid (T114072), this is not as useful in practice as it could be.

Sep 8 2017, 6:36 PM · VisualEditor-MediaWiki, VisualEditor, VisualEditor-Performance
GWicke updated the task description for T169116: Support flagged revisions in RESTBase.
Sep 8 2017, 6:12 PM · Patch-For-Review, Services (doing), RESTBase-API, RESTBase, VisualEditor, Reading-Infrastructure-Team-Backlog, Mobile-Content-Service
GWicke updated the task description for T175316: Very large jobs posted by Wikidata.
Sep 8 2017, 5:07 PM · MW-1.30-release-notes (WMF-deploy-2017-09-19 (1.30.0-wmf.19)), Patch-For-Review, EventBus, Analytics, Services (designing), Wikidata
GWicke added a comment to T175318: Optimize SVGs in data URIs.

This proposed optimization is similar to something I implemented in Parsoid's HTML5 serializer. In that case, we switch between single & double quotes for HTML attributes depending on whether the attribute value contains more single quotes or double quotes. This had a very significant impact on Parsoid HTML size, mainly because it has many JSON values embedded in attributes.

Sep 8 2017, 3:52 PM · MW-1.31-release-notes (WMF-deploy-2017-09-26 (1.31.0-wmf.1)), MW-1.30-release-notes (WMF-deploy-2017-09-19 (1.30.0-wmf.19)), Front-end-Standards-Group, Performance-Team (Radar), MediaWiki-ResourceLoader
GWicke added a comment to T175316: Very large jobs posted by Wikidata.

@Pchelolo, based on our previous conversation about this I am assuming that the bulk of the task is a very large list of pages. Is this correct?

Sep 8 2017, 3:43 PM · MW-1.30-release-notes (WMF-deploy-2017-09-19 (1.30.0-wmf.19)), Patch-For-Review, EventBus, Analytics, Services (designing), Wikidata

Sep 7 2017

GWicke added a comment to T120242: Reliable (atomic) MediaWiki event production.

Facebook actually heavily relies on SQL comments to pass event information to binlog tailer daemons (see the TAO paper). We currently use those SQL comments only to mark the source of a SQL query (PHP function), but could potentially add some annotations that would make it easy to generically extract & export such events into individual Kafka topics.

Sep 7 2017, 10:37 PM · Services (later)
GWicke added a comment to T175305: mobile-sections: Cannot read property 'indexOf' of undefined in markReferenceSections.

Starting a new section when encountering a new heading of the same level is expected behavior, in line with MediaWiki section edit behavior, as well as HTML5 semantics. When encountering a heading of a higher level (higher number, lower prominence), the sectioning code I wrote in parsoid-utils creates a nested section. This is in line with typical HTML5 section and page outline semantics: https://developer.mozilla.org/en-US/docs/Web/Guide/HTML/Using_HTML_sections_and_outlines.

Sep 7 2017, 10:04 PM · Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban)
GWicke added a comment to T151934: Check & possibly improve request id handling in changeprop.

Rebased PR now ready at https://github.com/wikimedia/change-propagation/pull/203.

Sep 7 2017, 8:51 PM · Services (done), ChangeProp
GWicke updated subscribers of T175213: 2017/18 Annual Plan Program 8: Multi-datacenter support, Q2 goals.
Sep 7 2017, 4:29 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke updated subscribers of T175206: 2017/18 Annual Plan Program 8: Multi-datacenter support.
Sep 7 2017, 4:29 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke renamed T175206: 2017/18 Annual Plan Program 8: Multi-datacenter support from 2017/18 annual plan program 8: Multi-datacenter support to 2017/18 Annual Plan Program 8: Multi-datacenter support.
Sep 7 2017, 4:20 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke added a comment to T170120: Standardize on the "default" pod setup.

I don't have strong views on how to scale metrics and log collection. In any case, we have been doing this remotely for a while now (using standard formats like gelf for logs), so whether things are aggregated per pod or more centrally doesn't make a big difference to the services themselves.

Sep 7 2017, 3:17 PM · User-Joe, Services (watching), Kubernetes, Operations, Goal

Sep 6 2017

GWicke added a subtask for T175213: 2017/18 Annual Plan Program 8: Multi-datacenter support, Q2 goals: T175212: Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure..
Sep 6 2017, 8:19 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke added a parent task for T175212: Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure.: T175213: 2017/18 Annual Plan Program 8: Multi-datacenter support, Q2 goals.
Sep 6 2017, 8:19 PM · Services (doing), Patch-For-Review, MediaWiki-JobQueue, ChangeProp, Analytics, EventBus, Goal
GWicke updated the task description for T175213: 2017/18 Annual Plan Program 8: Multi-datacenter support, Q2 goals.
Sep 6 2017, 8:14 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke created T175213: 2017/18 Annual Plan Program 8: Multi-datacenter support, Q2 goals.
Sep 6 2017, 8:06 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke renamed T175212: Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure. from Services Q1 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure. to Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure..
Sep 6 2017, 8:06 PM · Services (doing), Patch-For-Review, MediaWiki-JobQueue, ChangeProp, Analytics, EventBus, Goal
GWicke renamed T175212: Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure. from Services Q1 2017/18 goal: Migrate most jobs to multi-DC enabled event processing infrastructure. to Services Q1 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure..
Sep 6 2017, 8:04 PM · Services (doing), Patch-For-Review, MediaWiki-JobQueue, ChangeProp, Analytics, EventBus, Goal
GWicke created T175212: Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure..
Sep 6 2017, 8:04 PM · Services (doing), Patch-For-Review, MediaWiki-JobQueue, ChangeProp, Analytics, EventBus, Goal
GWicke updated the task description for T175206: 2017/18 Annual Plan Program 8: Multi-datacenter support.
Sep 6 2017, 7:55 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke created T175206: 2017/18 Annual Plan Program 8: Multi-datacenter support.
Sep 6 2017, 7:51 PM · MediaWiki-Platform-Team, Performance-Team (Radar), Epic, Operations, Services (watching)
GWicke updated subscribers of T174993: Vandalism in "In the news" articles persisting in the app' ?.

@bearND: Okay, nevermind then. @Pchelolo or @mobrovac, is there any other caching for the explore feed?

Sep 6 2017, 6:25 PM · Reading-Infrastructure-Team-Backlog, Services (watching), Mobile, Wikipedia-iOS-App-Backlog, Wikipedia-Android-App-Backlog, iOS-app-Bugs, Android-app-Bugs
GWicke updated subscribers of T174993: Vandalism in "In the news" articles persisting in the app' ?.
Sep 6 2017, 5:40 PM · Reading-Infrastructure-Team-Backlog, Services (watching), Mobile, Wikipedia-iOS-App-Backlog, Wikipedia-Android-App-Backlog, iOS-app-Bugs, Android-app-Bugs
GWicke added a comment to T174993: Vandalism in "In the news" articles persisting in the app' ?.

@bearND, until recently the cache timeout for the trending response was 30 minutes. @Pchelolo lowered it to five minutes in https://gerrit.wikimedia.org/r/#/c/374648/, after the issue was reported on the staff channel by @jynus.

Sep 6 2017, 5:39 PM · Reading-Infrastructure-Team-Backlog, Services (watching), Mobile, Wikipedia-iOS-App-Backlog, Wikipedia-Android-App-Backlog, iOS-app-Bugs, Android-app-Bugs
GWicke added a comment to T171965: [Spike - 8 hours] How should the PDF post-processing script be exposed for use by Extension:Collection.

This service would replace the current electron pdf renderer as well on the medium/long run, right?

Sep 6 2017, 2:16 PM · Proton, Readers-Web-Kanban-Board, Electron-PDFs, Readers-Web-Backlog (Tracking), Spike
GWicke added a comment to T174982: Sourcemap is incorrect in RESTBase help page.

cause an error by putting the wrong URL in the input field

Could you elaborate on this? Which input field are you referring to?

Sep 6 2017, 12:48 AM · Services (later), RESTBase-API, RESTBase
GWicke added a comment to T150871: [EPIC] (Proposal) Replicate core OCG features and sunset OCG service.

Thanks for the update & clarity on the timeline, @ovasileva! It is much appreciated.

Sep 6 2017, 12:47 AM · Readers-Web-Backlog (Tracking), Services (watching), OCG-General, User-mobrovac, Epic, Readers-Community-Engagement, Operations

Sep 5 2017

GWicke updated the task description for T171965: [Spike - 8 hours] How should the PDF post-processing script be exposed for use by Extension:Collection.
Sep 5 2017, 5:01 PM · Proton, Readers-Web-Kanban-Board, Electron-PDFs, Readers-Web-Backlog (Tracking), Spike
GWicke edited projects for T170319: End of August milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure., added: Services (doing); removed Services (later).
Sep 5 2017, 2:48 PM · Services (doing), User-Joe, User-Elukey, Goal, Epic
GWicke edited projects for T174992: Update zotero translators , added: Services (watching); removed Services.
Sep 5 2017, 2:47 PM · User-Ryasmeen, Services (watching), VisualEditor, Citoid

Aug 31 2017

GWicke added a comment to T171965: [Spike - 8 hours] How should the PDF post-processing script be exposed for use by Extension:Collection.

@Tgr, at first sight it looks like there are reasonable python bindings for headless Chrome as well. Combined with the PDF post-processing library you have been testing, I could see a simple python service doing both pre/postprocessing and actual rendering work well. The service portion of either option is trivial in any case, and all the heavy lifting is in the libraries & Chrome.

Aug 31 2017, 10:26 PM · Proton, Readers-Web-Kanban-Board, Electron-PDFs, Readers-Web-Backlog (Tracking), Spike
GWicke added a comment to T173710: Job queue is increasing non-stop.

I updated https://gerrit.wikimedia.org/r/#/c/295027/ to apply on current master. This removes CDN purges from HTMLCacheUpdate, and only performs them after RefreshLinks, and only if nothing else caused a re-render since.

Aug 31 2017, 7:36 PM · User-Elukey, Patch-For-Review, Services (watching), Performance-Team (Radar), Discovery, CirrusSearch, Wikidata, Operations, MediaWiki-JobQueue