Page MenuHomePhabricator

Mholloway (Michael Holloway)
Senior Software Engineer

Projects (9)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Mar 30 2015, 8:44 PM (314 w, 6 d)
Availability
Available
IRC Nick
mholloway
LDAP User
Mholloway
MediaWiki User
MHolloway (WMF) [ Global Accounts ]

Recent Activity

Fri, Apr 2

Mholloway created T279180: Add CI jobs for mediawiki/libs/metrics-platform.
Fri, Apr 2, 7:28 PM · Continuous-Integration-Config, Better Use Of Data, Product-Data-Infrastructure

Thu, Apr 1

Mholloway added a comment to T218835: prefUpdate schema contains multiple identical events for the same preference update.

The fixed patch finally rolled out on Tuesday 3/30 with 1.36.0-wmf.36. It looks like it's almost completely eliminated duplicate entries from the PrefUpdate table, down from several hundred duplicate events per day prior to the change. Yesterday there were no duplicate events, and today so far there is only one duplicate popupsreferencepreviews change.

Thu, Apr 1, 9:27 PM · MW-1.36-notes (1.36.0-wmf.36; 2021-03-23), Readers-Web-Backlog (Kanbanana-FY-2020-21), Better Use Of Data, Product-Data-Infrastructure, Analytics-Radar, Product-Analytics
Mholloway created T279089: Create or identify an appropriate Gerrit group for +2 rights on schemas/event/secondary.
Thu, Apr 1, 5:25 PM · Product-Data-Infrastructure, Product-Analytics, Better Use Of Data, Analytics, Gerrit-Privilege-Requests
Mholloway committed rMLMPe3c007dbca19: Add COPYING and CODE_OF_CONDUCT.md (authored by Mholloway).
Add COPYING and CODE_OF_CONDUCT.md
Thu, Apr 1, 1:44 PM

Wed, Mar 31

Mholloway awarded T278467: Use Hive/Spark timestamps in Refined event data a Party Time token.
Wed, Mar 31, 2:45 PM · Research, Product-Analytics, Analytics

Mon, Mar 22

Mholloway added a comment to T218835: prefUpdate schema contains multiple identical events for the same preference update.

No worries, @nray! Thanks for the update.

Mon, Mar 22, 6:06 PM · MW-1.36-notes (1.36.0-wmf.36; 2021-03-23), Readers-Web-Backlog (Kanbanana-FY-2020-21), Better Use Of Data, Product-Data-Infrastructure, Analytics-Radar, Product-Analytics
Mholloway added a comment to T218835: prefUpdate schema contains multiple identical events for the same preference update.

@nray Do you plan to review updated patch (updated only to add a null check), or can @jlinehan and I get it merged today to roll out this week?

Mon, Mar 22, 3:07 PM · MW-1.36-notes (1.36.0-wmf.36; 2021-03-23), Readers-Web-Backlog (Kanbanana-FY-2020-21), Better Use Of Data, Product-Data-Infrastructure, Analytics-Radar, Product-Analytics
Mholloway moved T218835: prefUpdate schema contains multiple identical events for the same preference update from Next to Reviewing on the Product-Data-Infrastructure board.
Mon, Mar 22, 3:04 PM · MW-1.36-notes (1.36.0-wmf.36; 2021-03-23), Readers-Web-Backlog (Kanbanana-FY-2020-21), Better Use Of Data, Product-Data-Infrastructure, Analytics-Radar, Product-Analytics

Mon, Mar 15

Mholloway added a comment to T276515: Generate Session Length test data.

Since it's a near-term follow-up, my vote would be to keep this one open.

Mon, Mar 15, 4:13 PM · Product-Analytics, Patch-For-Review, MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Better Use Of Data

Mar 12 2021

Mholloway awarded Blog Post: Tracking memory issue in a Java application a 100 token.
Mar 12 2021, 2:09 PM · Gerrit, Release-Engineering-Team (Development services)

Mar 11 2021

Mholloway added a comment to T277229: UserOptionsManager: Argument 1 passed to MediaWiki\User\UserOptionsManager::setOption() must implement interface MediaWiki\User\UserIdentity, null given.

Ah, sorry, not happening anymore. Looks like this was only occurring for a brief window at 22:30.

Mar 11 2021, 10:53 PM · MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), User-brennen, MobileFrontend, Mobile-Web-Settings, Wikimedia-production-error
Mholloway added a comment to T277229: UserOptionsManager: Argument 1 passed to MediaWiki\User\UserOptionsManager::setOption() must implement interface MediaWiki\User\UserIdentity, null given.

I'm seeing a lot of this in the logs, too, and it doesn't make any sense to me, because the patch updates both signatures:

Mar 11 2021, 10:47 PM · MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), User-brennen, MobileFrontend, Mobile-Web-Settings, Wikimedia-production-error
Mholloway added a comment to T277229: UserOptionsManager: Argument 1 passed to MediaWiki\User\UserOptionsManager::setOption() must implement interface MediaWiki\User\UserIdentity, null given.

Reverting.

Mar 11 2021, 9:37 PM · MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), User-brennen, MobileFrontend, Mobile-Web-Settings, Wikimedia-production-error
Mholloway added a comment to T218835: prefUpdate schema contains multiple identical events for the same preference update.

From my preliminary spot checking, the patch appears to have eliminated duplicates on the group 0 and 1 wikis to which it's been deployed so far. I look forward to seeing the results after it's promoted to group 2 this afternoon.

Mar 11 2021, 7:54 PM · MW-1.36-notes (1.36.0-wmf.36; 2021-03-23), Readers-Web-Backlog (Kanbanana-FY-2020-21), Better Use Of Data, Product-Data-Infrastructure, Analytics-Radar, Product-Analytics

Mar 10 2021

Mholloway added a comment to T277051: Jenkins-bot does not submit changes on passing gate-and-submit for /schemas/event/* repos.

Looking good! Thank you, @hashar!

Mar 10 2021, 4:45 PM · Analytics, Event-Platform, Continuous-Integration-Config
Mholloway created T277051: Jenkins-bot does not submit changes on passing gate-and-submit for /schemas/event/* repos.
Mar 10 2021, 3:10 PM · Analytics, Event-Platform, Continuous-Integration-Config
Mholloway added a comment to T276962: Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up`.

To add a data point, my new environment is still working well starting from a cold boot this morning.

Mar 10 2021, 2:24 PM · MediaWiki-Docker
Mholloway updated the task description for T276962: Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up`.
Mar 10 2021, 2:22 PM · MediaWiki-Docker

Mar 9 2021

Mholloway awarded T253924: Allow passing arguments into container a Like token.
Mar 9 2021, 11:46 PM · Fresh
Mholloway updated the task description for T276962: Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up`.
Mar 9 2021, 6:10 PM · MediaWiki-Docker
Mholloway renamed T276962: Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up` from Job runner frequently fails to obtain a replica DB connection to MySQL on `docker-compose up` to Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up`.
Mar 9 2021, 6:08 PM · MediaWiki-Docker
Mholloway added a comment to T276962: Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up`.

OK, I've started from a fresh slate with DB replication and things are looking better. When I take the environment down and spin it back up, there are a few of the same errors from the job runner container, but it eventually connects after the replica DB finishes starting up. With the single-MySQL installation, the job runner just kept spewing the same error indefinitely. Maybe for some reason it's expecting a replica DB that doesn't exist?

Mar 9 2021, 5:56 PM · MediaWiki-Docker
Mholloway added a comment to T276962: Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up`.

Caveat: I'm not positive that my wiki was configured correctly when I tried setting up replication earlier. I'll try setting up a fresh installation using DB replication from the start and see if I have better luck. In any case this is a bug for installations using a single MySQL instance.

Mar 9 2021, 5:14 PM · MediaWiki-Docker
Mholloway updated the task description for T276962: Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up`.
Mar 9 2021, 4:56 PM · MediaWiki-Docker
Mholloway created T276962: Job runner in single-MySQL environment fails to obtain a DB connection on `docker-compose up`.
Mar 9 2021, 4:54 PM · MediaWiki-Docker
Mholloway added a comment to T276515: Generate Session Length test data.

@Mayakp.wiki, I've added some general info on ad blocker effects on event logging on-wiki at https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging#Ad_blockers. In a nutshell, if your ad blocker uses the EasyPrivacy block list, then requests to our analytics event intake services will be blocked. There may be others that we don't yet know about.

Mar 9 2021, 3:11 PM · Product-Analytics, Patch-For-Review, MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Better Use Of Data

Mar 8 2021

Mholloway added a comment to T276515: Generate Session Length test data.

@Mayakp.wiki You should now be a member of the data-qa group on Test Wikipedia. You can verify this by viewing your current groups here: https://test.wikipedia.org/w/api.php?action=query&meta=userinfo&uiprop=groups

Mar 8 2021, 10:16 PM · Product-Analytics, Patch-For-Review, MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Better Use Of Data
Mholloway removed a watcher for Mobile-Content-Service: Mholloway.
Mar 8 2021, 2:54 PM

Mar 5 2021

Mholloway closed T255169: ca-certificates 20200601~deb10u1 lacks GeoTrust Global CA certificate required for APNS as Resolved.
Mar 5 2021, 10:15 PM · Product-Infrastructure-Team-Backlog, Push-Notification-Service
Mholloway updated the task description for T218729: Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster.
Mar 5 2021, 9:59 PM · Cloud-VPS (Debian Jessie Deprecation), Beta-Cluster-Infrastructure
Mholloway added a comment to T218729: Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster.

deployment-mcs01 is obsolete, superseded by deployment-docker-mobileapps01. I'll shut it down momentarily.

Mar 5 2021, 9:55 PM · Cloud-VPS (Debian Jessie Deprecation), Beta-Cluster-Infrastructure
Mholloway updated the task description for T210704: Migrate node-based services in production to node10.
Mar 5 2021, 9:10 PM · Platform Team Initiatives (Containerise Services), serviceops, SRE
Mholloway closed T215539: Node.js 10 changes encoding for at least one Georgian character as Declined.

This ship has sailed. Declining as non-actionable.

Mar 5 2021, 9:08 PM · Services (watching), I18n, Product-Infrastructure-Team-Backlog
Mholloway closed T215539: Node.js 10 changes encoding for at least one Georgian character, a subtask of T218733: Migrate mobileapps to k8s and node 10, as Declined.
Mar 5 2021, 9:08 PM · Product-Infrastructure-Team-Backlog, serviceops, Patch-For-Review, Page Content Service, Mobile-Content-Service
Mholloway added a comment to T261842: Create schema to track users opting in/out of desktop improvements.

Thanks for the explanation and pointers, @nray. That clears things up.

Mar 5 2021, 7:45 PM · MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Product-Analytics, Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements
Mholloway updated subscribers of T276515: Generate Session Length test data.

OK, the code for this is teed up. The MW config change shouldn't be merged/deployed until next week because of the no-Friday-deploys rule, but the WikimediaEvents change can be merged anytime. Once the config change lands, I'll add @Mayakp.wiki to the data-qa group on testwiki (and also myself, to ensure that it works first) using createAndPromote.php.

Mar 5 2021, 3:59 PM · Product-Analytics, Patch-For-Review, MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Better Use Of Data

Mar 4 2021

Mholloway added a comment to T276502: [SessionLength] Change sampling rate to 10%.

Oops, assigned to @mforns. I teed up a patch for you. ;)

Mar 4 2021, 8:58 PM · Product-Analytics, Better Use Of Data
Mholloway added a comment to T261842: Create schema to track users opting in/out of desktop improvements.

@ovasileva could you expand on "Due to some issues with the preference update schema" - it's hard to analyze this without fully understanding/defining what's not working for us and what will work differently.

I believe that, since the changes from last year, the preferences schema currently cannot tell between a default that is set for a specific feature and a change in preference - as in, an opt-in by default and an opt-in by choice look the same within the schema. Our schema would distinguish between these two states.

Mar 4 2021, 8:12 PM · MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Product-Analytics, Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements

Mar 3 2021

Mholloway renamed T275070: [Metrics Platform] Finalize Metrics Platform API across platforms from [Metrics Platform] Finalize client library API across platforms to [Metrics Platform] Finalize Metrics Platform API across platforms.
Mar 3 2021, 7:32 PM · Better Use Of Data
Mholloway added a comment to T273535: GapFinder tool returns error message for every pair of languages.

(Unsubscribing since this is about the Python recommendation-api project, which I don't know much about, and not the Node.js recommendation-api project, which I do know something about.)

Mar 3 2021, 5:22 PM · Recommendation-API, GapFinder
Mholloway added a comment to T273535: GapFinder tool returns error message for every pair of languages.

I just took a quick look, and it seems to be working fine. For example, just now, I set the source language to English and the target language to Esperanto, entered "Town" in the search box, and hit enter, and got several results, just as I'd expect.

Mar 3 2021, 5:19 PM · Recommendation-API, GapFinder
Mholloway added a comment to T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check.

@kzimmerman Updated the wiki; please let me know if that looks good!

Mar 3 2021, 2:41 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data

Mar 2 2021

Mholloway added a comment to T276235: [MEP] [BUG] Timestamp format changed in migrated server-side EventLogging schemas.

Verified that timestamps are now coming in with expected format and time zone.

hive (event)> select dt, client_dt, meta.dt as meta_dt from serversideaccountcreation where year = 2021 and month = 3 and day = 2 order by meta_dt desc limit 10;
<snip>
OK
dt	client_dt	meta_dt
2021-03-02T18:59:52Z	2021-03-02T18:59:48Z	2021-03-02T18:59:52.534Z
2021-03-02T18:59:44Z	2021-03-02T18:59:40Z	2021-03-02T18:59:44.410Z
2021-03-02T18:59:43Z	2021-03-02T18:59:41Z	2021-03-02T18:59:43.909Z
2021-03-02T18:59:25Z	2021-03-02T18:59:19Z	2021-03-02T18:59:25.190Z
2021-03-02T18:59:23Z	2021-03-02T18:59:20Z	2021-03-02T18:59:23.166Z
2021-03-02T18:59:21Z	2021-03-02T18:59:17Z	2021-03-02T18:59:21.948Z
2021-03-02T18:59:12Z	2021-03-02T18:59:08Z	2021-03-02T18:59:12.697Z
2021-03-02T18:59:10Z	2021-03-02T18:59:07Z	2021-03-02T18:59:10.122Z
2021-03-02T18:59:05Z	2021-03-02T18:59:03Z	2021-03-02T18:59:05.412Z
2021-03-02T18:58:54Z	2021-03-02T18:58:49Z	2021-03-02T18:58:54.788Z
Time taken: 44.371 seconds, Fetched: 10 row(s)
Mar 2 2021, 10:22 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Event-Platform, Product-Analytics, Product-Data-Infrastructure, Analytics
Mholloway awarded T260401: Avoid unfinished train deploys over holidays, weekends, or other stretches of no-deploy days a Like token.
Mar 2 2021, 5:34 PM · Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), User-brennen, Sustainability (Incident Followup), Deployments
Mholloway closed T272863: EventLogging PHP EventServiceClient should use EventBus->send(). as Resolved.
Mar 2 2021, 2:57 PM · MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), Release-Engineering-Team (CI & Testing services), Continuous-Integration-Config, ci-test-error, Patch-For-Review, Product-Data-Infrastructure, Event-Platform, Analytics, Better Use Of Data
Mholloway closed T272863: EventLogging PHP EventServiceClient should use EventBus->send()., a subtask of T253121: MEP Client MediaWiki PHP, as Resolved.
Mar 2 2021, 2:57 PM · MW-1.36-notes (1.36.0-wmf.27; 2021-01-19), Patch-For-Review, Product-Data-Infrastructure, Event-Platform, Analytics, Better Use Of Data
Mholloway added a comment to T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check.

Thanks @Mholloway ! Some followups:

The data collected showed that fewer than 5% of clients lack passive event listener support

On T274264#6816810, you wrote 0.77% ; would it be reasonable to say "fewer than 1%"?

Yes, better.

Mar 2 2021, 2:53 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data

Feb 25 2021

Mholloway moved T263041: OperationError: The operation failed for an operation-specific reason in generateRandomSessionId from Inbox to QA/Review on the Better Use Of Data board.
Feb 25 2021, 2:04 PM · MW-1.36-notes (1.36.0-wmf.33; 2021-03-02), Better Use Of Data, Analytics-Radar, Product-Data-Infrastructure, Event-Platform, JavaScript, Analytics-EventLogging, Wikimedia-production-error
Mholloway moved T263041: OperationError: The operation failed for an operation-specific reason in generateRandomSessionId from Watching to Done on the Product-Data-Infrastructure board.
Feb 25 2021, 2:03 PM · MW-1.36-notes (1.36.0-wmf.33; 2021-03-02), Better Use Of Data, Analytics-Radar, Product-Data-Infrastructure, Event-Platform, JavaScript, Analytics-EventLogging, Wikimedia-production-error
Mholloway claimed T263041: OperationError: The operation failed for an operation-specific reason in generateRandomSessionId .

Thanks @jlinehan and @Krinkle for reviewing. I'll claim this and follow up in Logstash after the change rolls out.

Feb 25 2021, 2:03 PM · MW-1.36-notes (1.36.0-wmf.33; 2021-03-02), Better Use Of Data, Analytics-Radar, Product-Data-Infrastructure, Event-Platform, JavaScript, Analytics-EventLogging, Wikimedia-production-error

Feb 24 2021

Mholloway added a watcher for tech-decision-forum: Mholloway.
Feb 24 2021, 10:08 PM
Mholloway updated the task description for T275070: [Metrics Platform] Finalize Metrics Platform API across platforms.
Feb 24 2021, 7:16 PM · Better Use Of Data
Mholloway added a comment to T274220: Populate MachineVision databases for images commonly returned by search.

No, it shouldn't be a problem. I was being extremely conservative when I wrote that script, more because I was worried about blowing past our Google Cloud Vision budget than for any other reason. Either updating the script to be more efficient or running multiple instances in parallel should be fine.

Feb 24 2021, 2:47 PM · Discovery-Search (Current work), Structured-Data-Backlog, MachineVision

Feb 23 2021

Mholloway moved T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check from Doing to Sign-off on the Better Use Of Data board.
Feb 23 2021, 5:40 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data
Mholloway reopened T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check, a subtask of T274172: [Session Length] Complete sessionTick deployment to all wikis, as Open.
Feb 23 2021, 5:40 PM · Better Use Of Data
Mholloway reopened T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check as "Open".

Whoops, moving back to signoff for now.

Feb 23 2021, 5:40 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data
Mholloway closed T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check, a subtask of T274172: [Session Length] Complete sessionTick deployment to all wikis, as Resolved.
Feb 23 2021, 5:39 PM · Better Use Of Data
Mholloway closed T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check as Resolved.

https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/SessionLength#Passive_event_listener_support

Feb 23 2021, 5:39 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data
Mholloway closed T274172: [Session Length] Complete sessionTick deployment to all wikis as Resolved.
Feb 23 2021, 5:14 PM · Better Use Of Data
Mholloway updated the task description for T274172: [Session Length] Complete sessionTick deployment to all wikis.
Feb 23 2021, 5:14 PM · Better Use Of Data
Mholloway removed a project from T263491: [EPIC] WDQS behind API Gateway: Patch-For-Review.

Faulty bug tag, sorry!

Feb 23 2021, 4:53 PM · Epic, Wikidata, Platform Team Initiatives (API Gateway), Wikidata-Query-Service
Mholloway added a comment to T263041: OperationError: The operation failed for an operation-specific reason in generateRandomSessionId .

The behavior of getRandomValues is specified here: https://www.w3.org/TR/WebCryptoAPI/#Crypto-method-getRandomValues,
and the Gecko implementation is here: https://github.com/mozilla/gecko-dev/blob/0db73daa4b03ce7513a7dd5f31109143dc3b149e/dom/base/Crypto.cpp#L38.

Feb 23 2021, 3:42 PM · MW-1.36-notes (1.36.0-wmf.33; 2021-03-02), Better Use Of Data, Analytics-Radar, Product-Data-Infrastructure, Event-Platform, JavaScript, Analytics-EventLogging, Wikimedia-production-error

Feb 22 2021

Mholloway added a comment to T263505: Create logging instrumentation for Wikitext editor not affected by ad blockers.

For what it's worth the Modern Event Platform endpoint https://intake-analytics.wikimedia.org/v1/events (see wikitech:Event_Platform/EventGate) is not yet blocked by uBlock Origin

Feb 22 2021, 9:45 PM · Better Use Of Data, Product-Analytics, WikiEditor
Mholloway added a comment to T263503: Document how ad blockers / tracking blockers interact with EventLogging.

I added a new section https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging#Ad_blockers to the EventLogging docs.

Feb 22 2021, 7:25 PM · Better Use Of Data, Product-Data-Infrastructure, Analytics, Product-Analytics, Analytics-EventLogging, Documentation

Feb 19 2021

Mholloway removed a member for WikimediaEditorTasks: Mholloway.
Feb 19 2021, 8:14 PM
Mholloway removed a member for Product-Infrastructure-Team-Backlog: Mholloway.
Feb 19 2021, 8:13 PM
Mholloway removed a watcher for Push-Notification-Service: Mholloway.
Feb 19 2021, 8:13 PM
Mholloway removed a member for Push-Notification-Service: Mholloway.
Feb 19 2021, 8:13 PM
Mholloway removed a member for Wikifeeds: Mholloway.
Feb 19 2021, 8:12 PM
Mholloway removed a member for Proton: Mholloway.
Feb 19 2021, 8:12 PM
Mholloway removed a member for Page Content Service: Mholloway.
Feb 19 2021, 8:11 PM

Feb 17 2021

Mholloway closed T253634: Convert WikimediaEvents to use ResourceLoader packageFiles as Resolved.
Feb 17 2021, 7:32 PM · MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Better Use Of Data, Performance-Team (Radar), Analytics, Event-Platform
Mholloway moved T253634: Convert WikimediaEvents to use ResourceLoader packageFiles from QA/Review to Sign-off on the Better Use Of Data board.
Feb 17 2021, 7:32 PM · MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Better Use Of Data, Performance-Team (Radar), Analytics, Event-Platform
Mholloway added a comment to T218835: prefUpdate schema contains multiple identical events for the same preference update.

OK, after running a couple of queries for the past couple of days, it looks like the worst offender is in fact mf_amc_optin, followed by popupsreferencepreviews, then discussiontools-betaenable, then a handful of others with a duplicate or two per day.

Feb 17 2021, 5:08 PM · MW-1.36-notes (1.36.0-wmf.36; 2021-03-23), Readers-Web-Backlog (Kanbanana-FY-2020-21), Better Use Of Data, Product-Data-Infrastructure, Analytics-Radar, Product-Analytics
Mholloway added a comment to T218835: prefUpdate schema contains multiple identical events for the same preference update.

I've been poking at this as time permits but haven't yet managed to track down a cause. Interestingly, eyeballing some data from yesterday, it seems to happen particularly often for popupsreferencepreviews events.

Feb 17 2021, 12:44 AM · MW-1.36-notes (1.36.0-wmf.36; 2021-03-23), Readers-Web-Backlog (Kanbanana-FY-2020-21), Better Use Of Data, Product-Data-Infrastructure, Analytics-Radar, Product-Analytics

Feb 16 2021

Mholloway updated the task description for T266813: mw.user.generateRandomSessionId should return a UUID.
Feb 16 2021, 5:28 PM · Analytics-Radar, Better Use Of Data, Event-Platform, Product-Data-Infrastructure
Mholloway closed T229835: Improve logstash logging for MCS, a subtask of T121571: Improve logstash logging for graphoid, mobileapps, mathoid, as Invalid.
Feb 16 2021, 4:42 PM · Platform Team Workboards (Clinic Duty Team), User-mobrovac, Services-next
Mholloway closed T229835: Improve logstash logging for MCS, a subtask of T224602: Fix logging umbrella task, as Invalid.
Feb 16 2021, 4:42 PM · Better Use Of Data, Epic, Product-Infrastructure-Team-Backlog
Mholloway closed T229835: Improve logstash logging for MCS as Invalid.

I believe this task has become invalid since mobileapps was migrated to Kubernetes.

Feb 16 2021, 4:42 PM · Product-Infrastructure-Team-Backlog
Mholloway closed T224602: Fix logging umbrella task as Invalid.
Feb 16 2021, 3:59 PM · Better Use Of Data, Epic, Product-Infrastructure-Team-Backlog
Mholloway renamed T174986: Mobile Content Service in MediaWiki-Vagrant lacks error logging from Mobile Content Service lacks error logging to Mobile Content Service in MediaWiki-Vagrant lacks error logging.
Feb 16 2021, 3:59 PM · MediaWiki-Vagrant, Mobile-Content-Service

Feb 12 2021

Mholloway added a comment to T137321: Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables.

I picked up @Tgr's old patch and updated it to consume data from event.mediawiki_api_request, along with some other cosmetic changes. The HQL scripts seem to work well as updated. I also kicked off an Oozie job (using mholloway as the target database) but got cold feet and killed it.

Feb 12 2021, 11:31 PM · Analytics-Radar, Platform Team Initiatives (Modern Event Platform (TEC2)), User-Addshore, Patch-For-Review, MediaWiki-API
Mholloway claimed T137321: Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables.
Feb 12 2021, 11:21 PM · Analytics-Radar, Platform Team Initiatives (Modern Event Platform (TEC2)), User-Addshore, Patch-For-Review, MediaWiki-API

Feb 10 2021

Mholloway updated the task description for T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check.
Feb 10 2021, 8:01 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data
Mholloway closed T271456: Enable 'skin' dimension using stream configuration as Resolved.

Further demo work to be continued in T274175: [Client libraries] Demonstrate new capabilities.

Feb 10 2021, 7:07 PM · MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), Patch-For-Review, Product-Data-Infrastructure, Product-Analytics, Better Use Of Data
Mholloway closed T271456: Enable 'skin' dimension using stream configuration, a subtask of T267496: [SessionLength] Allow data consumers to interact with data related to Session Length, as Resolved.
Feb 10 2021, 7:07 PM · Product-Analytics (Kanban), Product-Data-Infrastructure, Better Use Of Data
Mholloway closed T271456: Enable 'skin' dimension using stream configuration, a subtask of T273235: [Metrics Platform] Define stream configuration syntax relevant to v1 release, as Resolved.
Feb 10 2021, 7:07 PM · Better Use Of Data, Product-Analytics, Analytics, Product-Data-Infrastructure
Mholloway closed T271456: Enable 'skin' dimension using stream configuration, a subtask of T273293: Define acceptable usage of the `meta` object in event schemas, as Resolved.
Feb 10 2021, 7:07 PM · Product-Data-Infrastructure, Analytics, Better Use Of Data

Feb 9 2021

Mholloway added a comment to T137321: Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables.

I could probably pick this up as a 10%-ish exercise, if someone (@Milimetric?) can spare some code review cycles.

Feb 9 2021, 10:31 PM · Analytics-Radar, Platform Team Initiatives (Modern Event Platform (TEC2)), User-Addshore, Patch-For-Review, MediaWiki-API
Mholloway added a comment to T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check.

Looking at the data collected yesterday, 2/8/21, on the group 0 and 1 wikis:

Feb 9 2021, 10:22 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data
Mholloway added a comment to T261987: MEP Client iOS (Revision).

We discussed this briefly in a board grooming meeting yesterday and would appreciate a review by the iOS team about which of the remaining items are still needed or wanted, and how they should be prioritized (individually or collectively). As far as I can tell, the remaining "possibly moot if persistence is solved" items still remain open and valid, but I could be wrong.

Feb 9 2021, 3:54 PM · Better Use Of Data, Product-Data-Infrastructure
Mholloway updated the task description for T261987: MEP Client iOS (Revision).
Feb 9 2021, 3:46 PM · Better Use Of Data, Product-Data-Infrastructure
Mholloway added a project to T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check: Product-Data-Infrastructure.
Feb 9 2021, 3:36 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data
Mholloway created T274264: [Session Length] Evaluate session length distribution for newer vs. older browsers and remove the supportsPassive check.
Feb 9 2021, 3:36 PM · MW-1.36-notes (1.36.0-wmf.32; 2021-02-23), Product-Data-Infrastructure, Better Use Of Data

Feb 1 2021

Mholloway added a comment to T271456: Enable 'skin' dimension using stream configuration.

Removed the [spike] label as this is really more of a bikeshed task. The implementation will be straightforward.

Feb 1 2021, 8:06 PM · MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), Patch-For-Review, Product-Data-Infrastructure, Product-Analytics, Better Use Of Data
Mholloway renamed T271456: Enable 'skin' dimension using stream configuration from [SPIKE] Enable 'skin' dimension using stream configuration to Enable 'skin' dimension using stream configuration.
Feb 1 2021, 8:05 PM · MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), Patch-For-Review, Product-Data-Infrastructure, Product-Analytics, Better Use Of Data
Mholloway added a comment to T271456: Enable 'skin' dimension using stream configuration.

I would support using a map-typed labels field for this. As described in the ECS spec it fits our intended purpose rather well, I think, and it gets us around the question of what does and doesn't constitute metadata. What do you think, @jlinehan?

Feb 1 2021, 8:03 PM · MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), Patch-For-Review, Product-Data-Infrastructure, Product-Analytics, Better Use Of Data
Mholloway moved T271456: Enable 'skin' dimension using stream configuration from Inbox to Doing on the Product-Data-Infrastructure board.
Feb 1 2021, 4:38 PM · MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), Patch-For-Review, Product-Data-Infrastructure, Product-Analytics, Better Use Of Data
Mholloway edited Description on Better Use Of Data.
Feb 1 2021, 4:35 PM
Mholloway changed IRC Nick from mdholloway to mholloway on Mholloway.
Feb 1 2021, 4:33 PM