Page MenuHomePhabricator

Milimetric (Dan Andreescu)
User

Projects (13)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Oct 8 2014, 5:48 PM (228 w, 1 d)
Availability
Available
LDAP User
Milimetric
MediaWiki User
Milimetric (WMF) [ Global Accounts ]

Recent Activity

Today

Milimetric moved T215290: update mw scooping to be able to scoop from new db cluster from Next Up to In Progress on the Analytics-Kanban board.
Thu, Feb 21, 10:52 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric updated the task description for T215863: Coarse alarm on data quality for refined data based on entropy calculations.
Thu, Feb 21, 9:52 PM · Analytics
Milimetric renamed T215863: Coarse alarm on data quality for refined data based on entropy calculations from Coarse alarm on data quality for refined data based on entrophy calculations to Coarse alarm on data quality for refined data based on entropy calculations.
Thu, Feb 21, 9:50 PM · Analytics
Milimetric created T216771: [Bug] Type mismatch for a few other schemas.
Thu, Feb 21, 9:45 PM · Analytics
Milimetric added a comment to T172410: Replace the current multisource analytics-store setup.

While this may look like an annoyance, we don't usually talk about the things that this change improved:

  • x1 is now finally fully available, while before only certain tables were
  • every time a new wiki was created, it broke dbstore1002
  • If for some reason the new dbstore hosts break, reimport from 0 should take no more than 1-2 hours, increasing the overall uptime (vs multiple days).
  • Lag should be close to 0 at all times
Thu, Feb 21, 9:39 PM · Product-Analytics, Analytics, WMDE-Analytics-Engineering, User-Addshore, User-Elukey, Research
Milimetric added a comment to T210706: Move AQS to nodejs 10.

Started trying to help on this, ran into two problems:

Thu, Feb 21, 9:27 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric committed rAAWOc60ad1c290c7: Update dashboards with latest dashiki build (authored by Milimetric).
Update dashboards with latest dashiki build
Thu, Feb 21, 8:22 PM
Milimetric added a comment to T162365: ExternalLinksChange Logging instrumentation is completely broken.

This latest change I pushed removes any EventLogging instrumentation from the SpamBlacklist extension. Needs some review.

Thu, Feb 21, 7:52 PM · Analytics, Patch-For-Review, MediaWiki-extensions-WikimediaEvents, The-Wikipedia-Library
Milimetric moved T216726: Edits to Flow pages result in a page-links-change event with no performer from Incoming to Radar on the Analytics board.
Thu, Feb 21, 5:52 PM · EventBus, Analytics, Internet-Archive, MediaWiki-extensions-WikimediaEvents, Wikimedia-General-or-Unknown, The-Wikipedia-Library
Milimetric closed T56783: Respect X-Forwarded-For only from trustworthy sources as Declined.

Or is this basically now an off-topic ticket going nowhere?

Thu, Feb 21, 5:52 PM · Analytics, Operations, Traffic, Analytics-Cluster
Milimetric moved T216491: Decommission dbstore1002 from Incoming to Radar on the Analytics board.
Thu, Feb 21, 5:47 PM · ops-eqiad, Operations, Analytics
Milimetric moved T216528: confirm gpu form factor in stat1005 from Incoming to Radar on the Analytics board.
Thu, Feb 21, 5:47 PM · ops-eqiad, Analytics-Kanban, Analytics, Operations
Milimetric moved T216679: Clean up analytics data for user zhousquared from Incoming to Ops Week on the Analytics board.
Thu, Feb 21, 5:46 PM · Analytics
Milimetric moved T216069: Flaky quibble-vendor-mysql-hhvm-docker test in Jenkins from Incoming to Radar on the Analytics board.
Thu, Feb 21, 5:45 PM · Core Platform Team Kanban (Blocked Externally), Services (blocked), Analytics, EventBus, MediaWiki-Core-Testing, Release-Engineering-Team, Jenkins, Quibble
Milimetric moved T212335: EventBus or CirrusSearch: DomainException from line 353 of /srv/mediawiki/php-1.33.0-wmf.9/vendor/firebase/php-jwt/src/JWT.php: Unknown JSON error: 5 from Incoming to Radar on the Analytics board.
Thu, Feb 21, 5:45 PM · Patch-For-Review, Core Platform Team Kanban (Doing), Services (doing), EventBus, Analytics, Core Platform Team (Security, stability, performance and scalability (TEC1)), WMF-JobQueue, CirrusSearch, Wikimedia-production-error
Milimetric moved T216707: CloudVPS: cloudvirtan1002 puppet failures due to memory allocation issues? from Incoming to Operational Excellence on the Analytics board.
Thu, Feb 21, 5:41 PM · Analytics-Kanban, Analytics-Cluster, Analytics, cloud-services-team (Kanban)
Milimetric assigned T216707: CloudVPS: cloudvirtan1002 puppet failures due to memory allocation issues? to Ottomata.
Thu, Feb 21, 5:41 PM · Analytics-Kanban, Analytics-Cluster, Analytics, cloud-services-team (Kanban)
Milimetric triaged T216184: Eventstreams build is broken as High priority.
Thu, Feb 21, 5:40 PM · Patch-For-Review, Analytics-Kanban, Operations, Wikimedia-Stream, Analytics, Services (watching)
Milimetric moved T216184: Eventstreams build is broken from Incoming to Operational Excellence on the Analytics board.
Thu, Feb 21, 5:40 PM · Patch-For-Review, Analytics-Kanban, Operations, Wikimedia-Stream, Analytics, Services (watching)
Milimetric triaged T216519: Old job_tracker setting in oozie properties as Normal priority.
Thu, Feb 21, 5:39 PM · Analytics
Milimetric renamed T216525: Add wikimania.wikimedia.org to pageview definition from Add wikimania.wikimedia.org to pageview whitelist to Add wikimania.wikimedia.org to pageview definition.
Thu, Feb 21, 5:38 PM · Pageviews-API, Analytics
Milimetric triaged T216525: Add wikimania.wikimedia.org to pageview definition as Normal priority.
Thu, Feb 21, 5:37 PM · Pageviews-API, Analytics
Milimetric added a comment to T216525: Add wikimania.wikimedia.org to pageview definition.

This is not only not in the whitelist, it's excluded from the pageview definition. The logic was that we don't want to include traffic to wikis that are not about "content". I believe we made an exception for outreach wiki, so we have to talk about whether we want to just allow all wikis.

Thu, Feb 21, 5:37 PM · Pageviews-API, Analytics
Milimetric added a project to T216561: extensions/EventBus/includes/EventBusRCFeedEngine.php:45 PHP Notice: Undefined index: eventServiceName: Analytics-Kanban.
Thu, Feb 21, 5:36 PM · Analytics-Kanban, MW-1.33-notes (1.33.0-wmf.18; 2019-02-19), Patch-For-Review, EventBus, Analytics, Wikimedia-production-error
Milimetric triaged T216561: extensions/EventBus/includes/EventBusRCFeedEngine.php:45 PHP Notice: Undefined index: eventServiceName as Normal priority.
Thu, Feb 21, 5:36 PM · Analytics-Kanban, MW-1.33-notes (1.33.0-wmf.18; 2019-02-19), Patch-For-Review, EventBus, Analytics, Wikimedia-production-error
Milimetric lowered the priority of T216567: EventBusRCFeedFormatter should clean up events from nulls from High to Normal.
Thu, Feb 21, 5:35 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Backlog (Later), Analytics, Services (next), EventBus
Milimetric triaged T216567: EventBusRCFeedFormatter should clean up events from nulls as High priority.
Thu, Feb 21, 5:35 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Backlog (Later), Analytics, Services (next), EventBus
Milimetric closed T216658: Timestamp column in EventLogging tables have incompatible collation as Declined.

This sucks but we're not likely to work on it, as we're moving away from mysql. We don't want to be mean though, so we can help sqoop this stuff into Hadoop if you need to use your painful workaround too much.

Thu, Feb 21, 5:35 PM · Analytics, Product-Analytics
Milimetric added a comment to T211881: graphoid: Code stewardship request.

I personally fail to see how this would be refactored

Thu, Feb 21, 3:52 PM · Core Platform Team Backlog (Watching / External), Services (watching), Release-Engineering-Team (Kanban), Operations, Code-Stewardship-Reviews, Graphoid
Milimetric moved T209549: Add ipblocks_restrictions table to Data Lake from Next Up to In Progress on the Analytics-Kanban board.
Thu, Feb 21, 3:33 PM · Analytics-Kanban, Anti-Harassment, Analytics
Milimetric claimed T209549: Add ipblocks_restrictions table to Data Lake.
Thu, Feb 21, 3:33 PM · Analytics-Kanban, Anti-Harassment, Analytics
Milimetric updated subscribers of T206268: Evaluate using TypeScript on node projects.

This is really great. @Ottomata, this is a good example if you want to try typescript in EventGate. Pretty complete and the linked-to guide is good too.

Thu, Feb 21, 3:27 PM · Core Platform Team Backlog (Watching / External), Services (watching), Analytics
Milimetric added a comment to T191964: Clickstream dataset for Persian Wikipedia only includes external values.

it's not you, it's Java. But I can't help without details, ping me on IRC, I'm very behind on my phab pings as you can see.

Thu, Feb 21, 3:22 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric added a comment to T200868: [EPIC] Make jQuery an optional dependency in Minerva.

How about a new $wg that specified an alternate set of baseModules? Like $wgAlternateBaseModules and if it exists, use that instead of https://github.com/wikimedia/mediawiki/blob/master/includes/resourceloader/ResourceLoaderStartUpModule.php#L376

Thu, Feb 21, 3:21 PM · Epic, Readers-Web-Backlog, Performance-Team, User-Jdlrobson
Milimetric added a comment to T211069: Decide whether we will include raw features.

This increase in data sounds fine, and the proposed example path looks fine too. Hundreds of subfolders are only annoying when it comes to repairing Hive tables to make them aware of new partitions, but if you're accessing from Spark it won't matter.

Thu, Feb 21, 2:57 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
Milimetric merged T201180: How to get display statistics of the content publised on Commons into T210313: Statistics for views of individual Wikimedia images.
Thu, Feb 21, 2:53 PM · Analytics, Tool-Pageviews
Milimetric merged task T201180: How to get display statistics of the content publised on Commons into T210313: Statistics for views of individual Wikimedia images.
Thu, Feb 21, 2:53 PM · Analytics
Milimetric added a comment to T201180: How to get display statistics of the content publised on Commons.

Yeah, going to close as a duplicate of that. The main obstacle now is expanding storage on the API cluster to fit the mediacounts dataset.

Thu, Feb 21, 2:52 PM · Analytics

Thu, Feb 14

Milimetric added a comment to T18691: RFC: Section headings should have a clickable anchor.

Just caught up with the history here and wanted to make sure @Msftwikipmey and @alexhollender, who are both working on a design for this feature, know about each other.

Thu, Feb 14, 7:00 AM · Readers-Web-Backlog (Design), TechCom-RFC, Design, MediaWiki-Interface

Wed, Feb 13

Milimetric added a comment to T215863: Coarse alarm on data quality for refined data based on entropy calculations.

I understand it, yay! And I like it. We could even compute the tolerance from past data once in a while, and use that instead of our guess. That way this approach could grow organically with the data. We should always have some absolute alarms like if entropy is ever 0 something went wrong. So we could put an entropy(min=0) check on pretty much every column.

Wed, Feb 13, 10:21 PM · Analytics
Milimetric added a comment to T215655: Generate edit totals by country by month.

Also, I created the table and filled it through 2019-01 manually. This way we can just restart the whole job and not have to worry about this addition of a step in the workflow. I'm going to stall this task a bit until I add a job to productionize the GII aggregation in a yearly coordinator. I'll finish that up tomorrow.

Wed, Feb 13, 4:35 AM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric added a comment to T215655: Generate edit totals by country by month.

For reference, this is how I generated the numbers sent to the GII folks:

Wed, Feb 13, 4:34 AM · Patch-For-Review, Analytics-Kanban, Analytics

Tue, Feb 12

Milimetric created T215858: Rethink Cloud DB replicas.
Tue, Feb 12, 4:06 AM · Data-Services, Analytics
Milimetric added a comment to T199004: RFC: Add a frontend build step to skins/extensions to our deploy process.

OOUI uses a build step.

I really wish it did not. The build process makes testing OOUI patches with MediaWiki a major chore.

The build step only involves concatenating JS files, compiling Less files, and generating colored icon variants, all of which are also available in MediaWiki's ResourceLoader. It could probably be refactored to avoid the build step.

Tue, Feb 12, 2:41 AM · TechCom-RFC, Proposal, User-Jdlrobson

Mon, Feb 11

Milimetric triaged T213488: Superset's rolling average feature results in error message as High priority.
Mon, Feb 11, 4:35 PM · Analytics-Kanban, Product-Analytics, Analytics
Milimetric added a comment to T215445: comment and actor view challenges for Cloud Services.

@Anomie: would it be much worse to implement this in mediawiki directly? Maybe a redacted column that starts out false and becomes true if rev_delete, log_delete, etc. are set.

Mon, Feb 11, 3:51 PM · cloud-services-team (Kanban), Data-Services
Milimetric added a comment to T115119: Create a feed or log of changed links on Wikimedia projects.

The instrumentation for ExternalLinksChange was kind of jammed into the SpamBlacklist extension. It never really worked, so it could just be pulled out entirely. It seemed hard to force it to work, but it doesn't seem hard to undo it and clean up SpamBlacklist, as I don't think there are problems with the extension itself.

Mon, Feb 11, 3:34 PM · Internet-Archive, MediaWiki-extensions-WikimediaEvents, Wikimedia-General-or-Unknown, The-Wikipedia-Library

Fri, Feb 8

Milimetric moved T215655: Generate edit totals by country by month from Next Up to In Code Review on the Analytics-Kanban board.
Fri, Feb 8, 8:41 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric claimed T215655: Generate edit totals by country by month.
Fri, Feb 8, 8:34 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric created T215655: Generate edit totals by country by month.
Fri, Feb 8, 8:33 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric added a comment to T213525: Update big spark jobs conf with better settings.

reviewed doc and fixed some spelling. I don't know what spill files are, but the rest made sense to me.

Fri, Feb 8, 4:43 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric added a comment to T214384: [Bug] Type mismatch between NavigationTiming EL schema and Hive table schema.

@Krinkle, the schema wouldn't change, it's fine as it is. The rest is correct. The confusion might come from the fact that we don't use the schema to refine data. That's how we ran into this problem, not knowing what type a field is, we just infer it from the JSON. Which doesn't work for whole numbers that need to be stored as Doubles. So, my proposed hack until we can make refine aware of the schema:

Fri, Feb 8, 3:17 AM · Analytics-Kanban, Patch-For-Review, Performance-Team (Radar), Analytics

Thu, Feb 7

Milimetric added a comment to T214384: [Bug] Type mismatch between NavigationTiming EL schema and Hive table schema.

@Krinkle: refined data was down-cast and is going to remain incorrect unless we re-ingest. We have raw data going back 90 days [1], so if you need we can alter the table and re-ingest to fix existing records. Let us know either way.

Thu, Feb 7, 6:10 PM · Analytics-Kanban, Patch-For-Review, Performance-Team (Radar), Analytics

Tue, Feb 5

Milimetric added a comment to T165118: Support Vega 3.0 and Vega Lite 2.0.

The status right now is that WMF is looking for a steward for the project. Ideally, a team would agree this is critical infrastructure and take over ownership of Graphoid and the Graph extension. We are mostly in agreement that it would be a bad idea to add even more logic to the current implementation, before it gets restructured. If no team agrees to take it over by the end of this quarter, I will see if I can make space to deal with it myself. As for GSoC work, before we get the basic service in shape I don't think it makes sense to draft any other tasks around it. Hope that helps, and I really hope a team decides to take this over.

Tue, Feb 5, 10:05 PM · Google-Summer-of-Code, Graphs
Milimetric added a comment to T214093: Modern Event Platform: Schema Guidelines and Conventions.

I like the [a-z0-9_] restriction being up-front. It's predictable and a very fair limitation considering the many systems this data is expected to flow through.

Tue, Feb 5, 9:51 PM · Patch-For-Review, Product-Analytics, Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Milimetric moved T213309: Reportupdater should alert if it fails over and over from Next Up to Done on the Analytics-Kanban board.
Tue, Feb 5, 9:48 PM · Analytics-Kanban, Analytics
Milimetric reassigned T213309: Reportupdater should alert if it fails over and over from Milimetric to elukey.
Tue, Feb 5, 9:48 PM · Analytics-Kanban, Analytics
Milimetric added a comment to T215290: update mw scooping to be able to scoop from new db cluster .

you mean T212386#4905949 right? Elukey I'm going to wait until you have that in code review, just in case you have other thoughts as you make it more official.

Tue, Feb 5, 9:46 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric moved T215082: Punjabi Wikisource WikiStats 2.0 from In Code Review to Ready to Deploy on the Analytics-Kanban board.
Tue, Feb 5, 4:14 PM · Analytics-Kanban, Patch-For-Review, Analytics-Wikistats, Analytics
Milimetric triaged T215082: Punjabi Wikisource WikiStats 2.0 as High priority.
Tue, Feb 5, 4:10 PM · Analytics-Kanban, Patch-For-Review, Analytics-Wikistats, Analytics

Sun, Jan 27

domoritz awarded T165118: Support Vega 3.0 and Vega Lite 2.0 a Like token.
Sun, Jan 27, 9:54 PM · Google-Summer-of-Code, Graphs

Wed, Jan 23

Milimetric added a comment to T200297: Introduce a new namespace for collaborative judgements about wiki entities.

This wikitext-in-JSON thing seems really complicated. I read through both comments above and walked away with a much better understanding of mediawiki, and I think that's a bad thing :)

Wed, Jan 23, 8:59 PM · MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Patch-For-Review, Scoring-platform-team (Current), DBA, Operations, Jade, TechCom-RFC
Milimetric moved T210542: Update datasets definitions and oozie jobs for dual-sqoop of comments and actors from In Code Review to Ready to Deploy on the Analytics-Kanban board.
Wed, Jan 23, 5:03 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric moved T210522: Refactor Sqoop, join actor and comment from analytics replicas from In Code Review to Ready to Deploy on the Analytics-Kanban board.
Wed, Jan 23, 5:03 PM · Analytics-Kanban, Analytics
Milimetric moved T210543: Update refinery-source jobs to join labsdb with actor and comment from In Code Review to Ready to Deploy on the Analytics-Kanban board.
Wed, Jan 23, 5:03 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric moved T209031: Not able to scoop comment table in labs for mediawiki reconstruction process [EPIC} from In Code Review to Ready to Deploy on the Analytics-Kanban board.
Wed, Jan 23, 5:03 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), Analytics-Kanban, DBA, Data-Services, Analytics
Milimetric moved T213524: Add 'mediawiki_history_unchecked' dataset to oozie from In Code Review to Ready to Deploy on the Analytics-Kanban board.
Wed, Jan 23, 5:03 PM · Patch-For-Review, Analytics-Kanban, Analytics

Jan 22 2019

Milimetric renamed T190535: Productionize and run 2018 job for Global Innovation Index from Hadoop Geowiki data from Productionize job for Global Innovation Index from Hadoop Geowiki data to Productionize and run 2018 job for Global Innovation Index from Hadoop Geowiki data.
Jan 22 2019, 10:30 PM · good first bug, Analytics
Milimetric raised the priority of T190535: Productionize and run 2018 job for Global Innovation Index from Hadoop Geowiki data from Normal to Needs Triage.
Jan 22 2019, 10:30 PM · good first bug, Analytics
Milimetric created T214437: Check logging table after next sqoop for log_user type.
Jan 22 2019, 8:53 PM · Analytics-Kanban, Analytics
Milimetric added a comment to T212763: Wikistats New Feature - DB size.
  • The XML file with current pages, including user and talk pages (uncompressed)
  • The full history dumps (uncompressed)
Jan 22 2019, 2:37 PM · Analytics, Analytics-Wikistats

Jan 21 2019

Milimetric added a comment to T212134: Deprecate Spark 1.6 in favor of Spark 2.x only.

switching to Andrew per Luca

Jan 21 2019, 4:38 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric reassigned T212134: Deprecate Spark 1.6 in favor of Spark 2.x only from elukey to Ottomata.
Jan 21 2019, 4:38 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric moved T210706: Move AQS to nodejs 10 from Next Up to In Progress on the Analytics-Kanban board.
Jan 21 2019, 4:37 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric claimed T210706: Move AQS to nodejs 10.
Jan 21 2019, 4:37 PM · Patch-For-Review, Analytics-Kanban, Analytics
Milimetric moved T214080: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate from Incoming to Modern Event Platform on the Analytics board.
Jan 21 2019, 4:36 PM · Patch-For-Review, Services (watching), Discovery, Analytics-EventLogging, EventBus, Analytics
Milimetric added a project to T214089: Update git lfs on stat1006/7: Analytics-Kanban.
Jan 21 2019, 4:35 PM · Patch-For-Review, User-Elukey, Analytics-Kanban, Analytics
Milimetric assigned T214089: Update git lfs on stat1006/7 to elukey.
Jan 21 2019, 4:34 PM · Patch-For-Review, User-Elukey, Analytics-Kanban, Analytics
Milimetric triaged T214089: Update git lfs on stat1006/7 as Normal priority.
Jan 21 2019, 4:33 PM · Patch-For-Review, User-Elukey, Analytics-Kanban, Analytics
Milimetric moved T214136: event_pageissues Turnilo view contains no valid data from before January 5 from Next Up to In Progress on the Analytics-Kanban board.
Jan 21 2019, 4:32 PM · Analytics-Kanban, Page-Issue-Warnings, Analytics
Milimetric moved T213602: virtualpageview_hourly lacks data from December 17 on from Next Up to Done on the Analytics-Kanban board.
Jan 21 2019, 4:32 PM · Analytics-Kanban, Analytics
Milimetric added a project to T213602: virtualpageview_hourly lacks data from December 17 on: Analytics-Kanban.
Jan 21 2019, 4:32 PM · Analytics-Kanban, Analytics
Milimetric moved T214136: event_pageissues Turnilo view contains no valid data from before January 5 from Incoming to Operational Excellence on the Analytics board.
Jan 21 2019, 4:32 PM · Analytics-Kanban, Page-Issue-Warnings, Analytics
Milimetric moved T206894: Set up automated email to report completion of mediawiki_history snapshot and Druid loading from Next Up to In Code Review on the Analytics-Kanban board.
Jan 21 2019, 4:13 PM · Patch-For-Review, Analytics-Kanban, Analytics, Contributors-Analysis, Product-Analytics

Jan 16 2019

Milimetric added a comment to T212172: Provide feature parity between the wiki replicas and the Analytics Data Lake.

Quick note to thank everyone very much for all these use cases. They're very useful for both the short and long term planning that's always spinning in my brain. Thank you!

Jan 16 2019, 4:58 PM · User-Elukey, Epic, Analytics, Contributors-Analysis, Product-Analytics
Milimetric added a comment to T211881: graphoid: Code stewardship request.

Which major design goal would that be? /me genuinely interested

Jan 16 2019, 4:50 PM · Core Platform Team Backlog (Watching / External), Services (watching), Release-Engineering-Team (Kanban), Operations, Code-Stewardship-Reviews, Graphoid
Milimetric added a comment to T213318: Wikibase Front-End Architecture.

oh man, revoke my arithmetic license, classic off by 1000 error, sorry about that, edited my comment above, it's 0.24%

Jan 16 2019, 4:29 PM · Wikidata, TechCom-RFC

Jan 15 2019

Milimetric added a comment to T213318: Wikibase Front-End Architecture.

UPDATE: my math is so very wrong below, it should be 0.24% of pageviews, not 24%, sorry

Jan 15 2019, 10:38 PM · Wikidata, TechCom-RFC
Milimetric added a comment to T204142: Establish guiding principles for software and system architecture.

Anything else to do here? The draft has been published, shall we move to Last Call?

Jan 15 2019, 10:03 PM · User-Daniel, TechCom-RFC, TechCom
Milimetric added a comment to T199004: RFC: Add a frontend build step to skins/extensions to our deploy process.

The problem with this workflow is that then your acceptance/browser tests are running against the last deployed frontend assets. Which is fine, but then once you build you may get browser tests that fail and it is hard to pinpoint which commit broke them.

Jan 15 2019, 9:43 PM · TechCom-RFC, Proposal, User-Jdlrobson
Milimetric added a comment to T142535: Find out what happens to the old rows in the revision table.

I just dropped the data I mentioned in this task. Since we've been sqooping from mediawiki, we have a version of this kind of data in the wmf_raw database, in the mediawiki_revision table, by comparing data across snapshots. And we can easily look at smaller periods of time.

Jan 15 2019, 8:24 PM · Analytics
Milimetric added a comment to T212493: Clean up staging db.

dropped all milimetric_ tables, and gave up on my dreams of figuring out what exactly is going on with mediawiki's revision table.

Jan 15 2019, 8:21 PM · Analytics-Kanban, Analytics
Milimetric moved T187207: Spin out a tiny EventLogging RL module for lightweight logging from Ready to Deploy to Done on the Analytics-Kanban board.
Jan 15 2019, 4:16 PM · MW-1.33-notes (1.33.0-wmf.9; 2018-12-18), MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Patch-For-Review, Analytics-Kanban, Performance-Team (Radar), Analytics-EventLogging, Analytics
Milimetric added a comment to T187207: Spin out a tiny EventLogging RL module for lightweight logging.

I just checked and I think we've exorcised any async or roundtrip code. @Krinkle, is there a specific test you do or a specific mw.track call that was too slow that you'd like me to check into?

Jan 15 2019, 4:15 PM · MW-1.33-notes (1.33.0-wmf.9; 2018-12-18), MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Patch-For-Review, Analytics-Kanban, Performance-Team (Radar), Analytics-EventLogging, Analytics

Jan 14 2019

Milimetric added a comment to T213221: API Analytics - page views by country.
Jan 14 2019, 4:39 PM · Pageviews-API, PageViewInfo, Analytics, MediaWiki-API

Jan 12 2019

Milimetric moved T213603: Coordinate work on minor changes for Edit Data Quality from Next Up to In Progress on the Analytics-Kanban board.
Jan 12 2019, 2:48 AM · Patch-For-Review, Analytics-Kanban
Milimetric triaged T213603: Coordinate work on minor changes for Edit Data Quality as High priority.
Jan 12 2019, 2:47 AM · Patch-For-Review, Analytics-Kanban
Milimetric added a comment to T153641: How to use Wikipedia EventLogging schemas in Vagrant setup?.

Thank you for pointing out the issues and helping with docs @srishakatux

Jan 12 2019, 2:37 AM · Analytics-Kanban, Analytics, Analytics-EventLogging, MediaWiki-Vagrant

Jan 11 2019

Milimetric added a comment to T199004: RFC: Add a frontend build step to skins/extensions to our deploy process.

I just want to re-iterate our simpler way of handling build steps in Wikistats 2. In light of the problems described here, I think it deserves a second look. It's pretty standard on other nodejs projects I've looked at. We basically factor out most of our common build config and use it in two kinds of builds:

Jan 11 2019, 11:21 PM · TechCom-RFC, Proposal, User-Jdlrobson
Milimetric added a comment to T153641: How to use Wikipedia EventLogging schemas in Vagrant setup?.

@srishakatux I have good news and bad news.

Jan 11 2019, 9:42 PM · Analytics-Kanban, Analytics, Analytics-EventLogging, MediaWiki-Vagrant