Page MenuHomePhabricator

Ottomata (Andrew Otto)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Oct 9 2014, 4:50 PM (266 w, 5 d)
Availability
Available
IRC Nick
ottomata
LDAP User
Ottomata
MediaWiki User
Ottomata [ Global Accounts ]

Recent Activity

Yesterday

Ottomata added a comment to T206789: Modern Event Platform: Schema Registry: Implementation.

Wow this bike shed is going to look great! Just had a good IRC discussion with Jason and Dan. Our contenders are:

Tue, Nov 19, 9:07 PM · Analytics-Kanban, CPT Initiatives (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata added a comment to T206789: Modern Event Platform: Schema Registry: Implementation.

I'm not sure why there is a problem with having the repositories named after the "genre" of schema(ta?) that they contain (e.g. 'production,' 'analytics', 'logging'...). I can imagine other "genres" that might appear.

Tue, Nov 19, 8:10 PM · Analytics-Kanban, CPT Initiatives (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata added a comment to T206789: Modern Event Platform: Schema Registry: Implementation.

Hm, but remember that 'analytics' will $ref sub schemas out of 'production'. If we didn't have the requirement to have different merge rights for these different types of schemas, we wouldn't have multiple schema repos.

Tue, Nov 19, 8:08 PM · Analytics-Kanban, CPT Initiatives (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata added a comment to T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc..

We should def consider these things as we think about refactoring sanitization:

Tue, Nov 19, 7:46 PM · Event-Platform, Analytics
Ottomata added a comment to T226193: [Discuss] Future ORES architecture.

Collecting links:
https://eng.uber.com/michelangelo/

Tue, Nov 19, 7:24 PM · ORES, Scoring-platform-team
Ottomata added a comment to T206789: Modern Event Platform: Schema Registry: Implementation.

Alternatives for 'production' schema repo

  • primary
  • major
  • cardinal
  • main
  • essential
  • critical
  • vital
  • principal
  • crucial
  • indispensable
Tue, Nov 19, 7:02 PM · Analytics-Kanban, CPT Initiatives (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata moved T228175: Event Platform Client Libraries from Backlog to Next Up on the Event-Platform board.
Tue, Nov 19, 5:34 PM · Analytics, Event-Platform, Epic, Better Use Of Data, Product-Infrastructure-Team-Backlog
Ottomata moved T101013: Log Wikidata Query Service queries to the event gate infrastructure from Backlog to Next Up on the Event-Platform board.
Tue, Nov 19, 5:34 PM · Discovery-Search (Current work), Patch-For-Review, Event-Platform, Analytics, Wikidata, Wikidata-Query-Service, Discovery
Ottomata updated subscribers of T238658: Migrate EventStreams to k8s deployment pipeline.

I can't seem to develop this locally due to a barrage of version problems.

Tue, Nov 19, 4:42 PM · Analytics, Patch-For-Review, Release-Engineering-Team (Pipeline), Services (watching), Release Pipeline
Ottomata edited projects for T238658: Migrate EventStreams to k8s deployment pipeline, added: Analytics; removed Release-Engineering-Team-TODO, Core Platform Team Legacy (Watching / External), Epic, Operations.
Tue, Nov 19, 3:11 PM · Analytics, Patch-For-Review, Release-Engineering-Team (Pipeline), Services (watching), Release Pipeline
Ottomata closed T196470: EventStreams are currently producing output in bursts of many items instead of real time as Declined.

I can't reproduce this, is it still happening?

Tue, Nov 19, 3:11 PM · Wikimedia-Stream
Ottomata updated the task description for T198901: Migrate production services to kubernetes using the pipeline.
Tue, Nov 19, 2:54 PM · Release-Engineering-Team (Pipeline), Release-Engineering-Team-TODO, Core Platform Team Legacy (Watching / External), Epic, Services (watching), Operations, Release Pipeline
Ottomata created T238658: Migrate EventStreams to k8s deployment pipeline.
Tue, Nov 19, 2:54 PM · Analytics, Patch-For-Review, Release-Engineering-Team (Pipeline), Services (watching), Release Pipeline
Ottomata added a comment to T236277: Extend Puppet CA Expiry date .

Hm, uh oh, @elukey we might want to recreate all those certs with a really long expiry :)

Tue, Nov 19, 2:42 PM · DBA, Patch-For-Review, User-jbond, Puppet, Operations
Ottomata added a project to T233634: Modern Event Platform: Stream Configuration: Implementation: Product-Infrastructure-Team-Backlog.
Tue, Nov 19, 2:37 PM · Product-Infrastructure-Team-Backlog (Kanban), MW-1.35-notes (1.35.0-wmf.3; 2019-10-22), Patch-For-Review, Performance-Team (Radar), Better Use Of Data, CPT Initiatives (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata triaged T238657: eventgate-wikimedia should support using remote stream configuration as High priority.
Tue, Nov 19, 2:34 PM · MW-1.35-notes (1.35.0-wmf.3; 2019-10-22), Performance-Team (Radar), Better Use Of Data, CPT Initiatives (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata moved T238657: eventgate-wikimedia should support using remote stream configuration from Incoming to Modern Event Platform on the Analytics board.
Tue, Nov 19, 2:34 PM · MW-1.35-notes (1.35.0-wmf.3; 2019-10-22), Performance-Team (Radar), Better Use Of Data, CPT Initiatives (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata created T238657: eventgate-wikimedia should support using remote stream configuration.
Tue, Nov 19, 2:32 PM · MW-1.35-notes (1.35.0-wmf.3; 2019-10-22), Performance-Team (Radar), Better Use Of Data, CPT Initiatives (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata added a comment to T206789: Modern Event Platform: Schema Registry: Implementation.

I think the naming we are having trouble with though is the production vs analytics dichotomy. I'm ok with production, but analytics might not be quite right. We need a word that means 'non production'.

Tue, Nov 19, 2:27 PM · Analytics-Kanban, CPT Initiatives (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata added a comment to T206789: Modern Event Platform: Schema Registry: Implementation.

I see nothing wrong with schemaS! Wait what is schemaE? A quick search just tells me its a latin plural. The plurals I see are schemas and schemata.

Tue, Nov 19, 2:26 PM · Analytics-Kanban, CPT Initiatives (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata added a comment to T223415: Strategy to be able to test eventlogging in beta in the absence of mysql .

Correct ya! I think we can re-evaluate this idea for both beta and prod in the future. It'd be nice to have some topics UI like http://kafka-topics-ui.demo.lenses.io/#/cluster/UAT/topic/n/nyc_yellow_taxi_trip_data/ one day (can't use that one though, it uses Confluent REST API).

Tue, Nov 19, 2:41 AM · Analytics-Kanban, Analytics, Analytics-EventLogging

Mon, Nov 18

Ottomata updated the task description for T236386: Set up eventgate-logging-external in production.
Mon, Nov 18, 7:20 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata updated the task description for T236386: Set up eventgate-logging-external in production.
Mon, Nov 18, 7:17 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata updated the task description for T236386: Set up eventgate-logging-external in production.
Mon, Nov 18, 7:16 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T233630: Public schema.wikimedia.org endpoint for schema.svc.

FYI for my own reference, an example of enabling envoyproxy in puppet: https://gerrit.wikimedia.org/r/c/operations/puppet/+/534597

Mon, Nov 18, 7:15 PM · Analytics-Kanban, Patch-For-Review, Service-deployment-requests, CPT Initiatives (Modern Event Platform (TEC2)), Analytics-EventLogging, Event-Platform, Services, Operations, Analytics
Ottomata updated the task description for T236386: Set up eventgate-logging-external in production.
Mon, Nov 18, 7:14 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T236386: Set up eventgate-logging-external in production.

@Joe @akosiaris @ema I'd like to move forward with these patches this week, hopefully sooner rather than later. Can you find some time to review? I'll add them all to ticket description for easier reference.

Mon, Nov 18, 7:09 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata updated the task description for T237259: Document all uses of the puppetCA certificate.
Mon, Nov 18, 7:07 PM · Patch-For-Review, DBA, User-jbond, Puppet, Operations
Ottomata updated the task description for T237259: Document all uses of the puppetCA certificate.
Mon, Nov 18, 7:06 PM · Patch-For-Review, DBA, User-jbond, Puppet, Operations
Ottomata updated the task description for T237259: Document all uses of the puppetCA certificate.
Mon, Nov 18, 7:04 PM · Patch-For-Review, DBA, User-jbond, Puppet, Operations
Ottomata updated the task description for T237259: Document all uses of the puppetCA certificate.
Mon, Nov 18, 7:04 PM · Patch-For-Review, DBA, User-jbond, Puppet, Operations
Ottomata added a project to T236386: Set up eventgate-logging-external in production: Service-deployment-requests.
Mon, Nov 18, 7:03 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a project to T236386: Set up eventgate-logging-external in production: serviceops.
Mon, Nov 18, 7:02 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T236386: Set up eventgate-logging-external in production.

Another patch: deploying puppet CA cert to eventgate pods for kafka producer TLS:

Mon, Nov 18, 6:55 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata created T238569: Cannot log into Gerrit using Brave Browser.
Mon, Nov 18, 5:12 PM · Gerrit
Ottomata added a comment to T198544: Look into whitelisting wikimedia Apis with brave.

Is Brave still blocking? I can see graphs on e.g. https://stats.wikimedia.org/v2/#/all-projects/reading/total-page-views/normal|bar|2-year|~total|monthly

Mon, Nov 18, 4:55 PM · Analytics
Ottomata moved T238434: Identify next steps needed for Product Analytics to approve switching mw.user.sessionId back to session-cookie persistence from Incoming to Radar on the Analytics board.
Mon, Nov 18, 4:51 PM · Better Use Of Data, Product-Analytics, Analytics, Performance-Team
Ottomata moved T238113: Repurpose db1107 as a generic database from Incoming to Operational Excellence on the Analytics board.
Mon, Nov 18, 4:51 PM · Analytics, DBA
Ottomata raised the priority of T223931: Switch mw.user.sessionId back to session-cookie persistence from Normal to High.
Mon, Nov 18, 4:51 PM · Analytics-Kanban, Product-Infrastructure-Team-Backlog, Product-Analytics (Kanban), Better Use Of Data, Analytics, Performance-Team
Ottomata moved T223931: Switch mw.user.sessionId back to session-cookie persistence from Radar to Data Quality on the Analytics board.
Mon, Nov 18, 4:51 PM · Analytics-Kanban, Product-Infrastructure-Team-Backlog, Product-Analytics (Kanban), Better Use Of Data, Analytics, Performance-Team
Ottomata assigned T223931: Switch mw.user.sessionId back to session-cookie persistence to Milimetric.
Mon, Nov 18, 4:50 PM · Analytics-Kanban, Product-Infrastructure-Team-Backlog, Product-Analytics (Kanban), Better Use Of Data, Analytics, Performance-Team
Ottomata closed T87738: Discrepancies in historical total active editor numbers, a subtask of T89024: Report metrics for Quarterly Report 2014 Oct-Dec, as Declined.
Mon, Nov 18, 4:46 PM · Analytics-Kanban, Analytics
Ottomata closed T87738: Discrepancies in historical total active editor numbers as Declined.

WikiStats 1 is no longer maintained.

Mon, Nov 18, 4:46 PM · Analytics, Analytics-Wikistats
Ottomata closed T101519: Wikistats under counted redirects on non English wikis since January (and hence over counted normal articles) as Declined.

WikiStats 1 is no longer maintained.

Mon, Nov 18, 4:46 PM · Analytics, Internet-Archive, Analytics-Wikistats
Ottomata closed T116526: Study feedback from Andyrom75 for IT wikivoyage on how articles are classified by Wikistats as Declined.

WikiStats 1 is no longer maintained.

Mon, Nov 18, 4:46 PM · Analytics, Analytics-Wikistats
Ottomata closed T127657: Wikistats doesn't yet know of all content namespaces on Wikisource as Declined.

WikiStats 1 is no longer maintained.

Mon, Nov 18, 4:46 PM · Analytics, Analytics-Wikistats
Ottomata closed T116531: Monthly page view stats for wikibooks, wikinews, wikiquote, wikisource, wikiversity for July 2015 are extremely anomalous as Declined.

wikistats 1 is no longer maintained.

Mon, Nov 18, 4:45 PM · Analytics, Analytics-Wikistats
Ottomata triaged T237124: Growth: implement wider data purge window as Low priority.
Mon, Nov 18, 4:45 PM · Analytics, Product-Analytics, Growth-Team
Ottomata moved T237124: Growth: implement wider data purge window from Incoming to Data Quality on the Analytics board.
Mon, Nov 18, 4:45 PM · Analytics, Product-Analytics, Growth-Team
Ottomata moved T238106: "Wikidata Query Service Updater" should have 'bot' in the user agent to indicate is a tool from Incoming to Bots on the Analytics board.
Mon, Nov 18, 4:44 PM · Discovery-Search (Current work), Analytics
Ottomata moved T238357: Label high volume bot spikes in pageview data as automated traffic from Incoming to Bots on the Analytics board.
Mon, Nov 18, 4:44 PM · Analytics
Ottomata moved T238358: Deploy high volume bot spike detector to hungarian wikipedia from Incoming to Bots on the Analytics board.
Mon, Nov 18, 4:44 PM · Analytics
Ottomata moved T238360: Hourly Feature extraction for bot detection from webrequest from Incoming to Bots on the Analytics board.
Mon, Nov 18, 4:44 PM · Analytics-Kanban, Analytics
Ottomata moved T238361: Hourly labeling of "automated" traffic before loading of pageviews into pageview_hourly from Incoming to Bots on the Analytics board.
Mon, Nov 18, 4:44 PM · Analytics
Ottomata moved T238363: Vet high volume bot spike detection code from Incoming to Bots on the Analytics board.
Mon, Nov 18, 4:44 PM · Analytics
Ottomata triaged T238365: Add editors per country data to AQS API as Normal priority.
Mon, Nov 18, 4:43 PM · Analytics
Ottomata moved T238365: Add editors per country data to AQS API from Incoming to Analytics Query Service on the Analytics board.
Mon, Nov 18, 4:43 PM · Analytics
Ottomata triaged T238389: Rerun pingback reports to categorize software versions correctly. as High priority.
Mon, Nov 18, 4:43 PM · Analytics-Kanban, Analytics
Ottomata moved T238389: Rerun pingback reports to categorize software versions correctly. from Incoming to Data Quality on the Analytics board.
Mon, Nov 18, 4:42 PM · Analytics-Kanban, Analytics
Ottomata assigned T238389: Rerun pingback reports to categorize software versions correctly. to mforns.
Mon, Nov 18, 4:42 PM · Analytics-Kanban, Analytics
Ottomata added a project to T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc.: Event-Platform.
Mon, Nov 18, 4:41 PM · Event-Platform, Analytics
Ottomata triaged T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc. as High priority.
Mon, Nov 18, 4:41 PM · Event-Platform, Analytics
Ottomata moved T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc. from Incoming to Modern Event Platform on the Analytics board.
Mon, Nov 18, 4:41 PM · Event-Platform, Analytics
Ottomata added a parent task for T223628: Replace Camus with Kafka Connect for event data imports: T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc..
Mon, Nov 18, 4:41 PM · Analytics, Event-Platform
Ottomata added a subtask for T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc.: T223628: Replace Camus with Kafka Connect for event data imports.
Mon, Nov 18, 4:41 PM · Event-Platform, Analytics
Ottomata renamed T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc. from Evaluate (again) Gobblin as possible replacement for Camus to Evaluate possible replacements for Camus: Gobblin, Marmaryan, etc..
Mon, Nov 18, 4:40 PM · Event-Platform, Analytics
Ottomata triaged T238432: Add MaxMind DB files on an-coord1001 for hive local-jobs using UDF to succeed as High priority.
Mon, Nov 18, 4:39 PM · Patch-For-Review, Analytics-Kanban, Analytics
Ottomata moved T238432: Add MaxMind DB files on an-coord1001 for hive local-jobs using UDF to succeed from Incoming to Operational Excellence on the Analytics board.
Mon, Nov 18, 4:39 PM · Patch-For-Review, Analytics-Kanban, Analytics
Ottomata triaged T238461: Direct link generator to reports in Superset has the incorrect hostname as High priority.
Mon, Nov 18, 4:38 PM · Patch-For-Review, Analytics-Kanban, Product-Analytics, Analytics
Ottomata moved T238461: Direct link generator to reports in Superset has the incorrect hostname from Incoming to Smart Tools for Better Data on the Analytics board.
Mon, Nov 18, 4:38 PM · Patch-For-Review, Analytics-Kanban, Product-Analytics, Analytics
Ottomata assigned T238461: Direct link generator to reports in Superset has the incorrect hostname to elukey.
Mon, Nov 18, 4:38 PM · Patch-For-Review, Analytics-Kanban, Product-Analytics, Analytics
Ottomata triaged T137984: Determine total number of external links in all Wikipedias as Low priority.
Mon, Nov 18, 4:36 PM · Analytics, Analytics-Wikistats
Ottomata moved T137984: Determine total number of external links in all Wikipedias from Incoming to Analytics Query Service on the Analytics board.
Mon, Nov 18, 4:36 PM · Analytics, Analytics-Wikistats
Ottomata closed T143254: Ireland in Tagalog, Bengali and Urdu Wikipedia traffic breakdown as Declined.

wikistats v1 is no longer maintained. If this is true in wikistats v2 please file a new ticket. TY!

Mon, Nov 18, 4:33 PM · Analytics, Bengali-Sites, Analytics-Wikistats
Ottomata triaged T238560: Doubts and questions about Kerberos and Hadoop as High priority.
Mon, Nov 18, 4:31 PM · Analytics-Kanban, Analytics
Ottomata moved T238560: Doubts and questions about Kerberos and Hadoop from Incoming to Operational Excellence on the Analytics board.
Mon, Nov 18, 4:31 PM · Analytics-Kanban, Analytics
Ottomata moved T231858: Archive data on eventlogging MySQL to analytics replica before decomisioning from In Progress to Ready to Deploy on the Analytics-Kanban board.
Mon, Nov 18, 4:06 PM · Analytics-Kanban, Analytics, Analytics-EventLogging
Ottomata added a comment to T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc..

Hm a very quick read of that looks pretty good!

Mon, Nov 18, 2:22 PM · Event-Platform, Analytics

Fri, Nov 15

Ottomata added a comment to T236386: Set up eventgate-logging-external in production.

Hmmm...@fgiunchedi do your various Kafka logging producers use Kafka TLS? We haven't done that yet in any EventGate instances...perhaps we should eh?

Fri, Nov 15, 8:49 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T236386: Set up eventgate-logging-external in production.

Ok, TLS everywhere, right? Got some new patches up. I'd like to start merging these next week, so I'll summarize them again with proper order of operations (mostly for my own sanity).

Fri, Nov 15, 8:48 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T225129: Move eventgate logs to new logging infrastructure.

Ah, I think the deployment-chart for eventgate already has this done. We just need to deploy. Will do soon enough and resolve once we do.

Fri, Nov 15, 7:20 PM · observability, Analytics, Event-Platform, Operations, Wikimedia-Logstash
Ottomata added a comment to T236386: Set up eventgate-logging-external in production.

More brain bouncing with Jason. I think we like:

Fri, Nov 15, 6:55 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T236386: Set up eventgate-logging-external in production.
  • stream-intake.wikimedia.org
Fri, Nov 15, 6:35 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata updated subscribers of T236386: Set up eventgate-logging-external in production.

Heard some preferences from SREs to use a separate domain. I'd like to use the same domain for all the external eventgate instances then. Let's bike shed a name.

Fri, Nov 15, 4:21 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata renamed T236386: Set up eventgate-logging-external in production from Create new eventgate-logging deployment in k8s with helmfile to Set up eventgate-logging-external in production.
Fri, Nov 15, 4:20 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T198994: EventStreams butcher up some Unicode characters.

Ah! I did misunderstand that, thank you. Ok I think I get it now.
So the bot consumed an event for revision 93764184 create (right?), which is for a page with the title with мир:

Fri, Nov 15, 3:20 PM · Analytics, Wikimedia-Stream
Ottomata added a comment to T236386: Set up eventgate-logging-external in production.

We have to answer this question for eventgate-analytics-external too. If we do a separate domain, perhaps the same for both of them? beacon.wikimedia.org/v1/{logging,analytics}?

Fri, Nov 15, 2:44 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T198994: EventStreams butcher up some Unicode characters.

Hm, right, but what I mean is, the missing м looks like it is actually missing from the saved content:

Fri, Nov 15, 2:25 PM · Analytics, Wikimedia-Stream
Ottomata added a comment to T238243: Archive /home/ezachte data on stat1007.

Ah hi Erik! Ok thank you!

Fri, Nov 15, 2:18 PM · Analytics
Ottomata added a comment to T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, etc..

+1, we should consider Gobblin again. I was looking at it the other day a bit too. I'm not giving up on Kafka Connect yet, but I'm not hopeful.

Fri, Nov 15, 2:17 PM · Event-Platform, Analytics
Ottomata added a comment to T231858: Archive data on eventlogging MySQL to analytics replica before decomisioning .

Ah! Good to know. Will do next time. Or...I could dump again, the DBs are still up. Do you think I should?

Fri, Nov 15, 2:16 PM · Analytics-Kanban, Analytics, Analytics-EventLogging

Thu, Nov 14

Ottomata added a comment to T231858: Archive data on eventlogging MySQL to analytics replica before decomisioning .

db1107:

real    1258m49.602s
user    1875m25.784s
sys     54m34.796s
696G Nov 14 15:50 mysqldump-db1107-2019-11-13.sql.gz
Thu, Nov 14, 9:27 PM · Analytics-Kanban, Analytics, Analytics-EventLogging
Ottomata added a comment to T198994: EventStreams butcher up some Unicode characters.

Hey sorry, just saw this!

Thu, Nov 14, 8:50 PM · Analytics, Wikimedia-Stream
Ottomata added a comment to T236386: Set up eventgate-logging-external in production.

Ok, patches for LVS and discovery ready for review:

Thu, Nov 14, 8:02 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata updated subscribers of T236386: Set up eventgate-logging-external in production.

Yeah. Public endpoint! Which begs the question @fgiunchedi...what should this endpoint be? Since this will be MediaWiki JS POSTing... do we just need routing from a cache frontend (or from MW?) domain to do the right thing? We'll have the same question for eventgate-analytics-external too.

Thu, Nov 14, 7:40 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Event-Platform, Analytics-Kanban, User-Elukey, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Ottomata added a comment to T233634: Modern Event Platform: Stream Configuration: Implementation.

Thanks @dr0ptp4kt!

Thu, Nov 14, 6:37 PM · Product-Infrastructure-Team-Backlog (Kanban), MW-1.35-notes (1.35.0-wmf.3; 2019-10-22), Patch-For-Review, Performance-Team (Radar), Better Use Of Data, CPT Initiatives (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Ottomata triaged T238138: Vertical: Virtualpageview datastream on MEP as Normal priority.
Thu, Nov 14, 6:26 PM · Analytics, Event-Platform, Epic, Better Use Of Data, Product-Infrastructure-Team-Backlog
Ottomata lowered the priority of T238230: Decommission EventLogging backend components by migrating to MEP from High to Normal.
Thu, Nov 14, 6:26 PM · Analytics, Analytics-EventLogging, Event-Platform
Ottomata moved T238138: Vertical: Virtualpageview datastream on MEP from Incoming to Modern Event Platform on the Analytics board.
Thu, Nov 14, 6:26 PM · Analytics, Event-Platform, Epic, Better Use Of Data, Product-Infrastructure-Team-Backlog
Ottomata triaged T238230: Decommission EventLogging backend components by migrating to MEP as High priority.
Thu, Nov 14, 6:26 PM · Analytics, Analytics-EventLogging, Event-Platform