Page MenuHomePhabricator

Ottomata (Andrew Otto)
User

Projects (9)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Oct 9 2014, 4:50 PM (321 w, 1 d)
Availability
Available
IRC Nick
ottomata
LDAP User
Ottomata
MediaWiki User
Ottomata [ Global Accounts ]

Recent Activity

Yesterday

Ottomata updated subscribers of T120242: Reliable (atomic) MediaWiki event production.
Fri, Dec 4, 4:15 PM · Platform Engineering, Platform Team Legacy (Later), Analytics, Event-Platform, Services (later)
Ottomata added a comment to T120242: Reliable (atomic) MediaWiki event production.

@dianamontalion
I updated this task with what I hope is more descriptive of the problem and some possible solutions. I really think solving this is key to the Architecture teams mission of supporting 'infinite use cases insert rest of arch mission phraseology here' :)

Fri, Dec 4, 4:14 PM · Platform Engineering, Platform Team Legacy (Later), Analytics, Event-Platform, Services (later)
Ottomata added a project to T120242: Reliable (atomic) MediaWiki event production: Platform Engineering.
Fri, Dec 4, 4:12 PM · Platform Engineering, Platform Team Legacy (Later), Analytics, Event-Platform, Services (later)
Ottomata added a comment to T120242: Reliable (atomic) MediaWiki event production.

We'd also have to some how tie the Kafka produce call with the MySQL DB write call into a transaction.

To do this I think we'd need some kind of two phase commit service for MediaWiki, which sounds really hard to me!

Fri, Dec 4, 4:10 PM · Platform Engineering, Platform Team Legacy (Later), Analytics, Event-Platform, Services (later)
Ottomata updated the task description for T120242: Reliable (atomic) MediaWiki event production.
Fri, Dec 4, 4:08 PM · Platform Engineering, Platform Team Legacy (Later), Analytics, Event-Platform, Services (later)
Ottomata updated the task description for T120242: Reliable (atomic) MediaWiki event production.
Fri, Dec 4, 4:08 PM · Platform Engineering, Platform Team Legacy (Later), Analytics, Event-Platform, Services (later)
Ottomata updated the task description for T120242: Reliable (atomic) MediaWiki event production.
Fri, Dec 4, 4:07 PM · Platform Engineering, Platform Team Legacy (Later), Analytics, Event-Platform, Services (later)
Ottomata updated the task description for T120242: Reliable (atomic) MediaWiki event production.
Fri, Dec 4, 4:06 PM · Platform Engineering, Platform Team Legacy (Later), Analytics, Event-Platform, Services (later)
Ottomata added a comment to T269444: Requesting access to Analytics Data for Jakob_WMDE.

OH OOPS I did thank you.

Fri, Dec 4, 2:59 PM · Patch-For-Review, Operations, SRE-Access-Requests
Ottomata added a comment to T269444: Requesting access to Analytics Data for Jakob_WMDE.

@WMDE-leszek will also need a Kerberos principal and should be in one of either the wmf or nda LDAP group.

Fri, Dec 4, 2:09 PM · Patch-For-Review, Operations, SRE-Access-Requests
Ottomata added a comment to T268202: Eq: 5 VM request for kafka-test-eqiad cluster.

Ah, we should for sure not page on this. I just looked, and if monitoring is enabled we set critical => true for the Kafka Broker Server process: https://github.com/wikimedia/puppet/blob/production/modules/profile/manifests/kafka/broker/monitoring.pp#L53

Fri, Dec 4, 2:08 PM · Patch-For-Review, vm-requests, Operations

Thu, Dec 3

Ottomata moved T258970: Set up environment for Product Analytics system user from Ops Week to Operational Excellence on the Analytics board.
Thu, Dec 3, 4:56 PM · Analytics-Kanban, Analytics, Product-Analytics
Ottomata added a project to T251788: Add folder creation for sqoop initial installation in puppet: Analytics-Kanban.
Thu, Dec 3, 4:55 PM · Analytics-Kanban, Patch-For-Review, Analytics
Ottomata moved T251788: Add folder creation for sqoop initial installation in puppet from Ops Week to Operational Excellence on the Analytics board.
Thu, Dec 3, 4:55 PM · Analytics-Kanban, Patch-For-Review, Analytics
Ottomata moved T266872: Improve Refine from Ops Week to Operational Excellence on the Analytics board.
Thu, Dec 3, 4:55 PM · Analytics
Ottomata moved T264358: Investigate oozie banner monthly job timeouts from Ops Week to Operational Excellence on the Analytics board.
Thu, Dec 3, 4:54 PM · Analytics-Kanban, Analytics
Ottomata added a comment to T264358: Investigate oozie banner monthly job timeouts.

The problem we were having was that the jobs were timingout before execution time due to the long delay (longer than 60 days), leading to success-files being deleted for them when restarted.

Thu, Dec 3, 3:15 PM · Analytics-Kanban, Analytics

Wed, Dec 2

Ottomata added a comment to T264358: Investigate oozie banner monthly job timeouts.

Well, those ones would succeed because now the _SUCCESS flags exist. The problem is when the job times out before the _SUCCESS flags exist. If the October job succeeds without timing out before the the Dec 19th dependency exists, we'll know we fixed it.

Wed, Dec 2, 10:28 PM · Analytics-Kanban, Analytics
Ottomata placed T268733: Alter table for navigation timing errors out in Hadoop test up for grabs.
Wed, Dec 2, 9:50 PM · Analytics-Kanban, Analytics
Ottomata updated subscribers of T269160: Set up internal eventstreams instance exposing all streams declared in stream config (and in kafka jumbo).
Wed, Dec 2, 8:39 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Analytics, Event-Platform, EventStreams
Ottomata added a comment to T269284: Requesting access to Analytics Data for WMDE-leszek.

Approved. @WMDE-leszek will also need nda (or wmf?) LDAP group membership, as well as a Kerberos principal.

Wed, Dec 2, 8:34 PM · Operations, SRE-Access-Requests
Ottomata added a comment to T267592: Updated schema strategy for analytics events.

Related: T263672: Figure out where stream/schema annotations belong (for sanitization and other use cases), @mpopov mentioned that you might want to use stream config to enable/disable setting of particular base fields by client libraries; we might want to do something similar for server side default settings, like automatically filling in HTTP header values.

Wed, Dec 2, 6:07 PM · Better Use Of Data, Patch-For-Review, Product-Analytics, Product-Infrastructure-Data
Ottomata added a comment to T267592: Updated schema strategy for analytics events.

The concept of an event topic is designed to replace the idea of instrumentation producing events to a particular stream. Our system allows multiple streams to subscribe to the same events, and we have made this explicit by recognizing that these events are not being sent to streams, rather the streams are subscribing to topics, and receiving the events for those topics.

Wed, Dec 2, 6:06 PM · Better Use Of Data, Patch-For-Review, Product-Analytics, Product-Infrastructure-Data
Ottomata moved T266573: eventgate-analytics-external occasionally seems to fail lookups of dynamic stream config from MW EventStreamConfig API from In Progress to Ready to Deploy on the Analytics-Kanban board.
Wed, Dec 2, 5:02 PM · Patch-For-Review, Event-Platform, Analytics-Kanban, Analytics
Ottomata added a comment to T261693: Ensure Puppet checks types as part of the build.

Interesting, thank you! It's good to have that on the profile class.

Wed, Dec 2, 2:23 PM · Patch-For-Review, puppet-compiler, Puppet, Operations

Tue, Dec 1

Ottomata added projects to T269160: Set up internal eventstreams instance exposing all streams declared in stream config (and in kafka jumbo): serviceops, Service-deployment-requests.
Tue, Dec 1, 8:31 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Analytics, Event-Platform, EventStreams
Ottomata updated the task description for T269160: Set up internal eventstreams instance exposing all streams declared in stream config (and in kafka jumbo).
Tue, Dec 1, 7:51 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Analytics, Event-Platform, EventStreams
Ottomata updated the task description for T269160: Set up internal eventstreams instance exposing all streams declared in stream config (and in kafka jumbo).
Tue, Dec 1, 7:50 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Analytics, Event-Platform, EventStreams
Ottomata updated the task description for T269160: Set up internal eventstreams instance exposing all streams declared in stream config (and in kafka jumbo).
Tue, Dec 1, 7:49 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Analytics, Event-Platform, EventStreams
Ottomata created T269160: Set up internal eventstreams instance exposing all streams declared in stream config (and in kafka jumbo).
Tue, Dec 1, 7:48 PM · Services, Operations, Service-deployment-requests, serviceops, Patch-For-Review, Analytics, Event-Platform, EventStreams
Ottomata added a comment to T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.

I found SpecialInvestigate, it is in the CheckUser extension: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CheckUser/+/644536

Tue, Dec 1, 3:09 PM · Patch-For-Review, Anti-Harassment
Ottomata added a subtask for T253121: MEP Client MediaWiki PHP: T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.
Tue, Dec 1, 3:08 PM · Patch-For-Review, Product-Infrastructure-Data, Event-Platform, Analytics, Better Use Of Data
Ottomata added a parent task for T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform: T253121: MEP Client MediaWiki PHP.
Tue, Dec 1, 3:08 PM · Patch-For-Review, Anti-Harassment
Ottomata added a comment to T253121: MEP Client MediaWiki PHP.

Hiya, I think we need to expedite https://gerrit.wikimedia.org/r/c/mediawiki/extensions/EventLogging/+/623459. We need it for the EventLogging -> EventGate migration.

Tue, Dec 1, 3:07 PM · Patch-For-Review, Product-Infrastructure-Data, Event-Platform, Analytics, Better Use Of Data
Ottomata updated subscribers of T264358: Investigate oozie banner monthly job timeouts.
Tue, Dec 1, 2:34 PM · Analytics-Kanban, Analytics
Ottomata added a comment to T264358: Investigate oozie banner monthly job timeouts.

I wonder if the -1 timeout in coordinator.xml conflicts with the Oozie property [[ https://oozie.apache.org/docs/3.1.3-incubating/oozie-default.xml | oozie.service.coord.default.max.timeout ]], which defaults to 60 days. It does seem likely, as the workflows and being put in TIMEDOUT 60 days after the created time.

Tue, Dec 1, 2:34 PM · Analytics-Kanban, Analytics

Mon, Nov 30

Ottomata added a comment to T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.

I'm also trying to find out if we actually need to migrate AutoblockIpBlock and CookieBlock after all. Neither of these seem to have had any data for many years. Can we just deprecate them and not migrate?

Mon, Nov 30, 8:51 PM · Patch-For-Review, Anti-Harassment
Ottomata created T269032: mediawiki-wikitext-history-2020-10 failed .
Mon, Nov 30, 7:51 PM · Patch-For-Review, Analytics
Ottomata assigned T251788: Add folder creation for sqoop initial installation in puppet to razzi.

So, the sqoop puppetization should just ensure that this directory exists?

Mon, Nov 30, 7:32 PM · Analytics-Kanban, Patch-For-Review, Analytics
Ottomata moved T237774: Address refinery security vulnerabilities with jackson and netty from Ops Week to Incoming on the Analytics board.
Mon, Nov 30, 7:31 PM · Analytics
Ottomata added a comment to T237774: Address refinery security vulnerabilities with jackson and netty.

I don't think this should be ops week, right? This is a regular task that should be scheduled, no? Moving back to incoming.

Mon, Nov 30, 7:31 PM · Analytics
Ottomata moved T255840: Broken icons on https://analytics.wikimedia.org/ from Ops Week to Incoming on the Analytics board.
Mon, Nov 30, 7:30 PM · Design, Analytics
Ottomata added a comment to T255840: Broken icons on https://analytics.wikimedia.org/.

This looks like a problem with Firefox, it works ok in Chrome.

Mon, Nov 30, 7:30 PM · Design, Analytics
Ottomata moved T265971: Check data currently stored on thorium and drop what it is not needed anymore from Ops Week to Operational Excellence on the Analytics board.
Mon, Nov 30, 7:27 PM · Analytics
Ottomata claimed T266872: Improve Refine.
Mon, Nov 30, 7:17 PM · Analytics
Ottomata added a comment to T264358: Investigate oozie banner monthly job timeouts.

Hm, this looks to be related to or caused by T222603: Fix oozie banner_impression monthly job.

Mon, Nov 30, 7:15 PM · Analytics-Kanban, Analytics
Ottomata edited projects for T209899: The mass-message queue reports 0 when there are still queued messages, added: Analytics-Radar; removed Analytics.
Mon, Nov 30, 5:51 PM · Analytics-Radar, ChangeProp, Event-Platform, WMF-JobQueue, MassMessage
Ottomata edited projects for T209899: The mass-message queue reports 0 when there are still queued messages, added: ChangeProp; removed Analytics.
Mon, Nov 30, 5:51 PM · Analytics-Radar, ChangeProp, Event-Platform, WMF-JobQueue, MassMessage
Ottomata added a comment to T237063: EventLogging validation errors for EditAttemptStep.

revision_id: undefined (which I'm assuming EventLogging filtered out better than it did the previously-mentioned nulls).

If revision_id is not required, and you don't want to send it, you should omit including it in the event data.

Mon, Nov 30, 5:27 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), Editing-team (FY2020-21 Kanban Board), VisualEditor, Growth-Team
Ottomata edited projects for T268220: Refactor puppet profiles to reduce hiera pollution, added: Analytics-Clusters; removed Analytics.
Mon, Nov 30, 5:06 PM · Analytics-Clusters, Analytics-Kanban
Ottomata assigned T268985: Reduce manual kinit frequency on stat100x hosts to elukey.
Mon, Nov 30, 5:06 PM · Analytics-Clusters
Ottomata edited projects for T268951: an-presto1004 shows only the NIC in the boot list, added: Analytics-Clusters; removed Analytics.
Mon, Nov 30, 5:05 PM · Analytics-Clusters, Operations, ops-eqiad
Ottomata edited projects for T268936: Backport kafkacat 1.6.0 from bullseye to buster-backports or buster-wikimedia, added: Analytics-Clusters; removed Analytics.
Mon, Nov 30, 5:05 PM · Analytics-Clusters, Operations
Ottomata triaged T268784: Configure superset cache as Medium priority.
Mon, Nov 30, 5:04 PM · Analytics-Clusters, Product-Analytics
Ottomata edited projects for T268219: Move Superset and Turnilo to an-tool1010, added: Analytics-Clusters; removed Analytics.
Mon, Nov 30, 5:04 PM · Patch-For-Review, Analytics-Clusters
Ottomata edited projects for T268784: Configure superset cache , added: Analytics-Clusters; removed Analytics.
Mon, Nov 30, 5:04 PM · Analytics-Clusters, Product-Analytics
Ottomata assigned T268784: Configure superset cache to razzi.
Mon, Nov 30, 5:03 PM · Analytics-Clusters, Product-Analytics
Ottomata added a project to T257412: Review an-coord1001's usage and failover plans: Analytics-Kanban.
Mon, Nov 30, 4:58 PM · Analytics-Kanban, Patch-For-Review, Analytics-Clusters
Ottomata assigned T255146: Put 24 Hadoop worker nodes in service (cluster expansion) to elukey.
Mon, Nov 30, 4:56 PM · Analytics-Clusters
Ottomata reassigned T260411: Create a temporary hadoop backup cluster from razzi to elukey.
Mon, Nov 30, 4:56 PM · Patch-For-Review, Analytics-Clusters
Ottomata moved T262660: Review and improve Oozie authorization permissions from Q2 2020/2021 to Q3 2020/2021 on the Analytics-Clusters board.
Mon, Nov 30, 4:55 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters
Ottomata removed a project from T256098: Segfault for systemd-sysusers.service on stat1007: Analytics-Clusters.
Mon, Nov 30, 4:52 PM · Operations
Ottomata moved T258700: Replace firejail use in superset with native systemd features from Backlog to Triaged but not scheduled yet on the Analytics-Clusters board.
Mon, Nov 30, 4:50 PM · Analytics-Clusters, User-MoritzMuehlenhoff, Operations
Ottomata moved T263272: analytics-admins should be able to sudo -u www-data in analytics systems from Backlog to Q2 2020/2021 on the Analytics-Clusters board.
Mon, Nov 30, 4:50 PM · Analytics-Kanban, Analytics-Clusters
Ottomata lowered the priority of T261693: Ensure Puppet checks types as part of the build from High to Medium.
Mon, Nov 30, 4:49 PM · Patch-For-Review, puppet-compiler, Puppet, Operations
Ottomata moved T265487: Review recurrent Hadoop worker disk saturation events from Backlog to Q3 2020/2021 on the Analytics-Clusters board.
Mon, Nov 30, 4:47 PM · Analytics-Clusters
Ottomata assigned T265487: Review recurrent Hadoop worker disk saturation events to elukey.
Mon, Nov 30, 4:46 PM · Analytics-Clusters
Ottomata assigned T268074: Create kafka test cluster to razzi.
Mon, Nov 30, 4:40 PM · Analytics-Clusters
Ottomata moved T268074: Create kafka test cluster from Backlog to Q2 2020/2021 on the Analytics-Clusters board.
Mon, Nov 30, 4:40 PM · Analytics-Clusters
Ottomata renamed T268074: Create kafka test cluster from Create kafka-jumbo mirror cluster to Create kafka test cluster.
Mon, Nov 30, 4:40 PM · Analytics-Clusters
Ottomata edited projects for T268684: Downscale Wikidata-analysis pyspark scripts to analytics limits, added: Analytics; removed Analytics-Clusters.
Mon, Nov 30, 4:39 PM · Analytics, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
Ottomata added a comment to T237063: EventLogging validation errors for EditAttemptStep.

It's back! This time it looks like it caused by a revision_id: null

Mon, Nov 30, 4:19 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), Editing-team (FY2020-21 Kanban Board), VisualEditor, Growth-Team
Ottomata added a comment to T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.

@Niharika I have migrated SpecialMuteSubmit and SpecialInvestigate to Event Platform.

Mon, Nov 30, 3:53 PM · Patch-For-Review, Anti-Harassment
Ottomata updated the task description for T259163: Migrate legacy metawiki schemas to Event Platform.
Mon, Nov 30, 3:49 PM · Product-Analytics, MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), Patch-For-Review, Product-Infrastructure-Data, Analytics-Kanban, Analytics, Analytics-EventLogging, Event-Platform
Ottomata updated the task description for T259163: Migrate legacy metawiki schemas to Event Platform.
Mon, Nov 30, 3:48 PM · Product-Analytics, MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), Patch-For-Review, Product-Infrastructure-Data, Analytics-Kanban, Analytics, Analytics-EventLogging, Event-Platform
Ottomata updated the task description for T259163: Migrate legacy metawiki schemas to Event Platform.
Mon, Nov 30, 3:21 PM · Product-Analytics, MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), Patch-For-Review, Product-Infrastructure-Data, Analytics-Kanban, Analytics, Analytics-EventLogging, Event-Platform
Ottomata added a comment to T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.

@Niharika, AFAICT, AutoblockIpBlock hasn't had any data for years, if ever.

Mon, Nov 30, 3:05 PM · Patch-For-Review, Anti-Harassment
Ottomata updated the task description for T259163: Migrate legacy metawiki schemas to Event Platform.
Mon, Nov 30, 3:00 PM · Product-Analytics, MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), Patch-For-Review, Product-Infrastructure-Data, Analytics-Kanban, Analytics, Analytics-EventLogging, Event-Platform
Ottomata updated the task description for T259163: Migrate legacy metawiki schemas to Event Platform.
Mon, Nov 30, 2:46 PM · Product-Analytics, MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), Patch-For-Review, Product-Infrastructure-Data, Analytics-Kanban, Analytics, Analytics-EventLogging, Event-Platform
Ottomata updated the task description for T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.
Mon, Nov 30, 2:42 PM · Patch-For-Review, Anti-Harassment
Ottomata merged task T267341: CookieBlock Event Platform Migration into T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.
Mon, Nov 30, 2:41 PM · Anti-Harassment, Event-Platform, Analytics
Ottomata merged task T267340: AutoblockIpBlock Event Platform Migration into T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.
Mon, Nov 30, 2:41 PM · Anti-Harassment, Analytics, Event-Platform
Ottomata merged task T267349: SpecialInvestigate Event Platform Migration into T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.
Mon, Nov 30, 2:41 PM · Analytics, Anti-Harassment, Event-Platform
Ottomata merged task T267350: SpecialMuteSubmit Event Platform Migration into T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.
Mon, Nov 30, 2:40 PM · Analytics, Anti-Harassment, Event-Platform
Ottomata merged tasks T267350: SpecialMuteSubmit Event Platform Migration, T267349: SpecialInvestigate Event Platform Migration, T267340: AutoblockIpBlock Event Platform Migration, T267341: CookieBlock Event Platform Migration into T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.
Mon, Nov 30, 2:40 PM · Patch-For-Review, Anti-Harassment
Ottomata added a comment to T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.

To fight phab proliferation I'm merging the subtasks in.

Mon, Nov 30, 2:40 PM · Patch-For-Review, Anti-Harassment
Ottomata updated the task description for T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform.
Mon, Nov 30, 2:36 PM · Patch-For-Review, Anti-Harassment
Ottomata closed T267341: CookieBlock Event Platform Migration as Declined.

FYI @sdkim I'm declining this one and marking it as To Deprecate on our audit sheet.

Mon, Nov 30, 2:36 PM · Anti-Harassment, Event-Platform, Analytics
Ottomata closed T267341: CookieBlock Event Platform Migration, a subtask of T259163: Migrate legacy metawiki schemas to Event Platform, as Declined.
Mon, Nov 30, 2:35 PM · Product-Analytics, MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), Patch-For-Review, Product-Infrastructure-Data, Analytics-Kanban, Analytics, Analytics-EventLogging, Event-Platform
Ottomata closed T267341: CookieBlock Event Platform Migration, a subtask of T268517: Migrate Anti-Harassment EventLogging schemas to Event Platform, as Declined.
Mon, Nov 30, 2:35 PM · Patch-For-Review, Anti-Harassment
Ottomata added a comment to T267341: CookieBlock Event Platform Migration.

I propose we do not migrate this schema and mark it as unused. There hasn't been a schema edit on metawiki since Jan 2017, and there isn't even a Hive table for this, which means there hasn't been an event sent since before we migrated to Hive.

Mon, Nov 30, 2:35 PM · Anti-Harassment, Event-Platform, Analytics
Ottomata updated the task description for T259163: Migrate legacy metawiki schemas to Event Platform.
Mon, Nov 30, 2:31 PM · Product-Analytics, MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), Patch-For-Review, Product-Infrastructure-Data, Analytics-Kanban, Analytics, Analytics-EventLogging, Event-Platform
Ottomata added a comment to T268784: Configure superset cache .

+1 sounds good!

Mon, Nov 30, 2:22 PM · Analytics-Clusters, Product-Analytics
Ottomata added a comment to T268985: Reduce manual kinit frequency on stat100x hosts.

execute kinit -R automatically upon login for every user

Mon, Nov 30, 2:06 PM · Analytics-Clusters
Ottomata added a comment to T268028: Move oozie's hive2 actions to analytics-hive.eqiad.wmnet.

Cool!

Mon, Nov 30, 2:06 PM · Patch-For-Review, Analytics, Analytics-Kanban
Ottomata added a comment to T268801: Deprecate the 'researchers' posix group.

Thanks Luca!

Mon, Nov 30, 2:05 PM · Patch-For-Review, Analytics-Kanban, Analytics
Ottomata added a comment to T268936: Backport kafkacat 1.6.0 from bullseye to buster-backports or buster-wikimedia.

THAT IS AWESOME YES PLEASE!

Mon, Nov 30, 2:04 PM · Analytics-Clusters, Operations
Ottomata added a comment to T268733: Alter table for navigation timing errors out in Hadoop test.

This is very similar to an issue in Spark: https://issues.apache.org/jira/browse/SPARK-23890, which is why we are using the Hive session to alter the table in the first place. The changes we are making are compatible type changes, Hive/Spark just can't tell the difference. The Spark fixes should be in Spark 3, but I haven't tested.

Mon, Nov 30, 2:02 PM · Analytics-Kanban, Analytics
Ottomata added a comment to T268784: Configure superset cache .

We deploy a on-host memcached instance, we have already a lot of puppet code + monitoring + metrics to re-use.

Sounds good. Q: Is there a reason we couldn't/shouldn't use the prod memcached clusters?

Mon, Nov 30, 1:58 PM · Analytics-Clusters, Product-Analytics

Wed, Nov 25

Ottomata added a comment to T268784: Configure superset cache .

OH! Cool!

Wed, Nov 25, 7:50 PM · Analytics-Clusters, Product-Analytics