Page MenuHomePhabricator

wkandek (Wolfgang Kandek)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Apr 12 2020, 7:16 PM (33 w, 1 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
WKandek (WMF) [ Global Accounts ]

Recent Activity

Yesterday

wkandek added a member for Service-deployment-requests: wkandek.
Sun, Nov 29, 7:24 AM

Aug 18 2020

wkandek closed Restricted Task, a subtask of T257066: Extension:Score / Lilypond is disabled on all wikis, as Resolved.
Aug 18 2020, 1:55 PM · User-notice, Security-Team, Security, Wikimedia-General-or-Unknown, MediaWiki-extensions-Score, Operations

Aug 7 2020

wkandek added a comment to T256863: restbase2009 down.

Will, is the unexpected and unknown state due to the Cassandra database state. I remember this being discussed a couple of days ago.

Aug 7 2020, 4:03 PM · RESTBase, Operations, ops-codfw

Jul 24 2020

wkandek added a comment to T258775: All wtp and parse servers have a bad partition scheme..

Back to 76%: php-1.36.0-wmf.1 and .41 are now way smaller.

Jul 24 2020, 5:31 PM · Operations, serviceops
wkandek closed T254530: Evaluate Locust Stress Test Tool as Resolved.
Jul 24 2020, 1:39 AM · serviceops

Jul 23 2020

wkandek triaged T257906: Move testreduce away from scandium to a separate Buster Ganeti VM as Medium priority.
Jul 23 2020, 10:57 PM · Patch-For-Review, Parsoid-Tests, Parsoid, serviceops, Operations
wkandek moved T257906: Move testreduce away from scandium to a separate Buster Ganeti VM from Incoming 🐫 to Doing 😎 on the serviceops board.
Jul 23 2020, 10:56 PM · Patch-For-Review, Parsoid-Tests, Parsoid, serviceops, Operations

Jul 19 2020

wkandek added a comment to T258336: db1082 crashed.
PST   UTC    Lag     Minutes LagMinutes   Lag Decay Rate/minute
12:30 19:30  17:43
12:56 19:56  12:44      0:26        299      11.50
13:42 20:42   5:38      0:46        426       9.26
13:52 20:52   4:31      0:10         67       6.70
14:08 21:08   1:20      0:16        191      11.94
Jul 19 2020, 9:57 PM · Operations, DBA
wkandek added a comment to T258336: db1082 crashed.

Should dbtree reflect the replication lag on db1124?

Jul 19 2020, 6:27 PM · Operations, DBA

Jul 14 2020

wkandek updated subscribers of T257948: https://blog.wikimedia.org/ returning blank page?.

Christopher Koerner:e-mail: 35 minutes ago
Once I fix what is broken all the posts from blog.wikimedia.org will be at diff.wikimedia.org with redirects.

Jul 14 2020, 6:51 PM · Diff-blog
wkandek added a comment to T257948: https://blog.wikimedia.org/ returning blank page?.

slack conversation in OCG-General indicates it is part of the blog migration and will be addressed soon.

Jul 14 2020, 6:50 PM · Diff-blog

Jun 23 2020

wkandek added a comment to T255927: db1088 crashed.

HP says, the server should not reboot due to battery failure: https://support.hpe.com/hpesc/public/docDisplay?docId=mmr_kc-0126260#:~:text=POST%20Error%3A%20313%20%2D%20HPE%20Smart,other%20reasons%20for%20a%20reboot.

Jun 23 2020, 10:09 PM · DBA, Operations
wkandek added a comment to T255927: db1088 crashed.

Should a BBU failure cause a reboot?

Jun 23 2020, 5:28 PM · DBA, Operations

Jun 16 2020

wkandek created T255511: mcrouter memcached flapping in gutter pool.
Jun 16 2020, 12:21 AM · serviceops

Jun 11 2020

wkandek added a comment to T255179: Session failures ("invalid CSRF token") preventing edits, login, logout, etc due to kask outage.

https://grafana.wikimedia.org/d/000001590/sessionstore?orgId=1&from=1591900083237&to=1591903561732

Jun 11 2020, 9:10 PM · Wikimedia-Incident, Platform Engineering, MediaWiki-Authentication-and-authorization, MediaWiki-User-login-and-signup, User-DannyS712

Jun 4 2020

wkandek triaged T254530: Evaluate Locust Stress Test Tool as Medium priority.
Jun 4 2020, 10:52 PM · serviceops
wkandek moved T254530: Evaluate Locust Stress Test Tool from Incoming 🐫 to Doing 😎 on the serviceops board.
Jun 4 2020, 10:51 PM · serviceops
wkandek added a comment to T254530: Evaluate Locust Stress Test Tool.

Locust was first setup locally under Virtualbox VMs and functionally tested. Vagrant was used to generate the VMs and puppet was used for the software installation and configuration. Puppet is also used to propagate changes in the test specification file.
Vagrant was also used in the port to AWS and functional testing works well. But it is cumbersome to generate 100s of VMs with Vagrant as API throttling seems to kick in it. It is easier and far faster to clone of on the Locust worker machines and use the AWS API to
generate additional workers. That way 1000 machines be brought up in under 1 hour. The cost of such a test is fairly low: under 10 USD/hour.

Jun 4 2020, 10:47 PM · serviceops
wkandek added a parent task for T254530: Evaluate Locust Stress Test Tool: Unknown Object (Task).
Jun 4 2020, 10:34 PM · serviceops
wkandek created T254530: Evaluate Locust Stress Test Tool.
Jun 4 2020, 10:32 PM · serviceops

May 21 2020

wkandek added a comment to T249352: Onboarding Wolfgang Kandek.

pwstore installed, access pending regeneration of pgp key. Task can be closed.

May 21 2020, 6:31 PM · LDAP-Access-Requests, SRE-Access-Requests, Operations

May 15 2020

wkandek added a comment to T252577: Maxmind data update issues for DNS (and others?).

Just FYI: my machine is being served from esams again.

May 15 2020, 3:04 AM · Operations, Traffic

May 14 2020

wkandek added a comment to P11193 SRE onboarding chat demo.

from the slide: curl -H "Content-Type: application/yaml" --data-binary @data https://blubberoid.wikimedia.org/v1/hello

May 14 2020, 1:29 PM

Apr 27 2020

wkandek updated the task description for T249352: Onboarding Wolfgang Kandek.
Apr 27 2020, 10:41 PM · LDAP-Access-Requests, SRE-Access-Requests, Operations
wkandek updated the task description for T249352: Onboarding Wolfgang Kandek.
Apr 27 2020, 9:46 PM · LDAP-Access-Requests, SRE-Access-Requests, Operations
wkandek updated the task description for T249352: Onboarding Wolfgang Kandek.
Apr 27 2020, 8:09 PM · LDAP-Access-Requests, SRE-Access-Requests, Operations
wkandek added a comment to T249352: Onboarding Wolfgang Kandek.

RSA Key from yubikey:

Apr 27 2020, 12:14 AM · LDAP-Access-Requests, SRE-Access-Requests, Operations
wkandek added a comment to T249352: Onboarding Wolfgang Kandek.
gpg --fingerprint 9B51CE0772203719B26C8ED3EEABB9556398421F
pub   rsa4096 2020-04-23 [SC]
      9B51 CE07 7220 3719 B26C  8ED3 EEAB B955 6398 421F
uid           [ultimate] Wolfgang Kandek <wkandek@wikimedia.org>
sub   rsa4096 2020-04-23 [E]
sub   rsa4096 2020-04-23 [A]
Apr 27 2020, 12:13 AM · LDAP-Access-Requests, SRE-Access-Requests, Operations

Apr 20 2020

wkandek added a watcher for serviceops: wkandek.
Apr 20 2020, 3:56 PM

Apr 13 2020

wkandek updated the task description for T249352: Onboarding Wolfgang Kandek.
Apr 13 2020, 8:23 PM · LDAP-Access-Requests, SRE-Access-Requests, Operations
wkandek updated the task description for T249352: Onboarding Wolfgang Kandek.
Apr 13 2020, 8:23 PM · LDAP-Access-Requests, SRE-Access-Requests, Operations
wkandek updated the task description for T249352: Onboarding Wolfgang Kandek.
Apr 13 2020, 6:58 PM · LDAP-Access-Requests, SRE-Access-Requests, Operations