EddieGP (Eddie Greiner-Petter)
Volunteer developer

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Feb 6 2017, 6:31 PM (63 w, 1 d)
Availability
Available
IRC Nick
eddiegp
LDAP User
EddieGP
MediaWiki User
EddieGP

Located in Germany: CET (UTC+1)/CEST (UTC+2)

GPG: 84E7 0489 0F69 0544 0A59 86D8 C485 27CF 7D40 8CDE

Recent Activity

Sun, Apr 22

EddieGP removed a project from T32795: "Show edit toolbar" preference is confusing: MediaWiki-General-or-Unknown.
Sun, Apr 22, 11:52 PM · Contributors-Team, MediaWiki-Page-editing, Design, WikiEditor
EddieGP added a comment to T182549: Email sometimes not being sent when a task is created and "other task activity" is not set in user preferences.

Per the answer on the discourse discussion, see https://secure.phabricator.com/T10448#186240 for why upstream probably won't move $whatever (here: task creation) into it's own notification setting, and https://secure.phabricator.com/T13069 for the preferred approach. I agree with their interpretation that this is just part of a more general problem and it seems the modular solution proposed would be better suited to solve that general problem, allowing very fine-grained notification control using the new system of mail stamps.
The downside of that this is not a trivial thing to fix but might take a while until we see the current system being replaced by the new one.

Sun, Apr 22, 8:47 PM · Phabricator

Fri, Apr 20

EddieGP renamed T192473: deployment-prep has jobqueue issues from deployment-prep has jobqueue/caching issues to deployment-prep has jobqueue issues.
Fri, Apr 20, 10:00 PM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure

Thu, Apr 19

EddieGP raised the priority of T192473: deployment-prep has jobqueue issues from Low to High.

Indeed, the jobqueue on beta is still broken, although it's unrelated to the logspam.
Thanks to Antoine, I now know that jobs are queued in kafka. Fiddling a bit on deployment-kafka04 gives me the impression that all the jobs made it there and are sitting happily in the queue. Somehow they don't get consumed. By the description of the profile::cpjobqueue I think deployment-cpjobqueue consumes the messages from kafka and triggers the jobs on deployment-jobrunner03. There's some errors on deployment-cpjobqueue in logstash, I might take a look on those tomorrow - or rather, later today in my TZ.

Thu, Apr 19, 11:16 PM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure
EddieGP created T192532: Figure out a way to enable volunteers to use the puppet compiler.
Thu, Apr 19, 9:51 AM · Operations, Puppet, puppet-compiler, Continuous-Integration-Config
EddieGP added a comment to T192476: Please unblock stuck global rename Samtar → There'sNoTime.

I didn't run that very command above. Actually I've been doing this for deploymentwiki first - Special:GlobalRenameProgress then said deploymentwiki was "Done" and everything else was "Queued". Then I did the same on enwiki, and it still only moved enwiki to "Done" and left everything else at "Queued". That was the point where I run it for the rest of the wikis in the for-loop.

Thu, Apr 19, 8:54 AM · MediaWiki-extensions-CentralAuth, GlobalRename, Beta-Cluster-Infrastructure
EddieGP added a comment to T192507: Puppet errors on deployment-mediawiki07.

Alright. Please remember to !log such things - if there's no log entry I'll assume puppet breakage is unintended and try to fix it, where it could just be ignored for a few days.

Thu, Apr 19, 8:30 AM · Beta-Cluster-Infrastructure
EddieGP lowered the priority of T192473: deployment-prep has jobqueue issues from Unbreak Now! to Low.

Per aarons comment, just logspam. Seems the actual problem for renames was nutcracker, which I fixed in T192473#4141169. Both are now unstuck.

Thu, Apr 19, 8:24 AM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure
EddieGP closed T192476: Please unblock stuck global rename Samtar → There'sNoTime as Resolved.
Thu, Apr 19, 8:20 AM · MediaWiki-extensions-CentralAuth, GlobalRename, Beta-Cluster-Infrastructure
EddieGP closed T192476: Please unblock stuck global rename Samtar → There'sNoTime, a subtask of T192473: deployment-prep has jobqueue issues, as Resolved.
Thu, Apr 19, 8:20 AM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure
EddieGP closed T192471: Please unblock stuck global rename Artix Kreiger 2 to Artix Krieger 2 as Resolved.

Resolved per the comments above. The errors is just logspam, that's tracked in the parent task.

Thu, Apr 19, 8:10 AM · GlobalRename, Beta-Cluster-Infrastructure, MediaWiki-extensions-CentralAuth
EddieGP closed T192471: Please unblock stuck global rename Artix Kreiger 2 to Artix Krieger 2, a subtask of T192473: deployment-prep has jobqueue issues, as Resolved.
Thu, Apr 19, 8:10 AM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure
EddieGP renamed T192473: deployment-prep has jobqueue issues from redis/nutcracker down on deployment-prep to deployment-prep has jobqueue/caching issues.
Thu, Apr 19, 12:17 AM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure
EddieGP removed a project from T192473: deployment-prep has jobqueue issues: Product-Analytics.
Thu, Apr 19, 12:10 AM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure
EddieGP added a comment to T172165: Require either PHP 7.0+ or HHVM in MW 1.31.

Also note that most of the new php7 syntax won't be available until we stop supporting hhvm. (T176370)

Thu, Apr 19, 12:09 AM · MW-1.31-release-notes, MW-1.31-release, Patch-For-Review, TechCom-RFC (TechCom-Approved), MediaWiki-General-or-Unknown

Wed, Apr 18

Restricted Application added a project to T192473: deployment-prep has jobqueue issues: Product-Analytics.
Wed, Apr 18, 11:59 PM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure
EddieGP added a comment to T192473: deployment-prep has jobqueue issues.

nutcracker now starts on deployment-jobrunner03, see my comment on T178457. The error in the task description still happens though.

Wed, Apr 18, 11:00 PM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure
EddieGP added a comment to T178457: nutcracker fails to start due to lack of /var/run/nutcracker (ex: deployment-videoscaler01 has memcached failures).

Saw the same on deployment-jobrunner03 today (fun note: found this task because google listed it when I searched what 'run, rabbit run' refers to) and had to create the directory manually there to get nutcracker to start

Wed, Apr 18, 10:57 PM · Patch-For-Review, Operations, Release-Engineering-Team (Kanban), Beta-Cluster-Infrastructure
EddieGP moved T192507: Puppet errors on deployment-mediawiki07 from To Triage to Puppet errors on the Beta-Cluster-Infrastructure board.
Wed, Apr 18, 10:02 PM · Beta-Cluster-Infrastructure
EddieGP created T192507: Puppet errors on deployment-mediawiki07.
Wed, Apr 18, 10:01 PM · Beta-Cluster-Infrastructure
EddieGP removed a project from T192473: deployment-prep has jobqueue issues: Wikimedia-log-errors.
Wed, Apr 18, 5:26 PM · MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), Patch-For-Review, Puppet, Beta-Cluster-Infrastructure

Tue, Apr 17

EddieGP added a comment to T190755: Request for access to the beta cluster.

According to the manual, specifying nothing is equivalent to specifying localhost, and both use the socket file rather than the network:

A Unix socket file is used if you do not specify a host name or if you specify the special host name localhost.

Tue, Apr 17, 10:46 PM · Release-Engineering-Team, Beta-Cluster-Infrastructure
EddieGP updated subscribers of T192139: Remove monthly run of updateArticleCount.php.

@Krinkle @demon Per your comments on the child task, could you review the above patch (the 'disable' one is the first)? It's just removing the now redundant cron for updateArticleCount.php.

Tue, Apr 17, 4:28 PM · Operations, Patch-For-Review, Wikimedia-maintenance-script-run
EddieGP renamed T132324: Tracking and Reducing cron-spam to root@ from Tracking and Reducing cron-spam from root@ to Tracking and Reducing cron-spam to root@ .
Tue, Apr 17, 3:35 PM · Patch-For-Review, Operations

Sat, Apr 14

Krinkle awarded T192217: Get rid of the check pipeline a Orange Medal token.
Sat, Apr 14, 10:09 PM · Continuous-Integration-Infrastructure
EddieGP edited Description on Continuous-Integration-Config.
Sat, Apr 14, 8:32 PM
EddieGP updated the task description for T192217: Get rid of the check pipeline.
Sat, Apr 14, 8:10 PM · Continuous-Integration-Infrastructure
EddieGP created T192217: Get rid of the check pipeline.
Sat, Apr 14, 8:09 PM · Continuous-Integration-Infrastructure
EddieGP updated subscribers of T192206: Remove wildcard vhost for *.wikimedia.org.
Sat, Apr 14, 1:34 PM · Patch-For-Review, Operations, Wikimedia-Apache-configuration, Traffic
EddieGP created T192206: Remove wildcard vhost for *.wikimedia.org.
Sat, Apr 14, 1:31 PM · Patch-For-Review, Operations, Wikimedia-Apache-configuration, Traffic
EddieGP created P6993 for wikimedia.org subdomains that do redirect, where do they redirect to?.
Sat, Apr 14, 1:09 PM
EddieGP created P6992 wikimedia.org subdomains that use the *.wikimedia.org vhost.
Sat, Apr 14, 1:04 PM

Fri, Apr 13

EddieGP triaged T166290: Provide a version of frwiki on Beta Cluster / staging as Low priority.
Fri, Apr 13, 11:32 PM · Release-Engineering-Team (Next), Beta-Cluster-Infrastructure
EddieGP edited projects for T188924: Stack overflow in WikibaseRepo initialization on Wikidata Beta, added: Beta-Cluster-reproducible; removed Beta-Cluster-Infrastructure.
Fri, Apr 13, 11:31 PM · Beta-Cluster-reproducible, Wikidata
EddieGP closed T120165: Implement role based hiera lookups for labs as Declined.

I agree with the previous comments. Horizons prefix functionality seems to cover about everything this was expected provide. Doing this would neither extinguish the fact that people have to remember setting hiera values for the cloud services, nor would it help to reduce the mess that cloud service hiera currently is. I'm thus boldly declining this.

Fri, Apr 13, 11:25 PM · Beta-Cluster-Infrastructure, Puppet, Operations, Cloud-Services
EddieGP closed T120165: Implement role based hiera lookups for labs, a subtask of T136077: deployment-cache-upload04/text04 Could not find data item cache::cluster in hiera no default supplied at /etc/puppet/modules/role/manifests/cache/base.pp:17, as Declined.
Fri, Apr 13, 11:25 PM · Beta-Cluster-Infrastructure
EddieGP closed T120165: Implement role based hiera lookups for labs, a subtask of T136078: On beta nutcracker::verbosity default to 5 while prod uses 4, fills disk with a lot of log spam, as Declined.
Fri, Apr 13, 11:25 PM · Patch-For-Review, Beta-Cluster-Infrastructure
EddieGP closed T120165: Implement role based hiera lookups for labs, a subtask of T146627: Make deployment-prep puppetmaster more similar to Production puppetmaster, as Declined.
Fri, Apr 13, 11:25 PM · Operations, Puppet, Beta-Cluster-Infrastructure
EddieGP triaged T178404: Beta: acme-setup failing in beta deployment-cache-upload04 as Normal priority.
Fri, Apr 13, 11:17 PM · Beta-Cluster-Infrastructure
EddieGP triaged T191109: deployment-eventlog05 puppet errors as Normal priority.
Fri, Apr 13, 11:17 PM · Puppet, Beta-Cluster-Infrastructure
EddieGP triaged T191663: deployment-secureredirexperiment puppet error as Normal priority.
Fri, Apr 13, 11:16 PM · Puppet, Beta-Cluster-Infrastructure
EddieGP triaged T191553: labs-puppetmaster/Labs Puppetmaster HTTPS is UNKNOWN since [...] as Low priority.
Fri, Apr 13, 11:16 PM · cloud-services-team, Puppet, Beta-Cluster-Infrastructure
EddieGP triaged T182161: Deploy ThrottleOverride to beta cluster as Low priority.
Fri, Apr 13, 11:15 PM · Beta-Cluster-Infrastructure, MediaWiki-extensions-ThrottleOverride
EddieGP moved T166290: Provide a version of frwiki on Beta Cluster / staging from To Triage to Backlog on the Beta-Cluster-Infrastructure board.
Fri, Apr 13, 11:14 PM · Release-Engineering-Team (Next), Beta-Cluster-Infrastructure
EddieGP moved T189493: Domain 'sdwiki' is not recognized. from To Triage to Extensions & services config on the Beta-Cluster-Infrastructure board.
Fri, Apr 13, 11:14 PM · Wikidata, Beta-Cluster-Infrastructure
EddieGP added a comment to T189493: Domain 'sdwiki' is not recognized..

I poked WMDE about what I found this morning on IRC:

Fri, Apr 13, 11:13 PM · Wikidata, Beta-Cluster-Infrastructure
EddieGP added a comment to T166290: Provide a version of frwiki on Beta Cluster / staging.

Since T188288: fr.wikipedia.beta.wmflabs.org uses an invalid security certificate frwiki already is part of our unified letsencrypt cert. JFTR to whoever will tackle this task.

Fri, Apr 13, 11:10 PM · Release-Engineering-Team (Next), Beta-Cluster-Infrastructure
EddieGP closed T191294: Long-lived cherry-picks on deployment-puppetmaster02.deployment-prep.eqiad.wmflabs as Declined.

wontfix until T135427: Beta puppetmaster cherry-pick process. We did, do and will just ignore that check, or drop it if it's too annoying,

Fri, Apr 13, 11:04 PM · Puppet, Beta-Cluster-Infrastructure, Release-Engineering-Team
EddieGP triaged T192183: Horizon only saves user user settings in browser cookies as Low priority.
Fri, Apr 13, 11:01 PM · Upstream, Horizon
EddieGP created T192183: Horizon only saves user user settings in browser cookies.
Fri, Apr 13, 11:01 PM · Upstream, Horizon
EddieGP triaged T192182: Horizon instance list: Sorting should work regardless of paging as Low priority.
Fri, Apr 13, 10:48 PM · Upstream, Horizon
EddieGP created T192182: Horizon instance list: Sorting should work regardless of paging.
Fri, Apr 13, 10:48 PM · Upstream, Horizon
EddieGP created T192179: Horizon should not show 'Launch' button on 'Images' page for non-project admins.
Fri, Apr 13, 10:18 PM · Horizon
EddieGP merged T44785: Create an account throttle rules extension into T27000: Deploy ThrottleOverride extension to Wikimedia wikis.
Fri, Apr 13, 9:34 PM · Wikimedia-Hackathon-2018, Wikimedia-extension-review-queue, Possible-Tech-Projects, Wikimedia-Hackathon-2017, Wikimedia-Developer-Summit (2017), MediaWiki-extensions-ThrottleOverride, Wikimedia-Extension-setup
EddieGP merged task T44785: Create an account throttle rules extension into T27000: Deploy ThrottleOverride extension to Wikimedia wikis.
Fri, Apr 13, 9:34 PM · MediaWiki-extension-requests
EddieGP closed T168520: Could not find class role::etcd::common for deployment-conf03.deployment-prep.eqiad.wmflabs , a subtask of T168519: Beta cluster varnish fails VCL compilation because citoid.wmflabs.org does not resolve, as Resolved.
Fri, Apr 13, 6:41 PM · RelEng-Archive-FY201718-Q1, User-Ryasmeen, Services (watching), Citoid, VisualEditor, Beta-Cluster-Infrastructure
EddieGP closed T168520: Could not find class role::etcd::common for deployment-conf03.deployment-prep.eqiad.wmflabs as Resolved.
Fri, Apr 13, 6:41 PM · Beta-Cluster-Infrastructure
EddieGP added a comment to T190755: Request for access to the beta cluster.

Do you still have trouble logging into these instances or can this task be closed?

Fri, Apr 13, 8:02 AM · Release-Engineering-Team, Beta-Cluster-Infrastructure
EddieGP moved T192032: Enable `scap log` on deployment-* servers from To Triage to Backlog on the Beta-Cluster-Infrastructure board.
Fri, Apr 13, 8:01 AM · Beta-Cluster-Infrastructure, Scap
EddieGP added a comment to T192032: Enable `scap log` on deployment-* servers.

Yeah, we could do that, by setting up an instance (or just applying the relevant class to deployment-tin). But then we probably want to make the scap-scripts (those run every ten minutes) not trigger the usual "scap started" and "scap ended"/"scap aborted"/... messages. There's a full scap on beta every 10 minutes - we don't want an extra message in -releng every five minutes. If we can convince scap to not log stuff for the auto update, no objections.

Fri, Apr 13, 8:01 AM · Beta-Cluster-Infrastructure, Scap
EddieGP added a parent task for T59788: Schedule initSiteStats.php maintenance script regularly: T192139: Remove monthly run of updateArticleCount.php.
Fri, Apr 13, 7:17 AM · Patch-For-Review, Wikimedia-maintenance-script-run, Wikimedia-Site-requests
EddieGP added a subtask for T192139: Remove monthly run of updateArticleCount.php: T59788: Schedule initSiteStats.php maintenance script regularly.
Fri, Apr 13, 7:17 AM · Operations, Patch-For-Review, Wikimedia-maintenance-script-run
EddieGP created T192139: Remove monthly run of updateArticleCount.php.
Fri, Apr 13, 7:17 AM · Operations, Patch-For-Review, Wikimedia-maintenance-script-run
EddieGP added a comment to T188913: "Obama" page on Beta Cluster often responds with 503.

Well the deployment-mediawiki-07 backend was the cause of 503s today. I changed the appserver backend in hiera to deployment-mediawiki05

Fri, Apr 13, 7:01 AM · Operations, Beta-Cluster-Infrastructure
EddieGP closed T59788: Schedule initSiteStats.php maintenance script regularly as Resolved.

I'm sorry, does this mean this is now "live"? So there will be a full recount on April 15th?

Yes, it'll start to run at 05:39 UTC on 1st and 15th of each month from now on. So the first run will be this Sunday.
If that first run fails for whatever reason, the cron will be reverted until problems can be fixed. However, if that would happen, you'd hear about it on this task.

Fri, Apr 13, 6:49 AM · Patch-For-Review, Wikimedia-maintenance-script-run, Wikimedia-Site-requests
EddieGP closed T59788: Schedule initSiteStats.php maintenance script regularly, a subtask of T42009: Special:Import increases NUMBEROFARTICLES for each Revision instead of each Article, as Resolved.
Fri, Apr 13, 6:49 AM · Patch-For-Review, MediaWiki-Export-or-Import

Thu, Apr 12

EddieGP added a comment to T188913: "Obama" page on Beta Cluster often responds with 503.

All of beta is currently down.

Thu, Apr 12, 5:12 PM · Operations, Beta-Cluster-Infrastructure
EddieGP closed T192063: API misbehaves on FlaggedRevs wikis after logging autopatrol actions was disabled as Invalid.
Thu, Apr 12, 11:39 AM · MediaWiki-extensions-FlaggedRevs, MediaWiki-Logging, MediaWiki-Patrolling, User-Ladsgroup
EddieGP added a comment to T192063: API misbehaves on FlaggedRevs wikis after logging autopatrol actions was disabled.

Indeed. We just checked the last log entry that worked for him and saw that the review action already behaved this way before and the autopatrol action was gone as expected. The API seems fine, the tool needs to be updated.

Thu, Apr 12, 11:39 AM · MediaWiki-extensions-FlaggedRevs, MediaWiki-Logging, MediaWiki-Patrolling, User-Ladsgroup
EddieGP added a comment to T184485: Stop logging autopatrol actions.

T192063: API misbehaves on FlaggedRevs wikis after logging autopatrol actions was disabled

Thu, Apr 12, 9:35 AM · MW-1.31-release-notes (WMF-deploy-2018-04-17 (1.31.0-wmf.30)), Wikidata-Ministry-Of-Magic-Tech-Debt, Wikidata-Ministry-Of-Magic, User-notice, TechCom-RFC (TechCom-Approved), User-ArielGlenn, MediaWiki-Patrolling, Patch-For-Review, MediaWiki-Logging
EddieGP created T192063: API misbehaves on FlaggedRevs wikis after logging autopatrol actions was disabled.
Thu, Apr 12, 9:34 AM · MediaWiki-extensions-FlaggedRevs, MediaWiki-Logging, MediaWiki-Patrolling, User-Ladsgroup
jcrespo awarded T190780: Schema changes to site_stats a Pterodactyl token.
Thu, Apr 12, 7:35 AM · Patch-For-Review, Blocked-on-schema-change, DBA

Wed, Apr 11

EddieGP added a comment to T190780: Schema changes to site_stats.

Alright, ignore me then. :-)

Wed, Apr 11, 11:28 AM · Patch-For-Review, Blocked-on-schema-change, DBA
EddieGP added a comment to T190780: Schema changes to site_stats.

The only concern about doing it directly on the master could be the fact that this table is being updated almost every second.

Wed, Apr 11, 11:11 AM · Patch-For-Review, Blocked-on-schema-change, DBA
EddieGP renamed T191945: wikimediafoundation.org doesn't have a responsive design from wikimediafoundation.org is totally unusable on mobile to wikimediafoundation.org doesn't have a responsive design.
Wed, Apr 11, 10:56 AM · Reading-Web-Local-Wiki-Issues, Wikimedia-General-or-Unknown, Mobile
EddieGP created T191945: wikimediafoundation.org doesn't have a responsive design.
Wed, Apr 11, 1:00 AM · Reading-Web-Local-Wiki-Issues, Wikimedia-General-or-Unknown, Mobile

Tue, Apr 10

EddieGP moved T190755: Request for access to the beta cluster from To Triage to Backlog on the Beta-Cluster-Infrastructure board.
Tue, Apr 10, 9:08 PM · Release-Engineering-Team, Beta-Cluster-Infrastructure
EddieGP closed T188288: fr.wikipedia.beta.wmflabs.org uses an invalid security certificate as Resolved.

The puppet errors are fixed and fr.wikipedia.beta.wmflabs.org seems to now be part of the unified cert. Thus I'm closing this as resolved.

Tue, Apr 10, 5:55 PM · Release-Engineering-Team (Kanban), User-greg, Patch-For-Review, Beta-Cluster-Infrastructure
EddieGP renamed T182927: Get letsencrypt wildcard cert for *.beta.wmflabs.org domains from various .beta.wmflabs.org domains use an invalid ssl certificate to Get letsencrypt wildcard cert for *.beta.wmflabs.org domains.
Tue, Apr 10, 5:51 PM · Patch-For-Review, Beta-Cluster-Infrastructure
EddieGP added a comment to T182549: Email sometimes not being sent when a task is created and "other task activity" is not set in user preferences.

That's why I didn't mark the task resolved. But I guess we now have an idea of where this comes from and what to report to upstream: "Please move task creation notifications out of 'Other Notification'". Unfortunately I don't seem to be able to create a task on secure.phabricator.com any more.

Tue, Apr 10, 9:11 AM · Phabricator
EddieGP closed T184501: What to do with deployment-sca03? as Resolved.

That instance no longer exists. I think this is resolved.

Tue, Apr 10, 8:56 AM · Release-Engineering-Team (Watching / External), Patch-For-Review, Recommendation-API, Beta-Cluster-Infrastructure, Scoring-platform-team (Current)
EddieGP added a comment to T187063: Remove video scaler instances from deployment-prep.

According to openstack browser, both instances are gone. Is this resolved?

Tue, Apr 10, 8:53 AM · Patch-For-Review, Operations, Beta-Cluster-Infrastructure
EddieGP merged T187826: Create mediawiki::maintenance server (aka terbium) in deployment-prep into T125976: Run mediawiki::maintenance scripts in Beta Cluster.
Tue, Apr 10, 8:52 AM · User-Addshore, Beta-Cluster-Infrastructure
EddieGP merged task T187826: Create mediawiki::maintenance server (aka terbium) in deployment-prep into T125976: Run mediawiki::maintenance scripts in Beta Cluster.
Tue, Apr 10, 8:52 AM · Beta-Cluster-Infrastructure
EddieGP added a comment to T190780: Schema changes to site_stats.

Just for the record, this table has less than 5 rows in all the wikis.

Tue, Apr 10, 8:24 AM · Patch-For-Review, Blocked-on-schema-change, DBA

Mon, Apr 9

EddieGP added a comment to T168520: Could not find class role::etcd::common for deployment-conf03.deployment-prep.eqiad.wmflabs .

Puppet run on this instance succeeds. Can this be closed now?

Mon, Apr 9, 11:52 PM · Beta-Cluster-Infrastructure
EddieGP closed T191154: Error: Could not find class role::kafka::jumbo::mirror for deployment-kafka0[45] as Resolved.

Puppet is fine on both hosts now. so this seems resolved. Thanks @Ottomata!

Mon, Apr 9, 11:50 PM · Puppet, Beta-Cluster-Infrastructure
EddieGP moved T188873: Requesting Pending Changes Reviewer on enwiki beta from To Triage to On wiki change on the Beta-Cluster-Infrastructure board.
Mon, Apr 9, 11:43 PM · Beta-Cluster-Infrastructure
EddieGP moved T188874: Suggestion: Give stewards userrights-interwiki on deploymentwiki and remove the global userrights, userrights-interwiki from To Triage to Extensions & services config on the Beta-Cluster-Infrastructure board.
Mon, Apr 9, 11:42 PM · Beta-Cluster-Infrastructure
EddieGP closed T117028: deployment-fluorine puppet failure due to '/usr/sbin/usermod -u 10003 datasets' returned 4: usermod: UID '10003' already exists as Resolved.

deployment-fluorine no longer exists and deployment-fluorine02 doesn't have puppet broken. Seems resolved to me.

Mon, Apr 9, 11:39 PM · Beta-Cluster-Infrastructure
EddieGP closed T117028: deployment-fluorine puppet failure due to '/usr/sbin/usermod -u 10003 datasets' returned 4: usermod: UID '10003' already exists, a subtask of T132259: Deployment-prep hosts with puppet errors (tracking), as Resolved.
Mon, Apr 9, 11:39 PM · Puppet, Tracking, Beta-Cluster-Infrastructure
EddieGP closed T184234: Puppet broken on deployment-cache-text04 due to varnishkafka issues as Resolved.

Seems fixed.

Mon, Apr 9, 11:36 PM · Puppet, Beta-Cluster-Infrastructure
EddieGP closed T184234: Puppet broken on deployment-cache-text04 due to varnishkafka issues, a subtask of T132259: Deployment-prep hosts with puppet errors (tracking), as Resolved.
Mon, Apr 9, 11:36 PM · Puppet, Tracking, Beta-Cluster-Infrastructure
EddieGP added a comment to T182549: Email sometimes not being sent when a task is created and "other task activity" is not set in user preferences.

I've not received a mail for the creation of T191701, found this task and made a few tests in a local phabricator instance:

Mon, Apr 9, 11:24 PM · Phabricator
EddieGP closed T191786: deployment-mira: puppet broken 2018-04-09 as Resolved.

Fixed by changing hiera, should recover with the next puppet run.

Mon, Apr 9, 11:43 AM · Puppet, Beta-Cluster-Infrastructure
EddieGP triaged T191786: deployment-mira: puppet broken 2018-04-09 as Unbreak Now! priority.

Puppet broken on all the appservers, jobrunners and deployment servers in beta.

Mon, Apr 9, 11:37 AM · Puppet, Beta-Cluster-Infrastructure
mmodell awarded T191182: Consider disabling differential a Dislike token.
Mon, Apr 9, 8:20 AM · Release-Engineering-Team (Someday), Phabricator, Gerrit
Samwilson awarded T191182: Consider disabling differential a Like token.
Mon, Apr 9, 4:29 AM · Release-Engineering-Team (Someday), Phabricator, Gerrit

Sun, Apr 8

EddieGP moved T173887: Wikimedia.org portal broken in Beta Cluster (Domain unavailable) from To Triage to Backlog on the Beta-Cluster-Infrastructure board.
Sun, Apr 8, 1:12 PM · Patch-For-Review, Beta-Cluster-Infrastructure, Discovery-Portal-Sprint, Performance-Team (Radar), Wikimedia-Portals, Discovery
EddieGP updated the task description for T191708: Disable Two-factor authentication for user Barek on en.wiki.
Sun, Apr 8, 12:40 PM · Support-and-Safety, Wikimedia-Site-requests