In T198685 we are ordering a replacement for analytics1003, the host that currently runs role::analytics_cluster::coordinator. Since we haven't tested its packages on Stretch, it is wise to do so in labs before doing the replacement in Production.
Description
Description
Details
Details
Customize query in gerrit
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | elukey | T204060 Test role::analytics_cluster::coordinator on Debian Stretch | |||
| Resolved | elukey | T204074 mariadb::service and managed services don't play well on Stretch |
Event Timeline
Comment Actions
Change 459795 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] profile::analytics::refinery::job::camus: ease labs testing
Comment Actions
Change 459795 merged by Elukey:
[operations/puppet@production] profile::analytics::refinery::job::camus: ease labs testing
Comment Actions
Created a subtask to track the current issue with (managed) Mariadb on Stretch, waiting for its completion before re-testing.
Comment Actions
The mariadb issues seems resolved, but now we have this:
elukey@hadoop-coordinator-2:~$ sudo puppet agent -tv Info: Using configured environment 'production' Info: Retrieving pluginfacts Info: Retrieving plugin Info: Loading facts Error: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, has_key(): expects the first argument to be a hash, got "" which is of type String at /etc/puppet/modules/mediawiki/functions/state.pp:11:12 on node hadoop-coordinator-2.analytics.eqiad.wmflabs Warning: Not using cache on failed catalog Error: Could not retrieve catalog; skipping run
This has been introduced recently due to usage of mediawiki::state('primary_dc') in camus.pp
Comment Actions
Change 460365 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] profile::analytics::refinery::job::camus: add parameter to enable monitors
Comment Actions
Change 460365 merged by Elukey:
[operations/puppet@production] profile::analytics::refinery::job::camus: add parameter to enable monitors
Comment Actions
Change 460380 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] profile::analytics::database::meta: upgrade mariadb version for labs
Comment Actions
Change 460380 merged by Elukey:
[operations/puppet@production] profile::analytics::database::meta: upgrade mariadb version for labs
Comment Actions
Change 460387 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] profile::analytics::database::meta: update mariadb's basedir for stretch
Comment Actions
Change 460387 merged by Elukey:
[operations/puppet@production] profile::analytics::database::meta: update mariadb's basedir for stretch
Comment Actions
Change 460399 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] profile::analytics::database::meta: use the same prod config in labs
Comment Actions
Change 460399 merged by Elukey:
[operations/puppet@production] profile::analytics::database::meta: use the same prod config in labs