Page MenuHomePhabricator

Upgrade the rest of the Hadoop test cluster to Buster
Closed, ResolvedPublic

Description

There are still some nodes missing:

  • an-test-worker1001
  • an-test-master*
  • an-test-coord1001

We should create recipes to keep data as it is (except for root).

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts:

['an-test-worker1001.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202104011351_elukey_6893.log.

The workers don't have their journalnodes dir in a partition (my bad) so I'll will try to add it asap, and I'll update the reuse recipes.

Then an-test-coord1001 will be next, I want to figure out what happens when mariadb is upgraded but the /srv partition data is kept (since it will inform us about what will happend for an-coord100[1,x])

Completed auto-reimage of hosts:

['an-test-worker1001.eqiad.wmnet']

and were ALL successful.

Change 676382 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] Add a more meaningful base dir for Hadoop in test

https://gerrit.wikimedia.org/r/676382

Change 676382 merged by Elukey:

[operations/puppet@production] Add a more meaningful base dir for Hadoop in test

https://gerrit.wikimedia.org/r/676382

Change 676560 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] install_server: add custom recipes for hadoop test masters/coord

https://gerrit.wikimedia.org/r/676560

Change 676560 merged by Elukey:

[operations/puppet@production] install_server: add custom recipes for hadoop test masters/coord

https://gerrit.wikimedia.org/r/676560

Change 676561 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] install_server: set buster for an-test-(master|coord) nodes

https://gerrit.wikimedia.org/r/676561

Change 676561 merged by Elukey:

[operations/puppet@production] install_server: set buster for an-test-(master|coord) nodes

https://gerrit.wikimedia.org/r/676561

Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts:

['an-test-master1002.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202104021028_elukey_25708.log.

Change 676562 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] install_server: fix partman recipe for an-test-master/coord

https://gerrit.wikimedia.org/r/676562

Change 676562 merged by Elukey:

[operations/puppet@production] install_server: fix partman recipe for an-test-master/coord

https://gerrit.wikimedia.org/r/676562

Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts:

['an-test-master1002.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202104021037_elukey_28584.log.

Completed auto-reimage of hosts:

['an-test-master1002.eqiad.wmnet']

and were ALL successful.

Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts:

['an-test-master1001.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202104021258_elukey_20209.log.

Completed auto-reimage of hosts:

['an-test-master1001.eqiad.wmnet']

and were ALL successful.

Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts:

['an-test-coord1001.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202104021414_elukey_3694.log.

Change 676592 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] profile::oozie::server: use default-mysql-client

https://gerrit.wikimedia.org/r/676592

Change 676592 merged by Elukey:

[operations/puppet@production] profile::oozie::server: use default-mysql-client

https://gerrit.wikimedia.org/r/676592

Completed auto-reimage of hosts:

['an-test-coord1001.eqiad.wmnet']

and were ALL successful.

Change 676598 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] Use mariadb instead of mysql for Hive and Oozie settings

https://gerrit.wikimedia.org/r/676598

Change 676598 merged by Elukey:

[operations/puppet@production] Use mariadb instead of mysql for Hive and Oozie settings

https://gerrit.wikimedia.org/r/676598

Change 676609 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] Fix the mariadb jdbc driver name for Hive and Oozie on Buster

https://gerrit.wikimedia.org/r/676609

Change 676609 merged by Elukey:

[operations/puppet@production] Fix the mariadb jdbc driver name for Hive and Oozie on Buster

https://gerrit.wikimedia.org/r/676609

All the hadoop test cluster nodes should be on Buster now, leaving this open for a couple of days to see if any issue comes up.

Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts:

['an-coord1002.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202104060936_elukey_28081.log.

Completed auto-reimage of hosts:

['an-coord1002.eqiad.wmnet']

and were ALL successful.