Page MenuHomePhabricator

Create an-tool1005 (Staging environment for Superset)
Closed, ResolvedPublic5 Estimated Story Points

Description

The VM needs to be a clone of analytics-tool1004, since it will be the staging environment to test deploys for various analytics UIs before hitting production.

Event Timeline

elukey triaged this task as Medium priority.

Change 494676 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/dns@master] Allocate AAAA/A/PTR records for an-tool1005

https://gerrit.wikimedia.org/r/494676

Change 494676 merged by Elukey:
[operations/dns@master] Allocate AAAA/A/PTR records for an-tool1005

https://gerrit.wikimedia.org/r/494676

If you need a private IP, do you need it to be inside the Analytics VLAN? (y/n)
y

Please enter the correct row. (A, B or C - gnt-group list to show)
C

How many vCPUs do you need?
4

How much RAM do you need? (Gigabytes)
6

What disk size do you need? (Gigabytes)
20

How do you want to call the instance? (FQDN)
an-tool1005.eqiad.wmnet

Based on your answers this is the full command to create the VM:

sudo gnt-instance add -t drbd -I hail --net 0:link=analytics --hypervisor-parameters=kvm:boot_order=network -o debootstrap+default --no-install -g row_C -B vcpus=4,memory=6g --disk 0:size=20g an-tool1005.eqiad.wmnet

Do you want to run it now? (y/n) y
Ok, running.
y

Please enter the correct row. (A, B or C - gnt-group list to show)
C

How many vCPUs do you need?
4

How much RAM do you need? (Gigabytes)
6

What disk size do you need? (Gigabytes)
20

How do you want to call the instance? (FQDN)
an-tool1005.eqiad.wmnet

Based on your answers this is the full command to create the VM:

sudo gnt-instance add -t drbd -I hail --net 0:link=analytics --hypervisor-parameters=kvm:boot_order=network -o debootstrap+default --no-install -g row_C -B vcpus=4,memory=6g --disk 0:size=20g an-tool1005.eqiad.wmnet

Do you want to run it now? (y/n) y
Ok, running.

Wed Mar  6 09:47:35 2019  - INFO: No-installation mode selected, disabling startup
Wed Mar  6 09:47:40 2019  - INFO: Selected nodes for instance an-tool1005.eqiad.wmnet via iallocator hail: ganeti1003.eqiad.wmnet, ganeti1001.eqiad.wmnet
Wed Mar  6 09:47:41 2019 * creating instance disks...
Wed Mar  6 09:47:45 2019 adding instance an-tool1005.eqiad.wmnet to cluster config
Wed Mar  6 09:47:45 2019 adding disks to cluster config
Wed Mar  6 09:47:45 2019  - INFO: Waiting for instance an-tool1005.eqiad.wmnet to sync disks
Wed Mar  6 09:47:45 2019  - INFO: - device disk/0:  0.10% done, 41m 35s remaining (estimated)
Wed Mar  6 09:48:46 2019  - INFO: - device disk/0: 10.90% done, 8m 14s remaining (estimated)
Wed Mar  6 09:49:46 2019  - INFO: - device disk/0: 21.60% done, 7m 0s remaining (estimated)
Wed Mar  6 09:50:46 2019  - INFO: - device disk/0: 32.40% done, 6m 8s remaining (estimated)
Wed Mar  6 09:51:46 2019  - INFO: - device disk/0: 43.10% done, 5m 13s remaining (estimated)
Wed Mar  6 09:52:46 2019  - INFO: - device disk/0: 53.90% done, 4m 5s remaining (estimated)
Wed Mar  6 09:53:47 2019  - INFO: - device disk/0: 64.70% done, 3m 11s remaining (estimated)
Wed Mar  6 09:54:47 2019  - INFO: - device disk/0: 75.40% done, 2m 15s remaining (estimated)
Wed Mar  6 09:55:47 2019  - INFO: - device disk/0: 86.20% done, 1m 16s remaining (estimated)
Wed Mar  6 09:56:47 2019  - INFO: - device disk/0: 97.00% done, 16s remaining (estimated)
Wed Mar  6 09:57:04 2019  - INFO: - device disk/0: 99.90% done, 0s remaining (estimated)
Wed Mar  6 09:57:04 2019  - INFO: - device disk/0: 99.90% done, 0s remaining (estimated)
Wed Mar  6 09:57:04 2019  - INFO: - device disk/0: 100.00% done, 0s remaining (estimated)
Wed Mar  6 09:57:04 2019  - INFO: - device disk/0: 100.00% done, 0s remaining (estimated)
Wed Mar  6 09:57:04 2019  - INFO: - device disk/0: 100.00% done, 0s remaining (estimated)
Wed Mar  6 09:57:04 2019  - INFO: - device disk/0: 100.00% done, 0s remaining (estimated)
Wed Mar  6 09:57:04 2019  - INFO: - device disk/0: 100.00% done, 0s remaining (estimated)
Wed Mar  6 09:57:05 2019  - INFO: Instance an-tool1005.eqiad.wmnet's disks are in sync
Wed Mar  6 09:57:05 2019  - INFO: Waiting for instance an-tool1005.eqiad.wmnet to sync disks
Wed Mar  6 09:57:05 2019  - INFO: Instance an-tool1005.eqiad.wmnet's disks are in sync

Time to add the new instance to DHCP.
Here's the MAC address:

NicMAC/0
aa:00:00:ae:a1:8c

Change 494680 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] Add an-tool1005 to site.pp/DHCP/partman configs

https://gerrit.wikimedia.org/r/494680

Change 494680 merged by Elukey:
[operations/puppet@production] Add an-tool1005 to site.pp/DHCP/partman configs

https://gerrit.wikimedia.org/r/494680

To keep archives happy: @MoritzMuehlenhoff is currently testing the Buster debian installer for Ganeti VMs, so please do not install anything on this VM yet.

@MoritzMuehlenhoff I am ready to make this host a proper staging environment for superset, let me know if we can proceed or not :)

@MoritzMuehlenhoff I am ready to make this host a proper staging environment for superset, let me know if we can proceed or not :)

I've earlier merged a patch which fixes Buster installations to run un-interrupted and confirmed with a reimage of graphite2001 that it's working fine, so feel free to simply install an-tool1005 now. If there should be any issues (maybe related to the an-tool partman recipe), let me know.

Change 511696 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] Introduce role::analytics_cluster::superset::staging

https://gerrit.wikimedia.org/r/511696

Change 511696 merged by Elukey:
[operations/puppet@production] Introduce role::analytics_cluster::superset::staging

https://gerrit.wikimedia.org/r/511696

Debian GNU/Linux 10 (buster)
an-tool1005 is a Superset web GUI for analytics dashboards (staging environment) (analytics_cluster::superset::staging)

elukey set the point value for this task to 5.May 21 2019, 1:50 PM
elukey moved this task from Next Up to Done on the Analytics-Kanban board.