Andrew (Andrew Bogott)
User

Projects (11)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Nov 2 2014, 11:35 PM (189 w, 5 d)
Availability
Available
IRC Nick
andrewbogott
LDAP User
Unknown
MediaWiki User
Andrewbogott

Recent Activity

Yesterday

Andrew added a comment to T197930: Build or backport .deb for kubernetes python client for Jessie and Trusty.

https://github.com/kubernetes-client/python

Fri, Jun 22, 8:45 AM · Toolforge, Kubernetes
Andrew triaged T197930: Build or backport .deb for kubernetes python client for Jessie and Trusty as Normal priority.
Fri, Jun 22, 8:45 AM · Toolforge, Kubernetes

Sun, Jun 17

Andrew created T197554: Update wikitech-static mediawiki version.
Sun, Jun 17, 8:25 PM · Operations

Fri, Jun 15

Andrew closed T183826: "Error 503 Backend fetch failed" on wikistream.wmflabs.org as Resolved.

http://wikistream.wmflabs.org/ seems up, for the moment at least.

Fri, Jun 15, 7:03 PM · VPS-Projects

Wed, Jun 13

Andrew triaged T197162: real-time service concerns with neutron migration as Normal priority.
Wed, Jun 13, 5:27 PM · Epic, Cloud-Services
Andrew added a comment to T191791: Make same glance images available to multiple regions.

I just changed the glance endpoints on labtestn so that they're the same as for labtest:

Wed, Jun 13, 2:16 PM · Patch-For-Review, cloud-services-team (Kanban), Cloud-Services

Tue, Jun 12

Andrew triaged T172344: Can't create or manage domains in the PAWS project as Low priority.
Tue, Jun 12, 4:43 PM · cloud-services-team (Kanban), Cloud-Services

Mon, Jun 11

Andrew added a comment to T196659: cloud vps: disable system-wide apt pinning for OpenStack jessie hosts.

@aborrero, thanks for investigating. I'm sure that that the existing client_pinning file isn't complete, and that making it complete for use on all our servers will be very messy :/

Mon, Jun 11, 6:19 PM · Patch-For-Review, cloud-services-team, Operations
Andrew added a comment to T188377: Import some Analytics git puppet submodules to operations/puppet.

I don't mind having to manually fix some puppetmasters, although it would be nice to do them all at once :) I'll try cherry-picking a few of these changes and see if I can get a sense of what's likely to break.

Mon, Jun 11, 6:19 PM · Analytics-Kanban, Patch-For-Review, User-Elukey, Operations, Analytics
Andrew placed T138672: Having difficulty logging into Phabricator via LDAP when multiple accounts returned for username (gerrit: Duplicate users: smccandlish) up for grabs.

This is looking like it's outside my area of influence so I'm unassigning myself.

Mon, Jun 11, 2:01 PM · Gerrit, LDAP, Phabricator
Andrew added a comment to T196659: cloud vps: disable system-wide apt pinning for OpenStack jessie hosts.

@aborrero doesn't pinning work if we pin the keystone package and all dependencies? Like in openstack::jessie_mitaka_client_pinning ?

Mon, Jun 11, 1:59 PM · Patch-For-Review, cloud-services-team, Operations
Gerrit Code Review <gerrit@wikimedia.org> committed rODIT6cba54cb6168: Update patch set 8 (authored by Andrew).
Update patch set 8
Mon, Jun 11, 11:35 AM
Gerrit Code Review <gerrit@wikimedia.org> committed rODIT160fd9e60412: Update patch set 1 (authored by Andrew).
Update patch set 1
Mon, Jun 11, 11:35 AM

Fri, Jun 8

Andrew added a comment to T182893: Get role::puppetmaster::standalone working on Stretch.

The remaining issue is a stray process that gets created but not cleaned up by the puppetization process:

Fri, Jun 8, 5:56 PM · cloud-services-team
Andrew added a comment to T182893: Get role::puppetmaster::standalone working on Stretch.

Hm, I rebooted the master and now everything works. So I think we're basically good, minus one apparent race condition.

Fri, Jun 8, 5:33 PM · cloud-services-team
Andrew added a comment to T182893: Get role::puppetmaster::standalone working on Stretch.

It definitely doesn't work easily -- I'm getting puppet failures right out of the gate. So, please don't close yet.

Fri, Jun 8, 5:26 PM · cloud-services-team
Andrew created T196751: labvirt1019 IPMI alert.
Fri, Jun 8, 3:36 PM · cloud-services-team, ops-eqiad, Operations, DC-Ops
Andrew added a comment to T196210: Strange default for IP Address field on floating IP association form.

I see this, and it's obviously wrong (unless that number is some internal ID that means something to the API, in which case it's just very user-unfriendly.)

Fri, Jun 8, 3:30 PM · Horizon
Andrew claimed T196209: "Associate Floating IP" button next to instance broken.

I just tried and it worked for me. Can you tell me what project/instance you're seeing this with?

Fri, Jun 8, 3:28 PM · cloud-services-team (Kanban), Horizon
Andrew closed T196199: Rebranding: Horizon title says 'Labs' as Resolved.
Fri, Jun 8, 3:21 PM · Patch-For-Review, Horizon
Andrew closed T196199: Rebranding: Horizon title says 'Labs', a subtask of T168480: Perform core Cloud Services rebranding, as Resolved.
Fri, Jun 8, 3:20 PM · Patch-For-Review, Goal, cloud-services-team (FY2017-18)
Andrew assigned T196668: Tool Labs CDNjs mirror not up-to-date to Bstorm.
Fri, Jun 8, 3:12 PM · Patch-For-Review, Toolforge
Andrew added a comment to T196537: Cloud VPS: X11 forwarding request failed on channel 0.

Can you tell me more about that -X? X11 isn't present on any of our servers by default, I don't think I've ever heard of anyone using it on a VPS before.

Fri, Jun 8, 2:02 PM · Cloud-VPS

Thu, Jun 7

Andrew triaged T196704: labstore1003 SMART failure (again) as High priority.
Thu, Jun 7, 10:14 PM · Operations, cloud-services-team, ops-eqiad, DC-Ops
Andrew added a comment to T196704: labstore1003 SMART failure (again).

(previously, https://phabricator.wikimedia.org/T193651 )

Thu, Jun 7, 10:14 PM · Operations, cloud-services-team, ops-eqiad, DC-Ops
Andrew created T196704: labstore1003 SMART failure (again).
Thu, Jun 7, 10:14 PM · Operations, cloud-services-team, ops-eqiad, DC-Ops
Andrew added a comment to T194998: Create custom deployment-prep role that allows editing of Designate records only.
andrew@labcontrol1001:~$ openstack role list
+----------------------------------+----------------+
| ID                               | Name           |
+----------------------------------+----------------+
| 1102f4ff63c3435793d0e4340bf4b04e | glanceadmin    |
| 2cd63d467f754404bf3746fe63ee0698 | admin          |
| 47a8370618ea42d49f7047774e75d262 | observer       |
| 4d8cad783d6342efa8414d7d36fbc034 | projectadmin   |
| 906f1588626d4d0993629ea3928b6fb4 | designateadmin |
| 9fe2ff9ee4384b1894a90878d3e92bab | _member_       |
| f473273fac7146b3bdbf22e5d4504f95 | user           |
+----------------------------------+----------------+
andrew@labcontrol1001:~$ openstack role assignment list | grep deployment-prep-dns-manager
| 47a8370618ea42d49f7047774e75d262 | deployment-prep-dns-manager              |       | deployment-prep                  |        | False     |
| 906f1588626d4d0993629ea3928b6fb4 | deployment-prep-dns-manager              |       | deployment-prep                  |        | False     |
Thu, Jun 7, 7:32 PM · Patch-For-Review, Operations, Cloud-VPS
Andrew added a comment to T194998: Create custom deployment-prep role that allows editing of Designate records only.

I've issued deployment-prep-dns-manager the designateadmin role on deployment-prep.

Thu, Jun 7, 7:13 PM · Patch-For-Review, Operations, Cloud-VPS
Andrew added a comment to T194998: Create custom deployment-prep role that allows editing of Designate records only.

I'm going to create a new role, 'designatemanager' and attach a patch here granting some DNS privs to that role. Then I think we should create a new user and give it 'observer' and 'designatemanager' on deployment-prep.

Thu, Jun 7, 5:39 PM · Patch-For-Review, Operations, Cloud-VPS

Wed, Jun 6

Andrew added a comment to T138672: Having difficulty logging into Phabricator via LDAP when multiple accounts returned for username (gerrit: Duplicate users: smccandlish).

I doubt that there's any interaction between the two accounts (mech vs. smccandlish) and there's definitely no interaction between the wikitech account and the SUL account.

Wed, Jun 6, 2:23 AM · Gerrit, LDAP, Phabricator

Tue, Jun 5

Andrew closed T196028: Up quota for shinken project as Resolved.

Done. Thank you for giving attention to this project!

Tue, Jun 5, 4:11 PM · Cloud-VPS (Quota-requests), Shinken
Andrew closed T196028: Up quota for shinken project, a subtask of T196027: Upgrade Shinken to Stretch, as Resolved.
Tue, Jun 5, 4:11 PM · Cloud-VPS, Shinken
Andrew created T196466: Review (and remove?) use of 'shell user' right on wikitech.
Tue, Jun 5, 1:44 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager

Mon, Jun 4

Andrew closed T196086: Request deletion of scrumbugz VPS project as Resolved.

done

Mon, Jun 4, 8:58 PM · cloud-services-team (Kanban), Cloud-VPS (Project-requests)
Andrew closed T192179: Horizon should not show 'Launch' button on 'Images' page for non-project admins as Resolved.
Mon, Jun 4, 8:51 PM · Patch-For-Review, Horizon
Andrew added a comment to T196252: Labservices1001 crashed.

Can this wait a few days?

Mon, Jun 4, 7:53 PM · ops-eqiad, cloud-services-team, Operations
Andrew added a comment to T196252: Labservices1001 crashed.

Sorry, @Cmjohnson, to be clear I was asking if you've already replaced the paste on this server, not saying that I think you have.

Mon, Jun 4, 5:55 PM · ops-eqiad, cloud-services-team, Operations
Andrew added a comment to T196252: Labservices1001 crashed.

In the past I've reapplied thermal paste. Let me know if you would like to schedule a time to do that.

Mon, Jun 4, 3:37 PM · ops-eqiad, cloud-services-team, Operations

Sun, Jun 3

Andrew created T196252: Labservices1001 crashed.
Sun, Jun 3, 2:26 AM · ops-eqiad, cloud-services-team, Operations

Fri, Jun 1

Andrew created T196200: Provide a way for OpenStack admins to manage projects they don't belong to.
Fri, Jun 1, 10:55 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew added a comment to T196171: Developer account creation without OpenStackManager.

... I suppose another option is to leave OpenStackManager in place but unused apart for user creation, until we make wikitech SUL and move all developer account creation to Striker.

Fri, Jun 1, 4:17 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew created T196171: Developer account creation without OpenStackManager.
Fri, Jun 1, 3:46 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew closed T194794: Add new users to Bastion group whenever they join a project as Resolved.
Fri, Jun 1, 3:36 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew closed T194794: Add new users to Bastion group whenever they join a project, a subtask of T161553: Remove OpenStackManager from Wikitech, as Resolved.
Fri, Jun 1, 3:36 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew added a comment to T161553: Remove OpenStackManager from Wikitech.

@bd808, does striker not already do all the necessary things to create an account? Or is that accomplished via a wikitech hook?

Fri, Jun 1, 3:29 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew added a comment to T161553: Remove OpenStackManager from Wikitech.

I've removed all of Wikitech's sidebar links to OSM. If we avoid protest and surprise for a few weeks I'll rip out the code.

Fri, Jun 1, 3:18 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager

Wed, May 30

Andrew closed T195552: Puppet broken on shinken-01.shinken.eqiad.wmflabs as Resolved.

Looks fixed to me

Wed, May 30, 9:23 PM · Patch-For-Review, cloud-services-team
Andrew closed T195798: Request deletion of librarybase VPS project as Resolved.

Deleted!

Wed, May 30, 8:07 PM · cloud-services-team (Kanban), Cloud-VPS (Project-requests)
Andrew closed T195059: Cannot add or update records under DNS zones in Horizon as Resolved.

@Krenair confirms that this is now fixed

Wed, May 30, 8:02 PM · Patch-For-Review, Operations, Cloud-VPS

Fri, May 25

Andrew created T195553: Puppet class systemd needs to throw a more useful error.
Fri, May 25, 1:39 AM · Operations, Puppet, cloud-services-team
Andrew added a project to T195552: Puppet broken on shinken-01.shinken.eqiad.wmflabs: cloud-services-team.
Fri, May 25, 1:37 AM · Patch-For-Review, cloud-services-team
Andrew created T195552: Puppet broken on shinken-01.shinken.eqiad.wmflabs.
Fri, May 25, 1:37 AM · Patch-For-Review, cloud-services-team

May 17 2018

Andrew closed T193579: Update and move labnet1001/1002 as Resolved.

Looks good! Thanks @Cmjohnson

May 17 2018, 3:56 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew closed T193579: Update and move labnet1001/1002, a subtask of T193196: labnet1003 and labnet1004 moving and enabling 10G NICs, as Resolved.
May 17 2018, 3:56 PM · Cloud-VPS, ops-eqiad, Operations
Andrew added a comment to T192179: Horizon should not show 'Launch' button on 'Images' page for non-project admins.

Thanks @EddieGP . Logged as upstream bug here: https://bugs.launchpad.net/horizon/+bug/1771851

May 17 2018, 3:48 PM · Patch-For-Review, Horizon

May 16 2018

Andrew created T194841: Degraded raid in labnet1002.
May 16 2018, 5:30 PM · cloud-services-team, DC-Ops, Operations, ops-eqiad
Andrew added a comment to T193579: Update and move labnet1001/1002.

@Cmjohnson, all set for you to move labnet1002 now.

May 16 2018, 4:05 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew updated the task description for T193579: Update and move labnet1001/1002.
May 16 2018, 4:05 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations

May 15 2018

Andrew renamed T194794: Add new users to Bastion group whenever they join a project from Add new users to astion group whenever they join a project to Add new users to Bastion group whenever they join a project.
May 15 2018, 8:06 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew created T194794: Add new users to Bastion group whenever they join a project.
May 15 2018, 8:05 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew closed T193715: Request creation of iiifls1 VPS project as Resolved.

@Manducus, the project now exists. You can add other users and projectadmins as you see fit.

May 15 2018, 7:12 PM · Cloud-VPS (Project-requests)
Andrew added a comment to T193715: Request creation of iiifls1 VPS project.

@Manducus, I can't find your wikitech/developer account -- do you have a developer account? If so, what is your user name?

May 15 2018, 6:35 PM · Cloud-VPS (Project-requests)
Andrew added a comment to T193196: labnet1003 and labnet1004 moving and enabling 10G NICs.

@Cmjohnson Just to clarify, labnet1003 and 1004 aren't in active service so you can move them anytime; just check in with @chasemp after they're moved to make sure he's happy.

May 15 2018, 5:22 PM · Cloud-VPS, ops-eqiad, Operations
Andrew added a comment to T193715: Request creation of iiifls1 VPS project.

We're approving this request (with standard quotas) for you to test and set up a prototype. Keep in mind that any full-scale implementation (e.g. all images on Commons or something like that) will require quite a bit more discussion regarding bandwidth and distributed object stores and other complications :)

May 15 2018, 4:08 PM · Cloud-VPS (Project-requests)
Andrew claimed T193715: Request creation of iiifls1 VPS project.
May 15 2018, 4:05 PM · Cloud-VPS (Project-requests)
Andrew closed T194717: tools-exec-1414 unresponsive as Resolved.

This is mysterious, but resolved for now.

May 15 2018, 4:37 AM · cloud-services-team, Toolforge
Andrew added a comment to T194717: tools-exec-1414 unresponsive.

I rebooted it and repooled it. There's nothing useful in the syslog, just a long silence:

May 15 2018, 4:36 AM · cloud-services-team, Toolforge

May 14 2018

Andrew added a comment to T185430: Remove wikidataconcepts project once migrated to wmde-dashboards.

I'm just checking in -- can this VM be deleted yet?

May 14 2018, 8:23 PM · Cloud-VPS (Project-requests)
Andrew closed T181679: Clean up the 'massmessage' Cloud VPS project after Outreachy round 15 is over as Resolved.

deleted!

May 14 2018, 8:21 PM · Cloud-VPS (Project-requests), Outreachy (Round-15), MassMessage
Andrew closed T181679: Clean up the 'massmessage' Cloud VPS project after Outreachy round 15 is over, a subtask of T178431: MassMessage technical debt cleanup/refactoring, as Resolved.
May 14 2018, 8:21 PM · Africa-Wikimedia-Developers, Technical-Debt, MW-1.31-release-notes (WMF-deploy-2018-01-16 (1.31.0-wmf.17)), Patch-For-Review, Outreachy (Round-15), MassMessage
Andrew added a comment to T193579: Update and move labnet1001/1002.

OK. In theory we can move it after the outage window tomorrow, since we're planning to switch all traffic back to labnet1001 after it gets re-racked. The only risk I can think of is if labnet1001 doesn't survive the move and we have to rely on 1002 long-term.

May 14 2018, 3:11 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations

May 12 2018

Andrew added a comment to T158244: Improve `webservice status` output.

@Nehajha Something like that would be just fine. I might suggest that you keep the output limited to one line so it's a bit easier for automatic jobs to parse or grep. Maybe just 'Your webservice of type xxx is running.'

May 12 2018, 5:39 PM · Toolforge

May 11 2018

Andrew updated the task description for T161553: Remove OpenStackManager from Wikitech.
May 11 2018, 10:09 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew updated the task description for T161553: Remove OpenStackManager from Wikitech.
May 11 2018, 10:08 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew updated subscribers of T194012: labsdb1004 and labsdb1005 some hard disks not healthy.

@fgiunchedi Can you comment on what this alert might mean?

May 11 2018, 4:41 PM · Cloud-Services
Andrew closed T194191: Allow projectadmins to change project roles in Horizon as Resolved.
May 11 2018, 4:35 PM · Patch-For-Review, cloud-services-team, wikitech.wikimedia.org, MW-1.30-release-notes (WMF-deploy-2017-06-06_(1.30.0-wmf.4)), MediaWiki-extensions-OpenStackManager
Andrew closed T194191: Allow projectadmins to change project roles in Horizon, a subtask of T161553: Remove OpenStackManager from Wikitech, as Resolved.
May 11 2018, 4:34 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew closed T194276: Review all VMs in the 'services' WMCS project as Resolved.

I'm deleting pdfservice, swproxy, zotero-test citoif-test citoid-jessie-test and sca1. Appservice remains.

May 11 2018, 4:25 PM · Performance-Team (Radar), Services (attic)

May 10 2018

Andrew added a comment to T187962: Rack/cable/configure asw2-c-eqiad switch stack.

I'm flying on the 29th. If Chase wants to manage these things without me that's fine with me though :)

May 10 2018, 10:21 PM · Patch-For-Review, Operations, ops-eqiad, netops
Andrew added a comment to T187962: Rack/cable/configure asw2-c-eqiad switch stack.

In theory we can do it on the 24th but the 31st is much better for me.

May 10 2018, 7:44 PM · Patch-For-Review, Operations, ops-eqiad, netops

May 9 2018

Andrew created T194276: Review all VMs in the 'services' WMCS project.
May 9 2018, 2:15 PM · Performance-Team (Radar), Services (attic)

May 8 2018

Andrew updated the task description for T161553: Remove OpenStackManager from Wikitech.
May 8 2018, 6:21 PM · cloud-services-team, wikitech.wikimedia.org, MediaWiki-extensions-OpenStackManager
Andrew added a comment to T194191: Allow projectadmins to change project roles in Horizon.

I haven't implemented paging. That means that in the Tools project, loading the page and interacting with it is pretty slow. Since most of this functionality is now handled by Striker I'm not sure it's worth implementing paging in this panel -- as best I can tell it's perfectly responsive for all other projects.

May 8 2018, 6:19 PM · Patch-For-Review, cloud-services-team, wikitech.wikimedia.org, MW-1.30-release-notes (WMF-deploy-2017-06-06_(1.30.0-wmf.4)), MediaWiki-extensions-OpenStackManager
Andrew added a comment to T194191: Allow projectadmins to change project roles in Horizon.

See also https://gerrit.wikimedia.org/r/#/c/431803/

May 8 2018, 6:18 PM · Patch-For-Review, cloud-services-team, wikitech.wikimedia.org, MW-1.30-release-notes (WMF-deploy-2017-06-06_(1.30.0-wmf.4)), MediaWiki-extensions-OpenStackManager
Andrew created T194191: Allow projectadmins to change project roles in Horizon.
May 8 2018, 6:17 PM · Patch-For-Review, cloud-services-team, wikitech.wikimedia.org, MW-1.30-release-notes (WMF-deploy-2017-06-06_(1.30.0-wmf.4)), MediaWiki-extensions-OpenStackManager

May 2 2018

Andrew added a comment to T193653: labtestvirt2002 eth1 showing no carrier.

I've confirmed that VMs on labtestvirt2002 work properly. Thank you!

May 2 2018, 7:26 PM · cloud-services-team, ops-codfw, Operations
Andrew created T193653: labtestvirt2002 eth1 showing no carrier.
May 2 2018, 5:01 PM · cloud-services-team, ops-codfw, Operations
Andrew updated the task description for T193579: Update and move labnet1001/1002.
May 2 2018, 3:19 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew updated the task description for T193579: Update and move labnet1001/1002.
May 2 2018, 2:49 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew updated the task description for T193579: Update and move labnet1001/1002.
May 2 2018, 2:48 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew added a comment to T193579: Update and move labnet1001/1002.

@Cmjohnson, The 15th sounds good for labnet1001. I don't think 1500UTC is the same thing as 1000 EST but I'm going to assume that the EST part is what interests you :)

May 2 2018, 2:43 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew added a comment to T193196: labnet1003 and labnet1004 moving and enabling 10G NICs.

@Cmjohnson, sorry, now we're talking about doing this all in one day. Could you be available for a specific appointment (probably around 1PM) to re-rack this box on either Friday May 11th or Tuesday May 15th? The 15th is mildly better but if either one works for you that'd be great.

May 2 2018, 12:12 AM · Cloud-VPS, Operations, ops-eqiad

May 1 2018

Andrew added a comment to T193196: labnet1003 and labnet1004 moving and enabling 10G NICs.

@Cmjohnson, I propose to fail over to labnet1002 on May 8th (Tuesday) and switch back to 1001 on May 15th (also a Tuesday). Can you commit to re-racking labnet1001 sometime on Wednesday, Thursday or Friday next week?

May 1 2018, 10:48 PM · Cloud-VPS, Operations, ops-eqiad
Andrew updated the task description for T193579: Update and move labnet1001/1002.
May 1 2018, 10:44 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew added a comment to T193579: Update and move labnet1001/1002.
root@labnet1002:~# uname -a
Linux labnet1002 3.13.0-145-generic #194-Ubuntu SMP Thu Apr 5 15:20:44 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
May 1 2018, 10:28 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew triaged T193579: Update and move labnet1001/1002 as Normal priority.
May 1 2018, 10:12 PM · Patch-For-Review, Cloud-VPS, ops-eqiad, Operations
Andrew added a comment to T192618: Can't ssh into new instance created at toolsbeta.

@zhuyifei1999 are you still blocked by this?

May 1 2018, 2:52 PM · Cloud-VPS
Andrew closed T179378: some labvirt servers are at full CPU capacity as Resolved.

I think this is under control now. I've opened T193272 about the misreporting issue.

May 1 2018, 2:52 PM · cloud-services-team, Cloud-VPS

Apr 30 2018

Andrew closed T192679: Test labvirt1021 and 22 and then make them official spares as Resolved.
Apr 30 2018, 9:45 PM · cloud-services-team (Kanban)
Andrew closed T192679: Test labvirt1021 and 22 and then make them official spares, a subtask of T192422: labvirt1015 is hosting more than 90 VMs, as Resolved.
Apr 30 2018, 9:45 PM · Patch-For-Review, cloud-services-team (Kanban)