aborrero (arturo)
Operations Engineer at Wikimedia Cloud Services Team

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Oct 23 2017, 12:19 PM (51 w, 6 d)
Availability
Available
IRC Nick
arturo
LDAP User
Arturo Borrero Gonzalez
MediaWiki User
ABorrero (WMF) [ Global Accounts ]

I'm Arturo Borrero Gonzalez from Spain (Seville). I'm Operations Engineer as part of the Wikimedia Cloud Services Team, a Wikimedia Foundation staff.

You may found me in some FLOSS projects, like Netfilter and Debian.

Recent Activity

Today

aborrero added a comment to T174596: dmz_cidr only includes some wikimedia public IP ranges, leading to some very strange behaviour.

This is also the reason we have to have the following route on cr1/2-eqiad static route 172.16.0.0/21 next-hop 10.64.22.4 so when hosts in the 172.16/21 subnet reach hosts outside (without NAT), return traffic knows what path to take.

I think there are several action items here, the end goal being OpenStack to be fully separated from the remaining of the infrastructure.
1/ Standardize the list of target subnets to not use NAT as mentioned in T174596#4530414 (use 1 list instead of 4, the most complete one)

Mon, Oct 22, 9:39 AM · cloud-services-team (Kanban), netops, Operations, Cloud-VPS
aborrero added a comment to T207536: Move various support services for Cloud VPS currently in prod into their own instances.

For the record, I don't think we should move openstack components inside openstack just to avoid complex chicken-egg problems.

Mon, Oct 22, 9:04 AM · Operations, Cloud-VPS
aborrero triaged T207543: Move labmon (Graphite, StatsD) into a Cloud VPS as Lowest priority.

We have dedicated hardware for this, in the case of labmon1002, a fairly new server which was put into works some months ago.

Mon, Oct 22, 9:01 AM · cloud-services-team (Kanban), Operations, Cloud-VPS

Fri, Oct 19

aborrero added a comment to T199003: Develop timeline for Cloud VPS wide deprecation of Trusty.

According to the timeline described here https://wikitech.wikimedia.org/wiki/News/Trusty_deprecation#Cloud_VPS_projects we should be sending pings to the deprecation subtasks starting today.

Fri, Oct 19, 12:44 PM · Cloud-VPS (Ubuntu Trusty Deprecation), cloud-services-team (Kanban), Goal
aborrero reopened T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs as "Open".

Reopening and reverting patch. I can confirm is causing at least 2 issues:

Fri, Oct 19, 11:59 AM · Patch-For-Review, cloud-services-team (Kanban), User-herron, Operations, Cloud-Services, Mail
aborrero reopened T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs, a subtask of T41785: Create a Cloud VPS SMTP smarthost, as Open.
Fri, Oct 19, 11:59 AM · User-herron, Patch-For-Review, Operations, Cloud-Services, Mail
aborrero added a comment to T174596: dmz_cidr only includes some wikimedia public IP ranges, leading to some very strange behaviour.

Does this still affect us? If so, which concrete subnets are affected?

Fri, Oct 19, 11:22 AM · cloud-services-team (Kanban), netops, Operations, Cloud-VPS
aborrero closed T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs as Resolved.

hey @herron it should be working now. This was my test:

Fri, Oct 19, 10:56 AM · Patch-For-Review, cloud-services-team (Kanban), User-herron, Operations, Cloud-Services, Mail
aborrero closed T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs, a subtask of T41785: Create a Cloud VPS SMTP smarthost, as Resolved.
Fri, Oct 19, 10:56 AM · User-herron, Patch-For-Review, Operations, Cloud-Services, Mail
aborrero moved T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs from Inbox to Doing on the cloud-services-team (Kanban) board.
Fri, Oct 19, 10:34 AM · Patch-For-Review, cloud-services-team (Kanban), User-herron, Operations, Cloud-Services, Mail
aborrero added a project to T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs: cloud-services-team (Kanban).
Fri, Oct 19, 10:33 AM · Patch-For-Review, cloud-services-team (Kanban), User-herron, Operations, Cloud-Services, Mail
aborrero moved T202886: cloudvps: eqiad1: create DNS PTR records for cloud addresses from Doing to Blocked on the cloud-services-team (Kanban) board.
Fri, Oct 19, 9:26 AM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services
aborrero moved T206223: *.wmflabs.org cert needs renewing from Important to Doing on the cloud-services-team (Kanban) board.
Fri, Oct 19, 9:15 AM · cloud-services-team (Kanban), Cloud-Services

Thu, Oct 18

aborrero moved T174596: dmz_cidr only includes some wikimedia public IP ranges, leading to some very strange behaviour from Inbox to Doing on the cloud-services-team (Kanban) board.
Thu, Oct 18, 3:37 PM · cloud-services-team (Kanban), netops, Operations, Cloud-VPS
aborrero moved T199003: Develop timeline for Cloud VPS wide deprecation of Trusty from Inbox to Doing on the cloud-services-team (Kanban) board.
Thu, Oct 18, 3:35 PM · Cloud-VPS (Ubuntu Trusty Deprecation), cloud-services-team (Kanban), Goal
aborrero moved T202886: cloudvps: eqiad1: create DNS PTR records for cloud addresses from Inbox to Doing on the cloud-services-team (Kanban) board.
Thu, Oct 18, 3:35 PM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services
aborrero moved T204745: cloudvps: migrate projects from main to eqiad1 from Inbox to Doing on the cloud-services-team (Kanban) board.
Thu, Oct 18, 3:35 PM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services
aborrero moved T206223: *.wmflabs.org cert needs renewing from Inbox to Doing on the cloud-services-team (Kanban) board.
Thu, Oct 18, 3:34 PM · cloud-services-team (Kanban), Cloud-Services
aborrero moved T207327: Change switch config for cloudvirt1018 (formerly labvirt1018) to work with neutron/eqiad1 from Inbox to Doing on the cloud-services-team (Kanban) board.
Thu, Oct 18, 3:34 PM · cloud-services-team (Kanban), Cloud-Services
aborrero added a project to T207327: Change switch config for cloudvirt1018 (formerly labvirt1018) to work with neutron/eqiad1: cloud-services-team (Kanban).

I'm checking with @ayounsi trying to debug what's happening here.

Thu, Oct 18, 3:34 PM · cloud-services-team (Kanban), Cloud-Services
aborrero claimed T207327: Change switch config for cloudvirt1018 (formerly labvirt1018) to work with neutron/eqiad1.
Thu, Oct 18, 3:18 PM · cloud-services-team (Kanban), Cloud-Services
aborrero created T207378: trusty servers: purge old kernel packages.
Thu, Oct 18, 11:15 AM · cloud-services-team
aborrero added a comment to T207317: Rename labvirt1018 to cloudvirt1018, move to eqiad1.

For the record, I refreshed the docs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments

Thu, Oct 18, 10:30 AM · Patch-For-Review, Cloud-Services
aborrero added a comment to T207327: Change switch config for cloudvirt1018 (formerly labvirt1018) to work with neutron/eqiad1.
  1. I renamed the switch ports descriptions from labvirt1018 to cloudvirt1018
  2. The switch ports configurations are similar to cloudvirt1024 (eth0 access for cloud-hosts1-b-eqiad, eth1 trunk with cloud-instances1-b-eqiad/cloud-instances2-b-eqiad)
Thu, Oct 18, 10:28 AM · cloud-services-team (Kanban), Cloud-Services
aborrero added a comment to T122406: Consider renumbering Labs to separate address spaces.

Agreed.

Thu, Oct 18, 10:07 AM · Cloud-Services, netops, Operations
aborrero renamed T205463: sudo randomly prompts for passwords sometimes in cloud instances from sudo randomly prompts for passwords sometimes in labs instances to sudo randomly prompts for passwords sometimes in cloud instances.
Thu, Oct 18, 10:01 AM · Cloud-VPS, LDAP, Beta-Cluster-reproducible
aborrero closed T169099: Locate an alternative source for modern Openstack Debian packages as Resolved.
  • openstack mitaka is in jessie-backports (already using it in eqiad1)
  • openstack newton is in stretch (mitaka+1)
  • openstack ocata is in stretch-backports (newton+1)
Thu, Oct 18, 9:42 AM · Patch-For-Review, cloud-services-team (Kanban), Cloud-Services
aborrero closed T169099: Locate an alternative source for modern Openstack Debian packages, a subtask of T186029: Remove support for Ubuntu Trusty prior to upstream End Of Life for release, as Resolved.
Thu, Oct 18, 9:42 AM · Cloud-VPS (Ubuntu Trusty Deprecation), Epic
aborrero triaged T203072: Request creation of ign2commons VPS project as Normal priority.
Thu, Oct 18, 9:03 AM · cloud-services-team (Kanban), Cloud-VPS (Project-requests)
aborrero moved T203072: Request creation of ign2commons VPS project from Doing to Important on the cloud-services-team (Kanban) board.

I just created the project, so you can start doing test and some work. However, I didn't do anything special regarding the disk space, hopefully @Andrew can say better if we are ready for the disk space allocation or we have to wait a bit more.
Keeping the task open for now.

Thu, Oct 18, 9:01 AM · cloud-services-team (Kanban), Cloud-VPS (Project-requests)
aborrero moved T203072: Request creation of ign2commons VPS project from Inbox to Doing on the cloud-services-team (Kanban) board.
Thu, Oct 18, 8:53 AM · cloud-services-team (Kanban), Cloud-VPS (Project-requests)

Fri, Oct 12

aborrero added a comment to T187994: netfilter software at WMF: iptables vs nftables.

From https://blogs.gnome.org/dcbw/2018/07/27/the-ascendance-of-nftables/ :

Fri, Oct 12, 8:44 PM · Operations
aborrero reopened T206872: cannot add cloudvirt1023 eth1 to cloud-instances2-b-eqiad vlan as "Open".

This still doesn't work. Same behavior as before: packets go out of the interface but nothing enters, which may indicate a miscommunication somewhere in the switching stack.

Fri, Oct 12, 8:11 PM · netops, cloud-services-team (Kanban), Cloud-VPS, Operations
aborrero reopened T206872: cannot add cloudvirt1023 eth1 to cloud-instances2-b-eqiad vlan, a subtask of T199125: rack/setup/install cloudvirt102[34], as Open.
Fri, Oct 12, 8:11 PM · cloud-services-team (Kanban), ops-eqiad, Cloud-VPS, Operations
aborrero renamed T206872: cannot add cloudvirt1023 eth1 to cloud-instances2-b-eqiad vlan from cannot add cloudvirt1023 eth1 to cloud-instances1-b-eqiad vlan to cannot add cloudvirt1023 eth1 to cloud-instances2-b-eqiad vlan.
Fri, Oct 12, 6:06 PM · netops, cloud-services-team (Kanban), Cloud-VPS, Operations

Thu, Oct 11

aborrero updated subscribers of T206706: Establish documentation review process for WMCS.

Idea 1: have a checklist in phabricator tasks when developing new features/fixing things that points us to update the relevant docs.
This way we don't consider a task as completed until docs have been updated/reviewed.

Thu, Oct 11, 6:18 PM · cloud-services-team (Kanban)
aborrero awarded T206761: Create a jessie netboot image with the 4.9 Linux kernel a Like token.
Thu, Oct 11, 4:17 PM · cloud-services-team, Operations

Wed, Oct 10

aborrero renamed T206710: admin docs: quarry from admin doc,./' to admin docs: quarry.
Wed, Oct 10, 10:21 PM · Quarry, Documentation
aborrero created T206710: admin docs: quarry.
Wed, Oct 10, 10:19 PM · Quarry, Documentation

Tue, Oct 9

aborrero added a comment to T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs.

Ok, it seems I'm wrong, will have to review my own docs lol

Tue, Oct 9, 6:28 PM · Patch-For-Review, cloud-services-team (Kanban), User-herron, Operations, Cloud-Services, Mail
aborrero added a comment to T206225: WMCS: Make a 'knowledge matrix' about our core products and who knows about them.

Something is wrong in that page:

Tue, Oct 9, 5:58 PM · cloud-services-team (Kanban)
aborrero added a comment to T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs.

Wait, the NAT is only applied to connections in the egress path (from VM to the internet), and connections internal to CloudVPS are not affected by this egress NAT, i.e, VMs in the 172.16.0.0/12 range can contact 185.15.56.18/31 without source NAT being applied.

Tue, Oct 9, 5:47 PM · Patch-For-Review, cloud-services-team (Kanban), User-herron, Operations, Cloud-Services, Mail

Fri, Oct 5

aborrero added a comment to T206261: Routing RFC1918 private IP addresses to/from WMCS floating IPs.

We have a mechanisms called dmz_cidr which we can use to exclude NATs between certain IP ranges.
See a more detailed explanation here: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Neutron#dmz_cidr

Fri, Oct 5, 12:04 PM · Patch-For-Review, cloud-services-team (Kanban), User-herron, Operations, Cloud-Services, Mail
aborrero awarded T206224: WMCS: Fewer transitory middle-of-the-night puppet alerts a Love token.
Fri, Oct 5, 11:47 AM · cloud-services-team (Kanban), Patch-For-Review, Operations
aborrero added a comment to T135991: Automated service restarts for common low-level system services.

Could you please also patch profile::prometheus::openstack_exporter?

Fri, Oct 5, 11:44 AM · Performance-Team (Radar), Patch-For-Review, Operations

Thu, Oct 4

aborrero closed T203177: cloudvps: metrics and analytics as Resolved.

I created a new grafaa dashboard and we have now 3 dashboards to monitor eqiad1:

Thu, Oct 4, 11:56 AM · Patch-For-Review, Cloud-Services
aborrero closed T203177: cloudvps: metrics and analytics , a subtask of T167293: Nova-network to Neutron migration, as Resolved.
Thu, Oct 4, 11:56 AM · Patch-For-Review, Epic, Cloud-Services

Tue, Oct 2

aborrero renamed T205994: cloudvps: duplicated neutron agents logging from cloudvps: duplicate neutron agents logging to cloudvps: duplicated neutron agents logging.
Tue, Oct 2, 5:16 PM · Cloud-Services
aborrero triaged T205994: cloudvps: duplicated neutron agents logging as Normal priority.
Tue, Oct 2, 5:15 PM · Cloud-Services
aborrero awarded T205897: Netbox: fill network topology a Love token.
Tue, Oct 2, 5:05 PM · Operations
aborrero triaged T205986: cloudnet1004: spontaneous reboot as Normal priority.
Tue, Oct 2, 4:59 PM · DC-Ops, cloud-services-team
aborrero changed the status of T205986: cloudnet1004: spontaneous reboot from Open to Stalled.

The obvious step seems to be to update all the machine firmware, as suggested by @RobH, which will take the server down for a couple of hours. Updating firmware is also what HP usually ask first when opening a support ticket with them.

Tue, Oct 2, 4:59 PM · DC-Ops, cloud-services-team
aborrero added a comment to T205947: Kubernetes interactive shell shares sessions with other users.

Thanks for filling the task, we are evaluating this.

Tue, Oct 2, 4:40 PM · Kubernetes, Toolforge
aborrero added a comment to T205524: cloudvps: neutron: agents failed to communicate with server.

After T205986: cloudnet1004: spontaneous reboot today, I see issues with agents again all over the place, including python tracebacks in the logs :-(

Tue, Oct 2, 4:32 PM · cloud-services-team (Kanban), Cloud-Services
aborrero created T205986: cloudnet1004: spontaneous reboot.
Tue, Oct 2, 4:24 PM · DC-Ops, cloud-services-team
aborrero created T205969: labstore1007: high load avg issue.
Tue, Oct 2, 12:16 PM · cloud-services-team
aborrero added a comment to T205524: cloudvps: neutron: agents failed to communicate with server.

I can't find the error messages in the logs anymore but it's very likely I'm not looking right. @aborrero does the situation look better now?

Tue, Oct 2, 9:48 AM · cloud-services-team (Kanban), Cloud-Services

Fri, Sep 28

aborrero added a comment to T203177: cloudvps: metrics and analytics .

Status of this: code has been deployed (after a lot of back and forth with puppet) and we get the Forbidden: Policy doesn't allow os_compute_api:os-hypervisors to be performed. (HTTP 403) error.
Also, not sure if we need something else to instruct prometheus to read from this exporter.

Fri, Sep 28, 1:37 PM · Patch-For-Review, Cloud-Services
aborrero added a comment to T203177: cloudvps: metrics and analytics .

With the current status of package and puppet patch, I see this error message from the exporter script:

Fri, Sep 28, 11:46 AM · Patch-For-Review, Cloud-Services
aborrero added a comment to T204840: wikitech-static: not synced.

The other day I created this page in wikitech:

Fri, Sep 28, 9:48 AM · cloud-services-team (Kanban), Patch-For-Review, wikitech.wikimedia.org
aborrero added a comment to T199003: Develop timeline for Cloud VPS wide deprecation of Trusty.

I will defer to you on the email since you're probably more knowledgeable in the particulars of the transition.

Fri, Sep 28, 9:43 AM · Cloud-VPS (Ubuntu Trusty Deprecation), cloud-services-team (Kanban), Goal

Thu, Sep 27

Jdlrobson awarded T204698: cloudvps: wikidata-page-banner project trusty deprecation a Like token.
Thu, Sep 27, 7:13 PM · Cloud-VPS (Ubuntu Trusty Deprecation), Readers-Web-Backlog (Tracking), Wikidata, Wikidata-Page-Banner
aborrero added a comment to T204745: cloudvps: migrate projects from main to eqiad1.

This machine migration had a disk failure when copying which apparently solved by itself:

Thu, Sep 27, 12:04 PM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services
aborrero added a comment to T199003: Develop timeline for Cloud VPS wide deprecation of Trusty.
Thu, Sep 27, 11:04 AM · Cloud-VPS (Ubuntu Trusty Deprecation), cloud-services-team (Kanban), Goal
aborrero closed T202115: cloudvps: eqiad1: review floating IP mechanisms as Resolved.

Feel free to reopen if more issues or questions appears.

Thu, Sep 27, 11:03 AM · cloud-services-team
aborrero closed T202115: cloudvps: eqiad1: review floating IP mechanisms, a subtask of T167293: Nova-network to Neutron migration, as Resolved.
Thu, Sep 27, 11:03 AM · Patch-For-Review, Epic, Cloud-Services
aborrero closed T202636: Allow routing between eqiad and eqiad1 regions as Resolved.

I think this is solved. Feel free to reopen if more issues or questions arise.

Thu, Sep 27, 11:02 AM · Patch-For-Review, Cloud-VPS, cloud-services-team
aborrero closed T202636: Allow routing between eqiad and eqiad1 regions, a subtask of T167293: Nova-network to Neutron migration, as Resolved.
Thu, Sep 27, 11:02 AM · Patch-For-Review, Epic, Cloud-Services

Wed, Sep 26

aborrero added a comment to T205524: cloudvps: neutron: agents failed to communicate with server.

Current state of this:

Wed, Sep 26, 4:09 PM · cloud-services-team (Kanban), Cloud-Services
aborrero added a comment to T205524: cloudvps: neutron: agents failed to communicate with server.
15:17 <arturo> well, after the patch, even though we still have the problem of unreplied rabbitmq messages and agents go down arbitrarily, I see them coming alive again much faster
15:18 <arturo> which may be a temporal mitigation
Wed, Sep 26, 1:18 PM · cloud-services-team (Kanban), Cloud-Services
aborrero added a comment to T205524: cloudvps: neutron: agents failed to communicate with server.

For a working agent<->server communication I can see messages flowing in both directions:

Wed, Sep 26, 10:51 AM · cloud-services-team (Kanban), Cloud-Services
aborrero added a comment to T205524: cloudvps: neutron: agents failed to communicate with server.

All the restarts do nothing.

Wed, Sep 26, 10:39 AM · cloud-services-team (Kanban), Cloud-Services
aborrero added a comment to T204745: cloudvps: migrate projects from main to eqiad1.

I'm tracking neutron agent/server issues in T205524

Wed, Sep 26, 10:12 AM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services
aborrero triaged T205524: cloudvps: neutron: agents failed to communicate with server as Normal priority.
Wed, Sep 26, 9:50 AM · cloud-services-team (Kanban), Cloud-Services
aborrero added a comment to T204745: cloudvps: migrate projects from main to eqiad1.

Issue seems to be that neutron is having a hard time with agents:

Wed, Sep 26, 9:43 AM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services
aborrero added a comment to T204745: cloudvps: migrate projects from main to eqiad1.

The region-migrate script failed:

Wed, Sep 26, 9:40 AM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services
aborrero updated the task description for T204745: cloudvps: migrate projects from main to eqiad1.
Wed, Sep 26, 9:18 AM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services

Tue, Sep 25

aborrero added a comment to T204745: cloudvps: migrate projects from main to eqiad1.

Next can be: mwv-apt, wikimania-support

Tue, Sep 25, 4:39 PM · cloud-services-team (Kanban), Patch-For-Review, Cloud-Services
aborrero closed T203533: Request creation of packagist-mirror VPS project as Resolved.

Since this is my clinic-duty week, I took the freedom of creating this project.

Tue, Sep 25, 9:27 AM · cloud-services-team (Kanban), Cloud-VPS (Project-requests)
aborrero closed T203533: Request creation of packagist-mirror VPS project, a subtask of T203529: Set up a packagist mirror for Wikimedia, as Resolved.
Tue, Sep 25, 9:27 AM · Composer, Wikimedia-General-or-Unknown

Mon, Sep 24

Bstorm awarded T196137: toolforge: prometheus issue is filling up email queue a Party Time token.
Mon, Sep 24, 4:40 PM · cloud-services-team (Kanban), Patch-For-Review, Toolforge
aborrero added a comment to T205159: Request increased quota for project-smtp Cloud VPS project.

Thanks for adding quota! Question -- What is the difference between pools wan-transport-eqiad and compat-net? Which should be used?

Mon, Sep 24, 10:43 AM · cloud-services-team (Kanban), Cloud-VPS (Quota-requests)

Sep 21 2018

aborrero closed T205078: toolforge: round of package upgrades and cleanups as Resolved.

That's all by now. I don't want to upgrade docker/linux/grub related packages by now.

Sep 21 2018, 12:37 PM · Toolforge
aborrero created T205078: toolforge: round of package upgrades and cleanups.
Sep 21 2018, 11:47 AM · Toolforge
aborrero added a comment to T193655: rack/setup/install cloudstore1008 & cloudstore1009.

hey @RobH @Cmjohnson what is the status of this? Could we move forward with OS installation?

Sep 21 2018, 9:36 AM · cloud-services-team (Kanban), Patch-For-Review, ops-eqiad, Cloud-VPS, Operations
aborrero triaged T204840: wikitech-static: not synced as Normal priority.
Sep 21 2018, 9:18 AM · cloud-services-team (Kanban), Patch-For-Review, wikitech.wikimedia.org
aborrero added a comment to T204840: wikitech-static: not synced.

I still don't know why this failed.

Sep 21 2018, 8:51 AM · cloud-services-team (Kanban), Patch-For-Review, wikitech.wikimedia.org
aborrero merged task T203206: Wikitech-static not getting all content changes into T204840: wikitech-static: not synced.
Sep 21 2018, 8:32 AM · cloud-services-team (Kanban), wikitech.wikimedia.org
aborrero merged T203206: Wikitech-static not getting all content changes into T204840: wikitech-static: not synced.
Sep 21 2018, 8:32 AM · cloud-services-team (Kanban), Patch-For-Review, wikitech.wikimedia.org
aborrero updated subscribers of T203177: cloudvps: metrics and analytics .

For the record @Andrew created this dashboard: https://grafana.wikimedia.org/dashboard/db/cloud-capacity-planning?orgId=1

Sep 21 2018, 7:34 AM · Patch-For-Review, Cloud-Services

Sep 20 2018

aborrero closed T204353: Wikidocumentaries wants to use https://wikidocumentaries.io as Resolved.

For the record, this is what I did:

Sep 20 2018, 12:36 PM · Cloud-VPS (Quota-requests), Wikidocumentaries
aborrero closed T204059: Request creation of hashtags VPS project as Resolved.
Sep 20 2018, 10:27 AM · Cloud-VPS (Project-requests)
aborrero added a comment to T204059: Request creation of hashtags VPS project.

Project has been created! It should be in the eqiad1-r region in the eqiad1 deployment. Mind the horizon option in the top-left drop-down menu.

Sep 20 2018, 10:27 AM · Cloud-VPS (Project-requests)
aborrero added a comment to T204695: cloudvps: wikidataconcepts project trusty deprecation.

@GoranSMilovanovic, find more info here:

Sep 20 2018, 10:20 AM · Cloud-VPS (Ubuntu Trusty Deprecation), User-GoranSMilovanovic
aborrero added a comment to T204003: Move labvirt1019 and 1020 to eqiad1.

Please refresh https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments with these changes or let me know and I'll do it :-)

Sep 20 2018, 9:56 AM · Patch-For-Review, Cloud-VPS
aborrero closed T204373: Request increased quota for integration Cloud VPS project as Resolved.

For the record, this is what I did:

Sep 20 2018, 9:29 AM · Release-Engineering-Team, Continuous-Integration-Infrastructure, Cloud-VPS (Quota-requests)
aborrero closed T204373: Request increased quota for integration Cloud VPS project, a subtask of T202160: Evaluate different strategy for Docker CI instances, as Resolved.
Sep 20 2018, 9:29 AM · Release-Engineering-Team (Kanban), Release Pipeline, Continuous-Integration-Infrastructure
aborrero closed T204532: Request removal of puppet3-diffs VPS project as Resolved.

Done :-)

Sep 20 2018, 9:23 AM · Operations, Cloud-VPS (Project-requests)
aborrero closed T204532: Request removal of puppet3-diffs VPS project, a subtask of T191438: Upgrade Puppet compilers to Stretch, as Resolved.
Sep 20 2018, 9:23 AM · Cloud-VPS, Jenkins, Release-Engineering-Team, User-herron, Operations, puppet-compiler, Puppet
aborrero added a comment to T204698: cloudvps: wikidata-page-banner project trusty deprecation.

@aborrero if we don't hear from Sumit, i suggest we remove this instance, however I'm not sure what the protocol and grace period is for doing so.

Sep 20 2018, 9:06 AM · Cloud-VPS (Ubuntu Trusty Deprecation), Readers-Web-Backlog (Tracking), Wikidata, Wikidata-Page-Banner