Page MenuHomePhabricator

ayounsi (Arzhel Younsi)
Network Engineer

Projects (9)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Apr 3 2017, 6:23 PM (210 w, 18 h)
Availability
Available
IRC Nick
xionox
LDAP User
Ayounsi
MediaWiki User
AYounsi (WMF) [ Global Accounts ]

Recent Activity

Today

ayounsi added a comment to T273716: Improve Alertmanager/LibreNMS notifications.


It's confusing to see the alerts twice in there.

Tue, Apr 13, 11:02 AM · Patch-For-Review, observability
ayounsi removed a project from T265590: ulog: filter out diffscan from ulog: netops.
Tue, Apr 13, 11:01 AM · observability, Security, SRE, User-jbond
ayounsi removed a project from T237243: Network unreachable after network-online.target is brought up: netops.
Tue, Apr 13, 10:58 AM · SRE, Traffic
ayounsi added a comment to T265864: Remove 185.15.56.0/24 from network::external.

They're currently coming from the 172.16.0.0/12 space but T209011 is going to change it so they will come from the 185.15.56.0/24 space.
Does that mean this change should be a prerequisite to T209011? Or is there more investigation to make? Trying to figure out the next steps.

Tue, Apr 13, 10:04 AM · Patch-For-Review, cloud-services-team (Kanban), SRE, netops
ayounsi added a comment to T276448: Failover m1 master: db1080 -> db1159 Wed 14th April at 10 AM UTC.

Affirm.

Tue, Apr 13, 9:00 AM · Patch-For-Review, DBA
ayounsi updated subscribers of T265864: Remove 185.15.56.0/24 from network::external.
Tue, Apr 13, 8:46 AM · Patch-For-Review, cloud-services-team (Kanban), SRE, netops
ayounsi updated subscribers of T265864: Remove 185.15.56.0/24 from network::external.
Tue, Apr 13, 8:38 AM · Patch-For-Review, cloud-services-team (Kanban), SRE, netops
ayounsi added a comment to T265864: Remove 185.15.56.0/24 from network::external.

PCC result: https://puppet-compiler.wmflabs.org/compiler1003/28963/

Tue, Apr 13, 8:35 AM · Patch-For-Review, cloud-services-team (Kanban), SRE, netops
ayounsi reopened T231517: Investigate and fix GC issues on cloudelastic machines as "Open".

Reopening as there are 3 similar Icinga alerts, 1 with a link to that task:
https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=cloudelastic1004&service=Rate+of+JVM+GC+Old+generation-s+runs+-+cloudelastic1004-cloudelastic-chi-eqiad
https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=cloudelastic1005&service=Rate+of+JVM+GC+Old+generation-s+runs+-+cloudelastic1005-cloudelastic-chi-eqiad
https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=cloudelastic1006&service=Rate+of+JVM+GC+Old+generation-s+runs+-+cloudelastic1006-cloudelastic-chi-eqiad

Tue, Apr 13, 7:34 AM · Patch-For-Review, Discovery-Search
ayounsi added a comment to T275081: (Need By: TBD) rack/setup/install cloudvirt104[0-6].eqiad.wmnet.

Please don't forget to update the switches by running Homer when you update Netbox, otherwise there are outstanding changes and they alert. I pushed the one bellow.

Tue, Apr 13, 6:04 AM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops
ayounsi added a comment to T274945: (Need By: TBD) rack/setup/install cloudcephosd10[16-20].eqiad.wmnet.

Please don't forget to update the switches by running Homer when you update Netbox, otherwise there are outstanding changes and they alert. I pushed the one bellow.

Configuration diff for asw2-d-eqiad.mgmt.eqiad.wmnet:
Tue, Apr 13, 6:00 AM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops

Thu, Apr 8

ayounsi closed Restricted Task, a subtask of T209460: CloudVPS: network architecture, as Resolved.
Thu, Apr 8, 12:32 PM · SRE, cloud-services-team (Kanban), Epic
ayounsi committed rOHPU59f4326d2834: Introduce production4/6 and tighten looback filter (authored by ayounsi).
Introduce production4/6 and tighten looback filter
Thu, Apr 8, 11:57 AM
ayounsi added a comment to T224891: Rate limit requests in violation of User-Agent policy more aggressively.

Even with the current rate limiting, some crawling are regularly causing issues, wasting precious SRE time.

Thu, Apr 8, 11:02 AM · User-notice, Traffic, SRE
ayounsi closed T257392: automatically sample from all FPCs on core routers as Resolved.

One more thing automated from Netbox.

Thu, Apr 8, 10:46 AM · SRE, netops
ayounsi committed rOHPU6562c4fabd33: Automatically enable sampling on all FPCs (authored by ayounsi).
Automatically enable sampling on all FPCs
Thu, Apr 8, 10:39 AM
ayounsi added a comment to T279457: Multiple host down alerts from rack C2.

Ok, because of this RTF RMA we're going to replace the switch with a spare.
@Papaul Let's chat on IRC to figure out what time would works best for you, then we can notify services owners and draft up a plan.

Thu, Apr 8, 9:29 AM · netops, SRE, ops-codfw

Wed, Apr 7

ayounsi added a comment to T275234: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org.

@ssingh did we get results from those test data?

Wed, Apr 7, 1:10 PM · SRE, netops, Traffic
ayounsi reassigned T277654: Higher latency on Lumen eqiad/esams link from ayounsi to wiki_willy.
Wed, Apr 7, 1:05 PM · SRE, netops
ayounsi added a comment to T279296: Feedback for new service IP flowchart.

Audience is indeed SREs, to be used to help them know what the (high level and preferred) options are when deploying a new service.
Service-deployment-requests is nice, I'd imagine SRE using that flowchart to know how the service request would fit in our infra.

Wed, Apr 7, 10:17 AM · SRE, serviceops, Traffic
ayounsi added a comment to T279503: Unable to load en.wikipedia.org from 84.19.61.192/26.

Investigation started a while ago on a noc@ thread.

Wed, Apr 7, 8:56 AM · Traffic, netops, SRE
ayounsi added a comment to T279429: Audit analytics firewall filters.

There is also a term permitting UDP fragments, I added a "count" to know if/why we're using it.

Wed, Apr 7, 8:48 AM · SRE, Analytics, netops

Tue, Apr 6

ayounsi added a comment to T279429: Audit analytics firewall filters.

There is also a term permitting UDP fragments, I added a "count" to know if/why we're using it.

Tue, Apr 6, 12:27 PM · SRE, Analytics, netops
ayounsi triaged T279429: Audit analytics firewall filters as Low priority.
Tue, Apr 6, 12:02 PM · SRE, Analytics, netops
ayounsi added a comment to T274234: Understand (and mitigate) the backup speed differences between backup1002->backup2002 and backup2002->backup1002.

As discussed over IRC a while ago, this is mostly due to the network being more used in the eqiad->codfw direction.

Tue, Apr 6, 6:29 AM · netops, SRE, Data-Persistence-Backup

Mon, Apr 5

ayounsi added a comment to T278495: Figure out plan for mailman IP situation.

I made T279296 to illustrate the best path about services IPs.
I don't know about Exim specifically, but any UDP or TCP service can go behind LVS, even with a single back-end.
What has not been done previously (AFAIK) is to have the server make outbound connection from the VIP (behind LVS).
Which shouldn't be an issue as long as:
1/ there is only 1 back-end node active at a time
2/ the the daemon making outbound connection binds in the VIP (itself on the loopback).

Mon, Apr 5, 3:41 PM · SRE, Wikimedia-Mailing-lists
ayounsi triaged T279296: Feedback for new service IP flowchart as Low priority.
Mon, Apr 5, 3:25 PM · SRE, serviceops, Traffic
ayounsi closed Restricted Task, a subtask of T278967: cross-sync audit files between civicrm servers, as Resolved.
Mon, Apr 5, 2:51 PM · fundraising-tech-ops
ayounsi committed rOSHO6fc6b4a7b641: Add Capirca support to Homer (authored by ayounsi).
Add Capirca support to Homer
Mon, Apr 5, 7:14 AM
ayounsi closed T275211: TATA SKY users unable to connect with upload.wikimedia.org in browsers except Opera as Resolved.

No activity, assuming the issue got resolved. Please re-open if needed.

Mon, Apr 5, 6:17 AM · SRE, Traffic
ayounsi closed T275211: TATA SKY users unable to connect with upload.wikimedia.org in browsers except Opera, a subtask of T275234: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org, as Resolved.
Mon, Apr 5, 6:17 AM · SRE, netops, Traffic

Wed, Mar 31

ayounsi triaged T278934: Add eqiad airport express to Netbox as Low priority.
Wed, Mar 31, 10:41 AM · DC-Ops
ayounsi committed rOSNE7d36be73a55a: Small network report improvements (authored by ayounsi).
Small network report improvements
Wed, Mar 31, 10:03 AM
ayounsi committed rOSNE0702545ce908: Add network report (authored by ayounsi).
Add network report
Wed, Mar 31, 9:48 AM

Mon, Mar 29

ayounsi closed T267391: Relined maintenance PA-315002 as Resolved.
Mon, Mar 29, 8:45 AM · ops-esams, SRE
ayounsi awarded T214579: Some very specific Maniphest search queries by RelEng, Sec Team and WMCS are global and shown for all users a Like token.
Mon, Mar 29, 8:09 AM · SecTeam-Processed, Developer Productivity, Release-Engineering-Team (Development services), Release-Engineering-Team-TODO, Phabricator

Fri, Mar 26

ayounsi added a comment to T278495: Figure out plan for mailman IP situation.

Indeed! Thanks for the task.
The IP behind lists.wikimedia.org is tied to eqiad row A, which brings many limitation in term of HA for the service (a row is a failure domain, so services should be designed across rows) and best practices in general (standardizing how public services are accessed, reducing tech-debt).
A few services grew organically that way, and we're trying to reduce them. Now seems a good time ;)

Fri, Mar 26, 3:51 PM · SRE, Wikimedia-Mailing-lists
ayounsi added a comment to T277654: Higher latency on Lumen eqiad/esams link.

And it's permanent:

As mentioned by George/Lumen Technician. The route had to be changed to accommodate an equipment decommissioning. This is a permanent move. Thank you.

Fri, Mar 26, 9:33 AM · SRE, netops
ayounsi added a comment to T273716: Improve Alertmanager/LibreNMS notifications.

Note that I also edited the current LibreNMS alert templates to remove useless (or duplicated info).

Fri, Mar 26, 9:27 AM · Patch-For-Review, observability
ayounsi raised the priority of T272403: (Need By: 2021-03-31) rack/setup/install cloudgw100[12].eqiad.wmnet from Medium to High.
Fri, Mar 26, 9:04 AM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops
ayounsi added a comment to T222931: Netbox Reports Ideas and Requests.

An idea that came up in discussing DNS automation with @ayounsi is to verify interface names match, and/or automate updating interface names from PuppetDB into Netbox.

Fri, Mar 26, 8:59 AM · netbox, User-crusnov, SRE-tools

Thu, Mar 25

ayounsi added a comment to T277654: Higher latency on Lumen eqiad/esams link.

The latency increased on the circuit due to a route change on your circuit. The route had to be changed to accommodate an equipment decommissioning. The current length of the path has increased due to the new route. The circuit is currently running clean on the new path but as I advised the new path may be longer that the original path and there are no protection switches to change the path.

Thu, Mar 25, 4:44 PM · SRE, netops
ayounsi committed rOSNEb5bbc2d1638b: Add Capirca definitions exporter (authored by ayounsi).
Add Capirca definitions exporter
Thu, Mar 25, 4:33 PM
ayounsi added a comment to T265904: Remove SLAAC IPs from Ganeti hosts.

@Volans, @crusnov, what do you think about changing the status of those IPs from active to SLAAC?

I think those should not be in Netbox in the first place and we should fix that instead.

Thu, Mar 25, 2:34 PM · Patch-For-Review, Traffic, SRE
ayounsi added a comment to T277654: Higher latency on Lumen eqiad/esams link.

Opened another ticket 20938358

Thu, Mar 25, 2:00 PM · SRE, netops
ayounsi committed rOHPU61376ea9fcf0: Option 82: use-vlan-id (authored by ayounsi).
Option 82: use-vlan-id
Thu, Mar 25, 6:55 AM

Wed, Mar 24

ayounsi added a subtask for T277438: Move management routers ssh port: Unknown Object (Task).
Wed, Mar 24, 8:53 AM · SRE, netops
ayounsi added a comment to T277438: Move management routers ssh port.

This is not supported by 3/5 of our management routers. They will need to be replaced by more recent gear anyway.

Wed, Mar 24, 8:42 AM · SRE, netops
ayounsi added a comment to T272403: (Need By: 2021-03-31) rack/setup/install cloudgw100[12].eqiad.wmnet.

@Cmjohnson there are outstanding changes in Homer for cloudsw1-c8
Also something is not right in Netbox, https://netbox.wikimedia.org/dcim/interfaces/20087/ is type virtual, and not connected to the device interface.

Wed, Mar 24, 6:59 AM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops

Tue, Mar 23

ayounsi added a comment to T265904: Remove SLAAC IPs from Ganeti hosts.

@Volans, @crusnov, what do you think about changing the status of those IPs from active to SLAAC?
See for example https://netbox-next.wikimedia.org/ipam/ip-addresses/4540/
That would makes some of the Capirca automation easier (it would automatically ignore SLAAC IPs), but I don't know if it risks breaking something else.
And would help keeping track of them as well.

Tue, Mar 23, 10:10 AM · Patch-For-Review, Traffic, SRE

Mon, Mar 22

ayounsi closed T277771: Rename cloud-hosts1-b-eqiad to cloud-hosts1-eqiad as Resolved.

All done!

Mon, Mar 22, 3:57 PM · SRE, netops
ayounsi committed rOSNE0558b26bf010: cloud-hosts1-b renamed (authored by ayounsi).
cloud-hosts1-b renamed
Mon, Mar 22, 3:38 PM
ayounsi added a reverting change for rOSNE4800c1e406bf: interface automation: 2nd fix for cloud-hosts VLAN: rOSNEf267ac30a83a: Revert "interface automation: 2nd fix for cloud-hosts VLAN".
Mon, Mar 22, 3:22 PM
ayounsi committed rOSNEf267ac30a83a: Revert "interface automation: 2nd fix for cloud-hosts VLAN" (authored by ayounsi).
Revert "interface automation: 2nd fix for cloud-hosts VLAN"
Mon, Mar 22, 3:22 PM
ayounsi reassigned T218751: Audit down ports from ayounsi to Cmjohnson.

I disabled the ones that were obviously unused. I'll let you disable the remaining ones as they have descriptions, etc...

Mon, Mar 22, 9:25 AM · DC-Ops, SRE, ops-eqiad
ayounsi added a comment to T272688: Validate (and document) Homer config files.

Thanks added support for all the configuration knobs, but still have to add comments to all of them.

Mon, Mar 22, 7:40 AM · Patch-For-Review, SRE-tools, homer
ayounsi reopened T276743: ps1-a7-eqiad power over threshold alerts as "Open".

Got another similar alert, see:
https://librenms.wikimedia.org/graphs/id=8980/type=sensor_power/from=1616136600/to=1616223000

Mon, Mar 22, 6:52 AM · SRE, ops-eqiad, DC-Ops
ayounsi reopened T276743: ps1-a7-eqiad power over threshold alerts, a subtask of T276239: Try to move some new analytics worker nodes to different racks, as Open.
Mon, Mar 22, 6:51 AM · Analytics-Radar, SRE, ops-eqiad
ayounsi added a comment to T277654: Higher latency on Lumen eqiad/esams link.

Seems expected:

Lumen Maintenance 20795082 is currently ongoing on your service. You may experience a full service interruption or degradation from Wed, 2021/03/17 04:00:00 GMT to Wed, 2021/03/24 10:00:00 GMT.

To revisit in 2 days.

Mon, Mar 22, 6:47 AM · SRE, netops

Thu, Mar 18

aborrero awarded T277771: Rename cloud-hosts1-b-eqiad to cloud-hosts1-eqiad a Evil Spooky Haunted Tree token.
Thu, Mar 18, 4:00 PM · SRE, netops
ayounsi triaged T277771: Rename cloud-hosts1-b-eqiad to cloud-hosts1-eqiad as Medium priority.
Thu, Mar 18, 3:37 PM · SRE, netops

Wed, Mar 17

ayounsi reassigned T277341: (Need By: TBD) install MPC7E-MRATE FPC into cr[12]-codfw from ayounsi to Papaul.
Wed, Mar 17, 4:03 PM · SRE, ops-codfw, DC-Ops
ayounsi triaged T277654: Higher latency on Lumen eqiad/esams link as Medium priority.
Wed, Mar 17, 12:10 PM · SRE, netops
ayounsi added a comment to T225140: Icinga alerts that should open tasks instead of alerting.

LibreNMS Inbound interface errors too

Wed, Mar 17, 7:33 AM · User-fgiunchedi, observability
ayounsi created T277634: elastic1062 interface errors.
Wed, Mar 17, 7:07 AM · SRE, ops-eqiad
ayounsi created T277633: analytics1063 interface errors.
Wed, Mar 17, 7:00 AM · SRE, ops-eqiad

Tue, Mar 16

ayounsi closed T277006: Remove servers interface names from switches interfaces descriptions as Resolved.

All done!

Tue, Mar 16, 8:54 PM · SRE, homer, netops, DC-Ops
ayounsi added a comment to T277341: (Need By: TBD) install MPC7E-MRATE FPC into cr[12]-codfw.

Those are hot swap-able, so then can be installed anytime.

Tue, Mar 16, 8:54 PM · SRE, ops-codfw, DC-Ops
ayounsi reassigned T277339: (Need By: TBD) rack/setup/install new linecards into routers from ayounsi to Cmjohnson.
Tue, Mar 16, 8:52 PM · SRE, ops-eqiad, DC-Ops
ayounsi added a comment to T277339: (Need By: TBD) rack/setup/install new linecards into routers.

Those are hot swap-able, so it can be installed anytime.

Tue, Mar 16, 8:51 PM · SRE, ops-eqiad, DC-Ops
ayounsi closed T174203: Investigate decommissioning two eqiad-frack vlans as Resolved.

And fully removed from pfw/fasw-eqiad

Tue, Mar 16, 8:25 PM · fundraising-tech-ops
ayounsi added a comment to T174203: Investigate decommissioning two eqiad-frack vlans.

From Netbox:

Deleted prefix 10.64.40.128/27
Deleted vlan frack-DMZ1-c-eqiad

Tue, Mar 16, 8:16 PM · fundraising-tech-ops
ayounsi closed Restricted Task, a subtask of T255435: Reconfigure fundraising public-reporting server role to fundraising-data, as Resolved.
Tue, Mar 16, 7:55 PM · Patch-For-Review, fundraising-tech-ops
ayounsi added a comment to T272688: Validate (and document) Homer config files.

Relevant: https://www.ipspace.net/kb/DataModels/70-Validation.html

Tue, Mar 16, 11:41 AM · Patch-For-Review, SRE-tools, homer

Mon, Mar 15

ayounsi triaged T277440: Add CI to homer-deploy repo as Medium priority.
Mon, Mar 15, 9:16 AM · SRE-tools, homer
ayounsi committed rOSHP759f82c8d5ec: Remove servers interface names from switches interfaces descriptions (authored by ayounsi).
Remove servers interface names from switches interfaces descriptions
Mon, Mar 15, 9:15 AM
ayounsi triaged T277438: Move management routers ssh port as Low priority.
Mon, Mar 15, 8:54 AM · SRE, netops
ayounsi triaged T277437: Broken kibana dashboard as High priority.
Mon, Mar 15, 8:39 AM · observability
ayounsi added a comment to T277340: (Need By: TBD) rack/setup/install (2) new 10G switches.

The original plan was to retrofit two existing 1G racks to 10G as a quick fix for the existing contention. The downside is that the migration from 1G to 10G means a rack downtime the time we replace the ToR switch.

Mon, Mar 15, 8:26 AM · SRE, ops-eqiad, DC-Ops

Mar 12 2021

ayounsi added a comment to T277020: cloudgw eqiad1: review & allocate subnets and VLANs.

OK, let's be conservative with v4 IPs, I reserved https://netbox.wikimedia.org/ipam/prefixes/393/ and matching vlan https://netbox.wikimedia.org/ipam/vlans/149/

Mar 12 2021, 2:01 PM · netops, SRE, cloud-services-team (Kanban)
ayounsi added a comment to T277020: cloudgw eqiad1: review & allocate subnets and VLANs.

cloudgw <-> neutron: vlan 1107 (cloud-gw-transport-eqiad) 185.15.56.224/29 (new allocation, not registered on netbox yet)

How many IPs do you need in that vlan? (/29 is 6 usable IPs, /30 is 2)

Mar 12 2021, 10:33 AM · netops, SRE, cloud-services-team (Kanban)

Mar 11 2021

ayounsi triaged T277146: Authoritative ports list as Low priority.
Mar 11 2021, 10:11 AM · Patch-For-Review, SRE, netops

Mar 10 2021

ayounsi added a comment to T277042: Netbox: remove template images.

Makes sens to me, thanks!

Mar 10 2021, 3:08 PM · DC-Ops, netbox
ayounsi triaged T277006: Remove servers interface names from switches interfaces descriptions as Medium priority.
Mar 10 2021, 7:14 AM · SRE, homer, netops, DC-Ops

Mar 8 2021

ayounsi triaged T276743: ps1-a7-eqiad power over threshold alerts as Low priority.
Mar 8 2021, 6:52 AM · SRE, ops-eqiad, DC-Ops

Feb 27 2021

ayounsi added a comment to T273716: Improve Alertmanager/LibreNMS notifications.

Another one:

<+jinxer-wm> (Processor usage over 85%) firing: Processor usage over 85% - https://alerts.wikimedia.org
04:58 (Processor usage over 85%) resolved: Processor usage over 85% - https://alerts.wikimedia.org

Doesn't say which host it's for.

Feb 27 2021, 8:05 AM · Patch-For-Review, observability

Feb 24 2021

ayounsi committed rOHPU9f1b5725aa4c: Prevent LAG members to be configured as OSPF neighbors (authored by ayounsi).
Prevent LAG members to be configured as OSPF neighbors
Feb 24 2021, 7:19 PM
ayounsi committed rOHPU4ff428812e5a: Make sure to only apply OSPF on end to end circuits (authored by ayounsi).
Make sure to only apply OSPF on end to end circuits
Feb 24 2021, 6:34 PM
ayounsi added a comment to T267927: Reload wikidata journal from fresh dumps.

Thanks, thinking a bit more about it, it might be better to put whatever blocks those reloads in Puppet behind a Hiera option. So puppet can stay enabled while not interfering with those actions.

Feb 24 2021, 2:02 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service
ayounsi added a comment to T274459: Eqiad: 2 VM request for GitLab.

Would be better to have a (Wiki/Google) doc to discuss those details, but here we go in the meantime.

Feb 24 2021, 10:04 AM · GitLab (Initialization), Patch-For-Review, User-brennen, vm-requests, SRE
ayounsi added a comment to T267927: Reload wikidata journal from fresh dumps.

The last Puppet run was at Tue Feb 16 13:22:35 UTC 2021 (11219 minutes ago). Puppet is disabled. T267927: Reload wikidata jnl from fresh dumps - gehel@cumin2001 - T267927

Feb 24 2021, 8:26 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Feb 23 2021

ayounsi closed T264300: active/active links monitoring as Resolved.

I created a LibreNMS traffic bill which already have alerting: https://librenms.wikimedia.org/bill/bill_id=24/ The particularity is that it alerts at the 95th percentile, which fits this usecase.

Feb 23 2021, 7:03 PM · observability, SRE, netops
ayounsi closed T269738: Upgrade Routinator 3000 to 0.8.2 as Resolved.
Feb 23 2021, 6:59 PM · SRE, netops
ayounsi added a comment to T249607: Kibana naming convention.

I think it makes sens!

Feb 23 2021, 5:38 PM · observability
ayounsi closed T275241: Eqiad: Port with no description xe-4/0/24 xe-4/0/3 as Resolved.

Indeed!
Looks like a LibreNMS "bug", it knows the interface got deleted because it was in https://librenms.wikimedia.org/ports/deleted=yes but it got removed faster than it took to set it as disabled/gone.

Feb 23 2021, 5:34 PM · SRE, ops-eqiad
ayounsi updated the task description for T275476: Upgrade af-netbox to 2.10.
Feb 23 2021, 9:03 AM · netbox
ayounsi created T275476: Upgrade af-netbox to 2.10.
Feb 23 2021, 9:03 AM · netbox

Feb 22 2021

ayounsi added a comment to T274488: ms-be1034 not powering on.

Changed its Netbox status to failed so the Netbox report doesn't alert.

Feb 22 2021, 8:18 AM · User-fgiunchedi, SRE, ops-eqiad
ayounsi reopened T273984: eqiad: Move logstash1020 to rack A8 as "Open".

The last Puppet run was at Mon Feb 8 14:16:19 UTC 2021 (19799 minutes ago). Puppet is disabled. disabled for re-racking T273984 --herron

Feb 22 2021, 8:17 AM · SRE, observability, ops-eqiad

Feb 21 2021

ayounsi added a comment to T265084: Upgrade Netbox to 2.10.

So we don't forget, https://github.com/netbox-community/netbox/issues/609 got introduced with Netbox 2.10.

Feb 21 2021, 8:33 PM · Patch-For-Review, netbox