Page MenuHomePhabricator
Create Task
Maniphest T388641

Migrate network icinga alerts to gNMI/prometheus
Open, Stalled, LowPublic
Actions

Assigned To
ayounsi
Authored By
ayounsi
Mar 12 2025, 10:46 AM
Tags
Referenced Files
F59060575: Screenshot 2025-04-14 at 12-09-27 gNMIc - Drafts - Dashboards - Grafana.png
Apr 14 2025, 10:10 AM
F59059830: Screenshot 2025-04-14 at 08-48-10 Explore - thanos - Grafana.png
Apr 14 2025, 6:50 AM
F59013484: gaps_grafana.png
Apr 8 2025, 9:46 AM
F59013476: image.png
Apr 8 2025, 9:46 AM
F58951374: Screenshot From 2025-03-31 11-31-19.png
Mar 31 2025, 9:32 AM
Subscribers
Aklapper
ayounsi
cmooney
fgiunchedi

Description

The current alerts are defined in https://github.com/wikimedia/operations-puppet/blob/production/modules/netops/manifests/monitoring.pp
Checks are listed in https://github.com/wikimedia/operations-puppet/blob/production/modules/netops/manifests/check.pp

  • Juniper alarms
  • Router interfaces
  • BGP status
  • Juniper virtual chassis ports
  • VRRP status
  • BFD status
  • OSPF status

VRRP might not be needed to port over as we're progressively decommissioning it.
Our Virtual Chassis don't support gNMI

BGP is being taken care of with https://gerrit.wikimedia.org/r/c/operations/alerts/+/1126030

Router interfaces current issue : T388642: gnmi_interfaces_interface_state_oper_status missing from most devices

Alarms
https://gerrit.wikimedia.org/r/c/operations/puppet/+/1131306/2

BFD
requires devices upgrades (T388641#10677414)
https://gerrit.wikimedia.org/r/c/operations/puppet/+/1131320

OSPF
requires devices upgrades (T388641#10677414).
Limited number of exposed metrics : T388641#10743419

Ideally (and like we currently do) we should not alert on the upper layer is having an issue if the lower layer is already alerting. For example if BFD is alerting, don't alert for OSPF as well.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
gnmic: Adjust BGP collection for Nokia compatibilityoperations/puppetproduction+11 -3
Promote the TransitPeeringIn/OutSaturation alerts to p.agingoperations/alertsmaster+8 -8
Netops: remove check_bgpoperations/puppetproduction+4 -380
alertmanager: route network devices alerts to froperations/puppetproduction+7 -0
team-wmcs: Add host-bound alerts for BGP sessionsoperations/alertsmaster+47 -0
gNMI: bump number of workers to 32operations/puppetproduction+1 -1
Add alerting for gNMIc Go routinesoperations/alertsmaster+31 -2
gNMI: add target down alertingoperations/alertsmaster+41 -0
Prometheus: gnmic_target_up rewrite name to instanceoperations/puppetproduction+3 -0
Disable pint alerting for OutboundInterfaceErrorsoperations/alertsmaster+2 -0
Add alerting for long peering BGP downoperations/alertsmaster+39 -2
Icinga: remove some network devices checksoperations/puppetproduction+0 -5
Add alerting for idle peering BGP sessionsoperations/alertsmaster+31 -0
Interfaces: also alert on frack routers and switchesoperations/alertsmaster+4 -4
Disable pint alerting for SwitchCoreInterfaceDownoperations/alertsmaster+3 -0
Add alerting for important switch interfacesoperations/alertsmaster+35 -1
BFDdown: don't deploy in codfwoperations/alertsmaster+1 -0
InboundInterfaceErrors: disable pintoperations/alertsmaster+2 -0
Bump TransitPeering in/out Saturation to criticaloperations/alertsmaster+4 -4
Enable PfwCoreBGPDown in codfwoperations/alertsmaster+1 -1
Add alerting for eqiad pfw BGP core sessionsoperations/alertsmaster+45 -0
Remove Turnilo dependency on netops:monitoringoperations/puppetproduction+13 -31
gNMIc: collect optics status on Juniperoperations/puppetproduction+10 -0
gNMIc: collect transceivers statesoperations/puppetproduction+7 -0
Add CPU/RAM/DISKoperations/puppetproduction+11 -0
gnmic: bump num-workers to 24operations/puppetproduction+1 -1
Add BFD down alertingoperations/alertsmaster+42 -0
gNMIc: bump num-workers to 16operations/puppetproduction+1 -1
gNMIc set retry to 5 minuteoperations/puppetproduction+1 -0
alertmanager: open dcops tasks with title as summaryoperations/puppetproduction+21 -32
gNMIc: collect BFD statesoperations/puppetproduction+60 -0
Fix TransitPeering[In|Out]boundSaturationoperations/alertsmaster+4 -4
alertmanager: fixup #2 dcops-task-network receiveroperations/puppetproduction+2 -2
alertmanager: fixup dcops-task-network task titleoperations/puppetproduction+1 -1
Make the interface error alert less sensitiveoperations/alertsmaster+7 -7
Add alerts for network alarmsoperations/alertsmaster+45 -0
alertmanager: test per-summary tasks for network alertsoperations/puppetproduction+12 -0
CloudCoreBGPDown: set severity to critical + scope networkoperations/alertsmaster+6 -4
gNMIc: subscribe to alerts statesoperations/puppetproduction+7 -0
Duplicate LibreNMS In/out interface errorsoperations/alertsmaster+57 -1
Add Prometheus alert for router interfaces statesoperations/alertsmaster+46 -0
Split the cloudsw alerts to their own filesoperations/alertsmaster+43 -28
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
cmooney added a comment.EditedApr 9 2025, 4:46 PM

@ayounsi similar to Fillipos graph I put this dashboard together using the approach I had earlier, basically graphing the number of metrics in a given series (chose ifInOctets) over every 60min window. Seems to show that we have never quite had things perfect in eqiad the way they are at pops, but it definitely got worse last week:

https://grafana.wikimedia.org/goto/Mtx1oAANg

ayounsi added a comment.Apr 14 2025, 6:50 AM

Thanks! Based on this comment : https://github.com/openconfig/gnmic/issues/498#issuecomment-2263694440
I graphed our Go routines : https://grafana.wikimedia.org/goto/QYSeH90Ng?orgId=1

Screenshot 2025-04-14 at 08-48-10 Explore - thanos - Grafana.png (1×2 px, 258 KB)

We might have a smoking gun :)

So I suggest we test an increase of num-workers from 8 to 12 (https://github.com/wikimedia/operations-puppet/blob/production/hieradata/common/profile/gnmi_telemetry.yaml#L28C5-L28C16) and see how it impacts the number of go_routines and the actual gaps. We might also need to increase the number of cores of the VM.

Stashbot added a comment.Apr 14 2025, 7:53 AM

Mentioned in SAL (#wikimedia-operations) [2025-04-14T07:53:03Z] <XioNoX> gnmic: bump num-workers to 12 on netflow1002 - T388641

Stashbot added a comment.Apr 14 2025, 9:00 AM

Mentioned in SAL (#wikimedia-operations) [2025-04-14T09:00:31Z] <XioNoX> gnmic: bump num-workers to 16 on netflow1002 - T388641

ayounsi added a comment.Apr 14 2025, 10:10 AM

Bumping to 12 didn't have the expected result, but to 16 seems to have solved the immediate issue.

Screenshot 2025-04-14 at 12-09-27 gNMIc - Drafts - Dashboards - Grafana.png (220×973 px, 22 KB)

There is still work to be done to fully understand the relationship between those knobs.

gerritbot added a comment.Apr 14 2025, 10:12 AM

Change #1136341 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] gNMIc: bump num-workers to 16

https://gerrit.wikimedia.org/r/1136341

gerritbot added a comment.Apr 14 2025, 10:27 AM

Change #1136341 merged by Ayounsi:

[operations/puppet@production] gNMIc: bump num-workers to 16

https://gerrit.wikimedia.org/r/1136341

gerritbot added a comment.Apr 15 2025, 8:36 AM

Change #1134664 merged by jenkins-bot:

[operations/alerts@master] Add BFD down alerting

https://gerrit.wikimedia.org/r/1134664

Maintenance_bot removed a project: Patch-For-Review.Apr 15 2025, 9:30 AM
gerritbot added a comment.Apr 15 2025, 12:13 PM

Change #1136704 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] gnmic: bump num-workers to 24

https://gerrit.wikimedia.org/r/1136704

gerritbot added a project: Patch-For-Review.Apr 15 2025, 12:13 PM
gerritbot added a comment.Apr 15 2025, 12:19 PM

Change #1136704 merged by Ayounsi:

[operations/puppet@production] gnmic: bump num-workers to 24

https://gerrit.wikimedia.org/r/1136704

Maintenance_bot removed a project: Patch-For-Review.Apr 15 2025, 12:31 PM
ayounsi added a comment.EditedApr 15 2025, 12:41 PM

For OSPF it looks like the interface states are there, but not the neighbor states:

P75019 gnmi ospf metrics
1# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_enable_bfd_state_enabled gNMIc generated metric
2# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_enable_bfd_state_enabled untyped
3gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_enable_bfd_state_enabled{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
4gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_enable_bfd_state_enabled{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
5# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_enabled gNMIc generated metric
6# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_enabled untyped
7gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_enabled{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
8gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_enabled{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
9# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_post_session_up_delay gNMIc generated metric
10# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_post_session_up_delay untyped
11gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_post_session_up_delay{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
12gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_post_session_up_delay{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
13# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_synchronized gNMIc generated metric
14# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_synchronized untyped
15gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_synchronized{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
16gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_igp_ldp_sync_state_synchronized{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
17# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_state_traffic_engineering_metric gNMIc generated metric
18# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_state_traffic_engineering_metric untyped
19gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_state_traffic_engineering_metric{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 10
20gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_mpls_state_traffic_engineering_metric{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 100
21# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_metric gNMIc generated metric
22# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_metric untyped
23gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_metric{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 10
24gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_metric{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 100
25# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_passive gNMIc generated metric
26# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_passive untyped
27gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_passive{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
28gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_passive{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 0
29# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_priority gNMIc generated metric
30# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_priority untyped
31gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_priority{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 128
32gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_state_priority{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 128
33# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_dead_interval gNMIc generated metric
34# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_dead_interval untyped
35gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_dead_interval{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 40
36gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_dead_interval{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 40
37# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_hello_interval gNMIc generated metric
38# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_hello_interval untyped
39gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_hello_interval{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 10
40gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_hello_interval{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 10
41# HELP gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_retransmission_interval gNMIc generated metric
42# TYPE gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_retransmission_interval untyped
43gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_retransmission_interval{area_identifier="0.0.0.0",interface_id="ae0.2",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 5
44gnmi_network_instances_network_instance_protocols_protocol_ospfv2_areas_area_interfaces_interface_timers_state_retransmission_interval{area_identifier="0.0.0.0",interface_id="et-0/0/0.0",network_instance_name="DEFAULT",protocol_identifier="OSPF",protocol_name="DEFAULT",source="cr4-ulsfo.wikimedia.org:32767"} 5

That's subscribing to /network-instances/network-instance/protocols/protocol/ospfv2.
Trying to target more specific paths like /network-instances/network-instance/protocols/protocol/ospfv2/areas/area/interfaces/interface/neighbors/neighbor/state/metric doesn't work neither.
That's on cr4-ulsfo, but the same on cr1-eqiad, both running junos 23.4.

Even though it's supposed to be there: https://apps.juniper.net/ydm-explorer/select-software?software=Junos%20OS&release=23.2R1&moduleId=All&datamodel=OpenConfig&filter=Unsupported&platform=all&tagId=847357&tagName=adjacency-state

gerritbot added a comment.Apr 15 2025, 1:04 PM

Change #1136717 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Add CPU/RAM/DISK

https://gerrit.wikimedia.org/r/1136717

gerritbot added a project: Patch-For-Review.Apr 15 2025, 1:04 PM
ayounsi updated the task description. (Show Details)Apr 15 2025, 1:04 PM
gerritbot added a comment.Apr 15 2025, 1:40 PM

Change #1136717 merged by Ayounsi:

[operations/puppet@production] Add CPU/RAM/DISK

https://gerrit.wikimedia.org/r/1136717

Maintenance_bot removed a project: Patch-For-Review.Apr 15 2025, 2:31 PM
gerritbot added a comment.Apr 28 2025, 8:01 AM

Change #1139410 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] gNMIc: collect transceivers states

https://gerrit.wikimedia.org/r/1139410

gerritbot added a project: Patch-For-Review.Apr 28 2025, 8:01 AM
ayounsi added a comment.Apr 28 2025, 10:09 AM

Another oddity is that subscribing to /components/component/transceiver/physical-channels/channel/state also returns all the data from /components/component/transceiver/state not a blocker, but adds some unnecessary load on the systems.

ayounsi added a comment.May 2 2025, 8:49 AM

a (better for now) alternative to /components/ is to use Juniper's /junos/system/linecard/optics/

Better because the components elements return a physical port name (Port0), and not the Junos standard interface name (xe-0/0/0) while the latter does.

Here is the full list of returned data for cr4-ulsfo (~600 metrics). We in theory don't need them all but I haven't found the way to cherry-pick them at the gNMI level, we could filter them out before exposing some to Prometheus.
Note that also despite subscribing to /junos/system/linecard/optics/ the returned metrics are in the /interfaces/interface/ realm.

P75735 gnmi junos optics metrics
1# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current gNMIc generated metric
2# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current untyped
3gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 45.534000396728516
4gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 43.60499954223633
5gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 43.520999908447266
6gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 43.520999908447266
7gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 36.07600021362305
8gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 35.69200134277344
9gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 28.9689998626709
10gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 37.20000076293945
11gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 36.900001525878906
12gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 39.236000061035156
13gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 38.5260009765625
14gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
15gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 42.84400177001953
16gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
17gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
18gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 36.75
19# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm gNMIc generated metric
20# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm untyped
21gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
22gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
23gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
24gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
25gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
26gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
27gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
28gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
29gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
30gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
31gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
32gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
33gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
34gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
35gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
36gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
37# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning gNMIc generated metric
38# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning untyped
39gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
40gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
41gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
42gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
43gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
44gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
45gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
46gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
47gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
48gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
49gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
50gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
51gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
52gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
53gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
54gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_high_warning{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
55# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm gNMIc generated metric
56# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm untyped
57gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
58gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
59gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
60gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
61gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
62gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
63gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
64gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
65gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
66gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
67gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
68gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
69gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
70gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
71gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
72gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
73# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning gNMIc generated metric
74# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning untyped
75gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
76gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
77gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
78gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
79gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
80gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
81gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
82gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
83gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
84gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
85gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
86gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
87gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
88gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
89gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
90gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_bias_current_low_warning{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
91# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm gNMIc generated metric
92# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm untyped
93gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -1.0248351097106934
94gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} -0.2724224328994751
95gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0.8710687756538391
96gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} -0.44168412685394287
97gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1.9476364850997925
98gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 1.8534339666366577
99gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 1.7443771362304688
100gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 2.7237558364868164
101gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -2.365719795227051
102gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -1.51195228099823
103gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -1.732773780822754
104gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -Inf
105gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -1.4935368299484253
106gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -Inf
107gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -Inf
108gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_dbm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -1.1182057857513428
109# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm gNMIc generated metric
110# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm untyped
111gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
112gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
113gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
114gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
115gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
116gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
117gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
118gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
119gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
120gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
121gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
122gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
123gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
124gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
125gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
126gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
127# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning gNMIc generated metric
128# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning untyped
129gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
130gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
131gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
132gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
133gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
134gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
135gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
136gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
137gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
138gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
139gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
140gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
141gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
142gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
143gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
144gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_high_warning{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
145# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm gNMIc generated metric
146# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm untyped
147gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
148gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
149gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
150gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
151gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
152gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
153gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
154gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
155gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
156gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
157gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
158gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
159gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
160gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
161gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
162gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
163# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning gNMIc generated metric
164# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning untyped
165gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
166gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
167gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
168gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
169gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
170gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
171gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
172gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
173gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
174gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
175gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
176gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
177gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
178gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
179gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
180gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_output_power_low_warning{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
181# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm gNMIc generated metric
182# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm untyped
183gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0.329404354095459
184gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0.5227060914039612
185gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0.667358934879303
186gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0.25223788619041443
187gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0.8550443649291992
188gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} -0.47934412956237793
189gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} -1.5168756246566772
190gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0.4091816842556
191gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -5.158426284790039
192gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -4.299241065979004
193gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -4.263161659240723
194gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -40
195gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -2.48336124420166
196gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -Inf
197gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -Inf
198gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_dbm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} -12.494915962219238
199# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm gNMIc generated metric
200# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm untyped
201gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
202gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
203gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
204gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
205gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
206gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
207gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
208gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
209gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
210gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
211gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
212gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
213gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
214gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
215gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
216gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
217# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning gNMIc generated metric
218# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning untyped
219gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
220gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
221gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
222gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
223gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
224gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
225gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
226gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
227gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
228gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
229gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
230gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
231gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
232gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
233gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
234gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_high_warning{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
235# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm gNMIc generated metric
236# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm untyped
237gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
238gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
239gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
240gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
241gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
242gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
243gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
244gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
245gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
246gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
247gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
248gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
249gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
250gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
251gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
252gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
253# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning gNMIc generated metric
254# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning untyped
255gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
256gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
257gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
258gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
259gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
260gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
261gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
262gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
263gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
264gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
265gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
266gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
267gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
268gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
269gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 1
270gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_receiver_power_low_warning{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
271# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature gNMIc generated metric
272# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature untyped
273gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 30.327999114990234
274gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 30.327999114990234
275gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 30.327999114990234
276gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 30.327999114990234
277gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 30.16699981689453
278gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 30.16699981689453
279gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 30.16699981689453
280gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 30.16699981689453
281gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 32.066001892089844
282gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 34.04600143432617
283gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 36.3120002746582
284gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 34.584999084472656
285gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 36.59299850463867
286gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 32.97999954223633
287gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 30.468000411987305
288gnmi_interfaces_interface_optics_lanediags_lane_lane_laser_temperature{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 33.737998962402344
289# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm gNMIc generated metric
290# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm untyped
291gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
292gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
293gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
294gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
295gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
296gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
297gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
298gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
299gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
300gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
301gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
302gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
303gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
304gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
305gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
306gnmi_interfaces_interface_optics_lanediags_lane_lane_rx_loss_of_signal_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
307# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm gNMIc generated metric
308# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm untyped
309gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
310gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
311gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
312gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
313gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
314gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
315gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
316gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
317gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
318gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
319gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
320gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
321gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
322gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
323gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
324gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_laser_disabled_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
325# HELP gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm gNMIc generated metric
326# TYPE gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm untyped
327gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="et-0/0/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
328gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="et-0/0/0",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
329gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="et-0/0/0",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
330gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="et-0/0/0",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
331gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="et-0/0/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
332gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="et-0/0/1",lane_lane_number="1",source="cr4-ulsfo.wikimedia.org:32767"} 0
333gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="et-0/0/1",lane_lane_number="2",source="cr4-ulsfo.wikimedia.org:32767"} 0
334gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="et-0/0/1",lane_lane_number="3",source="cr4-ulsfo.wikimedia.org:32767"} 0
335gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="xe-0/1/0",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
336gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="xe-0/1/1",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
337gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="xe-0/1/2",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
338gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="xe-0/1/3",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
339gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="xe-0/1/4",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
340gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="xe-0/1/5",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
341gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="xe-0/1/6",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
342gnmi_interfaces_interface_optics_lanediags_lane_lane_tx_loss_of_signal_alarm{interface_name="xe-0/1/7",lane_lane_number="0",source="cr4-ulsfo.wikimedia.org:32767"} 0
343# HELP gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold gNMIc generated metric
344# TYPE gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold untyped
345gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 110
346gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 105
347gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 110
348gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 85
349gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 85
350gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 85
351gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 85
352gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 85
353gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 85
354gnmi_interfaces_interface_optics_laser_bias_current_high_alarm_threshold{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 110
355# HELP gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold gNMIc generated metric
356# TYPE gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold untyped
357gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 100
358gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 105
359gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 100
360gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 80
361gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 80
362gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 80
363gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 80
364gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 80
365gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 80
366gnmi_interfaces_interface_optics_laser_bias_current_high_warning_threshold{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 100
367# HELP gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold gNMIc generated metric
368# TYPE gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold untyped
369gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 5
370gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 8
371gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 1
372gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 15
373gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 15
374gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 15
375gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 15
376gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 15
377gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 15
378gnmi_interfaces_interface_optics_laser_bias_current_low_alarm_threshold{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 1
379# HELP gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold gNMIc generated metric
380# TYPE gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold untyped
381gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 10
382gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 10
383gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 1
384gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 20
385gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 20
386gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 20
387gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 20
388gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 20
389gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 20
390gnmi_interfaces_interface_optics_laser_bias_current_low_warning_threshold{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 1
391# HELP gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm gNMIc generated metric
392# TYPE gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm untyped
393gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 5.5
394gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 7.300000190734863
395gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 3.5
396gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 2
397gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 2
398gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 2
399gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 2
400gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 2
401gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 2
402gnmi_interfaces_interface_optics_laser_output_power_high_alarm_threshold_dbm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 3.5
403# HELP gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm gNMIc generated metric
404# TYPE gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm untyped
405gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 4.5
406gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 5
407gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
408gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 1
409gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 1
410gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 1
411gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 1
412gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 1
413gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 1
414gnmi_interfaces_interface_optics_laser_output_power_high_warning_threshold_dbm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
415# HELP gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm gNMIc generated metric
416# TYPE gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm untyped
417gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} -7.5
418gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} -11
419gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} -10.220000267028809
420gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} -8.010000228881836
421gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} -8.010000228881836
422gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} -8.010000228881836
423gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} -8.010000228881836
424gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} -8.010000228881836
425gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} -8.010000228881836
426gnmi_interfaces_interface_optics_laser_output_power_low_alarm_threshold_dbm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} -10.220000267028809
427# HELP gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm gNMIc generated metric
428# TYPE gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm untyped
429gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} -6.5
430gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} -7
431gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} -8.210000038146973
432gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} -7.010000228881836
433gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} -7.010000228881836
434gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} -7.010000228881836
435gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} -7.010000228881836
436gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} -7.010000228881836
437gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} -7.010000228881836
438gnmi_interfaces_interface_optics_laser_output_power_low_warning_threshold_dbm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} -8.210000038146973
439# HELP gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm gNMIc generated metric
440# TYPE gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm untyped
441gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 5.5
442gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 6.5
443gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 3.5
444gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
445gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
446gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
447gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
448gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
449gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
450gnmi_interfaces_interface_optics_laser_rx_power_high_alarm_threshold_dbm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 3.5
451# HELP gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm gNMIc generated metric
452# TYPE gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm untyped
453gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 4.5
454gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 5.5
455gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
456gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 2
457gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 2
458gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 2
459gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 2
460gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 2
461gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 2
462gnmi_interfaces_interface_optics_laser_rx_power_high_warning_threshold_dbm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 2.5
463# HELP gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm gNMIc generated metric
464# TYPE gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm untyped
465gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} -13
466gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} -16
467gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} -16.399999618530273
468gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} -20
469gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} -20
470gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} -20
471gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} -20
472gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} -20
473gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} -20
474gnmi_interfaces_interface_optics_laser_rx_power_low_alarm_threshold_dbm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} -16.399999618530273
475# HELP gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm gNMIc generated metric
476# TYPE gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm untyped
477gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} -12
478gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} -12.010000228881836
479gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} -14.399999618530273
480gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} -18.010000228881836
481gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} -18.010000228881836
482gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} -18.010000228881836
483gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} -18.010000228881836
484gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} -18.010000228881836
485gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} -18.010000228881836
486gnmi_interfaces_interface_optics_laser_rx_power_low_warning_threshold_dbm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} -14.399999618530273
487# HELP gnmi_interfaces_interface_optics_module_temp gNMIc generated metric
488# TYPE gnmi_interfaces_interface_optics_module_temp untyped
489gnmi_interfaces_interface_optics_module_temp{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 30.327999114990234
490gnmi_interfaces_interface_optics_module_temp{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 30.16699981689453
491gnmi_interfaces_interface_optics_module_temp{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 32.066001892089844
492gnmi_interfaces_interface_optics_module_temp{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 34.04600143432617
493gnmi_interfaces_interface_optics_module_temp{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 36.3120002746582
494gnmi_interfaces_interface_optics_module_temp{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 34.584999084472656
495gnmi_interfaces_interface_optics_module_temp{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 36.59299850463867
496gnmi_interfaces_interface_optics_module_temp{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 32.97999954223633
497gnmi_interfaces_interface_optics_module_temp{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 30.468000411987305
498gnmi_interfaces_interface_optics_module_temp{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 33.737998962402344
499# HELP gnmi_interfaces_interface_optics_module_temp_high_alarm gNMIc generated metric
500# TYPE gnmi_interfaces_interface_optics_module_temp_high_alarm untyped
501gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
502gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
503gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
504gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
505gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 0
506gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 0
507gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 0
508gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 0
509gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 0
510gnmi_interfaces_interface_optics_module_temp_high_alarm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 0
511# HELP gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold gNMIc generated metric
512# TYPE gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold untyped
513gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 75
514gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 78
515gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 100
516gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 78
517gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 78
518gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 78
519gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 78
520gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 78
521gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 78
522gnmi_interfaces_interface_optics_module_temp_high_alarm_threshold{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 100
523# HELP gnmi_interfaces_interface_optics_module_temp_high_warning gNMIc generated metric
524# TYPE gnmi_interfaces_interface_optics_module_temp_high_warning untyped
525gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
526gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
527gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
528gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
529gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 0
530gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 0
531gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 0
532gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 0
533gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 0
534gnmi_interfaces_interface_optics_module_temp_high_warning{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 0
535# HELP gnmi_interfaces_interface_optics_module_temp_high_warning_threshold gNMIc generated metric
536# TYPE gnmi_interfaces_interface_optics_module_temp_high_warning_threshold untyped
537gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 70
538gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 75
539gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 85
540gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 73
541gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 73
542gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 73
543gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 73
544gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 73
545gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 73
546gnmi_interfaces_interface_optics_module_temp_high_warning_threshold{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 85
547# HELP gnmi_interfaces_interface_optics_module_temp_low_alarm gNMIc generated metric
548# TYPE gnmi_interfaces_interface_optics_module_temp_low_alarm untyped
549gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
550gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
551gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
552gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
553gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 0
554gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 0
555gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 0
556gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 0
557gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 0
558gnmi_interfaces_interface_optics_module_temp_low_alarm{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 0
559# HELP gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold gNMIc generated metric
560# TYPE gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold untyped
561gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} -5
562gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} -5
563gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} -50
564gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} -13
565gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} -13
566gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} -13
567gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} -13
568gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} -13
569gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} -13
570gnmi_interfaces_interface_optics_module_temp_low_alarm_threshold{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} -50
571# HELP gnmi_interfaces_interface_optics_module_temp_low_warning gNMIc generated metric
572# TYPE gnmi_interfaces_interface_optics_module_temp_low_warning untyped
573gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
574gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
575gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
576gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
577gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 0
578gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 0
579gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 0
580gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 0
581gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 0
582gnmi_interfaces_interface_optics_module_temp_low_warning{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 0
583# HELP gnmi_interfaces_interface_optics_module_temp_low_warning_threshold gNMIc generated metric
584# TYPE gnmi_interfaces_interface_optics_module_temp_low_warning_threshold untyped
585gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 0
586gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 0
587gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} -40
588gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} -8
589gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} -8
590gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} -8
591gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} -8
592gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} -8
593gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} -8
594gnmi_interfaces_interface_optics_module_temp_low_warning_threshold{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} -40
595# HELP gnmi_interfaces_interface_optics_optics_type gNMIc generated metric
596# TYPE gnmi_interfaces_interface_optics_optics_type untyped
597gnmi_interfaces_interface_optics_optics_type{interface_name="et-0/0/0",source="cr4-ulsfo.wikimedia.org:32767"} 32
598gnmi_interfaces_interface_optics_optics_type{interface_name="et-0/0/1",source="cr4-ulsfo.wikimedia.org:32767"} 32
599gnmi_interfaces_interface_optics_optics_type{interface_name="xe-0/1/0",source="cr4-ulsfo.wikimedia.org:32767"} 8
600gnmi_interfaces_interface_optics_optics_type{interface_name="xe-0/1/1",source="cr4-ulsfo.wikimedia.org:32767"} 8
601gnmi_interfaces_interface_optics_optics_type{interface_name="xe-0/1/2",source="cr4-ulsfo.wikimedia.org:32767"} 8
602gnmi_interfaces_interface_optics_optics_type{interface_name="xe-0/1/3",source="cr4-ulsfo.wikimedia.org:32767"} 8
603gnmi_interfaces_interface_optics_optics_type{interface_name="xe-0/1/4",source="cr4-ulsfo.wikimedia.org:32767"} 8
604gnmi_interfaces_interface_optics_optics_type{interface_name="xe-0/1/5",source="cr4-ulsfo.wikimedia.org:32767"} 8
605gnmi_interfaces_interface_optics_optics_type{interface_name="xe-0/1/6",source="cr4-ulsfo.wikimedia.org:32767"} 8
606gnmi_interfaces_interface_optics_optics_type{interface_name="xe-0/1/7",source="cr4-ulsfo.wikimedia.org:32767"} 8

gerritbot added a comment.May 2 2025, 12:10 PM

Change #1140688 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] gNMIc: collect optics status on Juniper

https://gerrit.wikimedia.org/r/1140688

gerritbot added a comment.May 2 2025, 12:10 PM

Change #1139410 abandoned by Ayounsi:

[operations/puppet@production] gNMIc: collect transceivers states

Reason:

I541fc1f5ec0ca88889debe0353487ea1c967cb45

https://gerrit.wikimedia.org/r/1139410

gerritbot added a comment.May 6 2025, 1:00 PM

Change #1140688 merged by Ayounsi:

[operations/puppet@production] gNMIc: collect optics status on Juniper

https://gerrit.wikimedia.org/r/1140688

Maintenance_bot removed a project: Patch-For-Review.May 6 2025, 1:32 PM
gerritbot added a comment.May 12 2025, 7:54 PM

Change #1144644 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Remove Turnilo dependency on netops:monitoring

https://gerrit.wikimedia.org/r/1144644

gerritbot added a project: Patch-For-Review.May 12 2025, 7:54 PM
gerritbot added a comment.May 12 2025, 8:37 PM

Change #1144650 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Icinga: remove some network devices checks

https://gerrit.wikimedia.org/r/1144650

ayounsi changed the status of subtask T390052: Enable gNMI on SRX devices and fasw from Open to Stalled.May 13 2025, 8:46 AM
gerritbot added a comment.May 13 2025, 8:50 AM

Change #1144644 merged by Ayounsi:

[operations/puppet@production] Remove Turnilo dependency on netops:monitoring

https://gerrit.wikimedia.org/r/1144644

gerritbot added a comment.May 13 2025, 9:49 AM

Change #1145115 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Add alerting for eqiad pfw BGP core sessions

https://gerrit.wikimedia.org/r/1145115

gerritbot added a comment.May 13 2025, 11:47 AM

Change #1145169 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):

[operations/puppet@production] alertmanager: route network pfw alerts to fr

https://gerrit.wikimedia.org/r/1145169

gerritbot added a comment.May 13 2025, 12:00 PM

Change #1145115 merged by jenkins-bot:

[operations/alerts@master] Add alerting for eqiad pfw BGP core sessions

https://gerrit.wikimedia.org/r/1145115

gerritbot added a comment.May 13 2025, 1:41 PM

Change #1145199 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Enable PfwCoreBGPDown in codfw

https://gerrit.wikimedia.org/r/1145199

gerritbot added a comment.May 13 2025, 1:49 PM

Change #1145199 merged by jenkins-bot:

[operations/alerts@master] Enable PfwCoreBGPDown in codfw

https://gerrit.wikimedia.org/r/1145199

gerritbot added a comment.May 14 2025, 12:16 PM

Change #1145875 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Bump TransitPeering in/out Saturation to critical

https://gerrit.wikimedia.org/r/1145875

ayounsi added a comment.May 14 2025, 1:23 PM

Opened JTAC case 2025-0514-696857 for the management switches (EX4300)

ayounsi added a comment.May 14 2025, 9:05 PM

No luck:

Thank you for the information provided. As I have verified on the device and in Pathfinder - Feature Explorer, the gRPC telemetry configuration is not compatible with the EX4300-48T model, this is a product limitation gRPC is unsupported freeBSD6 based system, which is why it is not working. These features can be verified at the following link: 
https://apps.juniper.net/feature-explorer/feature/4332?fn=gRPC%20support%20for%20the%20Junos%20Telemetry%20Interface
cmooney added a comment.May 16 2025, 11:18 AM
In T388641#10628908, @gerritbot wrote:

Change #1127041 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Duplicate LibreNMS In/out interface errors

https://gerrit.wikimedia.org/r/1127041

We've been getting AlertLintErrors firing for this one in recent days. Reason is if we don't have errors the series are not generated (afaik), the error is reporting:

prometheus "ops" at http://127.0.0.1:9900/ops doesn't currently have "gnmi_interfaces_interface_state_counters_in_fcs_errors", it was last present 2d17h ago
ayounsi added a comment.May 20 2025, 8:35 AM

It's actually multiple of them:

  • gnmi_bfd_peer_session_state{} missing in codfw, while it used to work until I think the latest restart of gNMIc
  • gnmi_interfaces_interface_state_counters_in_fcs_errors{} missing in eqsin, this could be related to the cr3 upgrade
  • gnmi_interfaces_interface_state_counters_out_errors{} missing in esams, this also could be related to the upgrade
Stashbot added a comment.May 20 2025, 8:36 AM

Mentioned in SAL (#wikimedia-operations) [2025-05-20T08:36:03Z] <XioNoX> restart gnmic in esams - T388641

Stashbot added a comment.May 20 2025, 8:38 AM

Mentioned in SAL (#wikimedia-operations) [2025-05-20T08:38:28Z] <XioNoX> restart gnmic in eqsin - T388641

cmooney added a comment.May 20 2025, 8:48 AM
In T388641#10838021, @ayounsi wrote:
  • gnmi_interfaces_interface_state_counters_in_fcs_errors{} missing in eqsin, this could be related to the cr3 upgrade
  • gnmi_interfaces_interface_state_counters_out_errors{} missing in esams, this also could be related to the upgrade

From previous experience the error stats are only exported if there have actually been errors. So if the box reboots, and there have been no errors, I don't believe it'll export those stats and thus the series will be missing. So I think this is a normal scenario we need to deal with rather than a bug/problem.

  • gnmi_bfd_peer_session_state{} missing in codfw, while it used to work until I think the latest restart of gNMIc

That one confuses me, the BFD session is there all the time.

Stashbot added a comment.May 20 2025, 8:49 AM

Mentioned in SAL (#wikimedia-operations) [2025-05-20T08:49:31Z] <XioNoX> restart gnmic in codfw - T388641

gerritbot added a comment.May 20 2025, 9:18 AM

Change #1148281 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] BFDdown: don't deploy in codfw

https://gerrit.wikimedia.org/r/1148281

ayounsi added a comment.May 20 2025, 9:23 AM

Restarting gNMIc in esams fixed the issue for gnmi_interfaces_interface_state_counters_out_errors{}. It still seems brittle, but at least we have alerting for it.

For BFD, it's because the codfw core routers are running a too old Junos, metrics should start showing up once they get upgraded (T364092).
https://gerrit.wikimedia.org/r/c/operations/alerts/+/1148281 will remove the alerting from codfw. We can revert it after the upgrade.

gerritbot added a comment.May 20 2025, 9:28 AM

Change #1148281 merged by jenkins-bot:

[operations/alerts@master] BFDdown: don't deploy in codfw

https://gerrit.wikimedia.org/r/1148281

gerritbot added a comment.May 20 2025, 9:30 AM

Change #1145875 merged by jenkins-bot:

[operations/alerts@master] Bump TransitPeering in/out Saturation to critical

https://gerrit.wikimedia.org/r/1145875

gerritbot added a comment.May 20 2025, 9:56 AM

Change #1148287 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] InboundInterfaceErrors: disable pint

https://gerrit.wikimedia.org/r/1148287

gerritbot added a comment.May 20 2025, 12:01 PM

Change #1148287 merged by jenkins-bot:

[operations/alerts@master] InboundInterfaceErrors: disable pint

https://gerrit.wikimedia.org/r/1148287

gerritbot added a comment.May 21 2025, 7:52 AM

Change #1148792 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Add alerting for important switch interfaces

https://gerrit.wikimedia.org/r/1148792

ayounsi closed subtask T364092: Upgrade core routers to Junos 23.4R2 as Resolved.May 21 2025, 9:41 AM
gerritbot added a comment.May 21 2025, 9:58 AM

Change #1148792 merged by jenkins-bot:

[operations/alerts@master] Add alerting for important switch interfaces

https://gerrit.wikimedia.org/r/1148792

gerritbot added a comment.May 21 2025, 12:26 PM

Change #1148849 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Disable pint alerting for SwitchCoreInterfaceDown

https://gerrit.wikimedia.org/r/1148849

gerritbot added a comment.May 21 2025, 1:09 PM

Change #1148849 merged by jenkins-bot:

[operations/alerts@master] Disable pint alerting for SwitchCoreInterfaceDown

https://gerrit.wikimedia.org/r/1148849

gerritbot added a comment.May 21 2025, 2:36 PM

Change #1148891 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Netops: remove check_bgp

https://gerrit.wikimedia.org/r/1148891

gerritbot added a comment.May 26 2025, 1:48 PM

Change #1150692 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Interfaces: also alert on frack routers and switches

https://gerrit.wikimedia.org/r/1150692

gerritbot added a comment.May 27 2025, 6:40 AM

Change #1150692 merged by jenkins-bot:

[operations/alerts@master] Interfaces: also alert on frack routers and switches

https://gerrit.wikimedia.org/r/1150692

gerritbot added a comment.May 27 2025, 2:56 PM

Change #1151235 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Add alerting for idle peering BGP sessions

https://gerrit.wikimedia.org/r/1151235

gerritbot added a comment.May 28 2025, 6:17 AM

Change #1151235 merged by jenkins-bot:

[operations/alerts@master] Add alerting for idle peering BGP sessions

https://gerrit.wikimedia.org/r/1151235

gerritbot added a comment.May 28 2025, 7:17 AM

Change #1151551 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Add alerting for long peering BGP down

https://gerrit.wikimedia.org/r/1151551

gerritbot added a comment.May 28 2025, 12:28 PM

Change #1151658 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/alerts@master] team-wmcs: Add host-bound alerts for BGP sessions

https://gerrit.wikimedia.org/r/1151658

gerritbot added a comment.May 28 2025, 12:33 PM

Change #1151551 merged by jenkins-bot:

[operations/alerts@master] Add alerting for long peering BGP down

https://gerrit.wikimedia.org/r/1151551

gerritbot added a comment.May 28 2025, 1:14 PM

Change #1144650 merged by Ayounsi:

[operations/puppet@production] Icinga: remove some network devices checks

https://gerrit.wikimedia.org/r/1144650

ayounsi updated the task description. (Show Details)Jun 3 2025, 6:36 AM
gerritbot added a comment.Jun 3 2025, 6:50 AM

Change #1153026 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Prometheus: gnmic_target_up rewrite name to instance

https://gerrit.wikimedia.org/r/1153026

gerritbot added a comment.Jun 3 2025, 7:11 AM

Change #1153030 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] gNMI: add target down alerting

https://gerrit.wikimedia.org/r/1153030

gerritbot added a comment.Jun 3 2025, 7:51 AM

Change #1153091 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Add alerting for gNMIc Go routines

https://gerrit.wikimedia.org/r/1153091

gerritbot added a comment.Jun 3 2025, 8:40 AM

Change #1153096 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] gNMI: bump number of workers to 32

https://gerrit.wikimedia.org/r/1153096

gerritbot added a comment.Jun 3 2025, 8:48 AM

Change #1153100 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Disable pint alerting for OutboundInterfaceErrors

https://gerrit.wikimedia.org/r/1153100

gerritbot added a comment.Jun 3 2025, 2:13 PM

Change #1153100 merged by jenkins-bot:

[operations/alerts@master] Disable pint alerting for OutboundInterfaceErrors

https://gerrit.wikimedia.org/r/1153100

gerritbot added a comment.Jun 3 2025, 2:25 PM

Change #1153026 merged by Ayounsi:

[operations/puppet@production] Prometheus: gnmic_target_up rewrite name to instance

https://gerrit.wikimedia.org/r/1153026

gerritbot added a comment.Jun 4 2025, 8:08 AM

Change #1153030 merged by jenkins-bot:

[operations/alerts@master] gNMI: add target down alerting

https://gerrit.wikimedia.org/r/1153030

gerritbot added a comment.Jun 4 2025, 8:08 AM

Change #1153091 merged by jenkins-bot:

[operations/alerts@master] Add alerting for gNMIc Go routines

https://gerrit.wikimedia.org/r/1153091

gerritbot added a comment.Jun 4 2025, 8:37 AM

Change #1153096 merged by Ayounsi:

[operations/puppet@production] gNMI: bump number of workers to 32

https://gerrit.wikimedia.org/r/1153096

cmooney added a subtask: T395998: Export additional network device stats in gnmi.Jun 4 2025, 10:06 AM
ayounsi changed the task status from Open to Stalled.Jun 4 2025, 11:41 AM
ayounsi claimed this task.

Going to mark that one as stalled until we can either onboard new device types (eg. SRXs) or new metrics that would help reducing our dependency on Icinga (eg. OSPF).

gerritbot added a comment.Jun 4 2025, 4:56 PM

Change #1151658 merged by jenkins-bot:

[operations/alerts@master] team-wmcs: Add host-bound alerts for BGP sessions

https://gerrit.wikimedia.org/r/1151658

gerritbot added a comment.Jun 9 2025, 12:24 PM

Change #1145169 merged by Filippo Giunchedi:

[operations/puppet@production] alertmanager: route network devices alerts to fr

https://gerrit.wikimedia.org/r/1145169

gerritbot added a comment.Jun 11 2025, 9:20 AM

Change #1155620 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/alerts@master] Promote the TransitPeeringIn/OutSaturation alerts to p.aging

https://gerrit.wikimedia.org/r/1155620

gerritbot added a comment.Jun 11 2025, 12:23 PM

Change #1148891 merged by Ayounsi:

[operations/puppet@production] Netops: remove check_bgp

https://gerrit.wikimedia.org/r/1148891

gerritbot added a comment.Jun 12 2025, 12:44 PM

Change #1155620 merged by jenkins-bot:

[operations/alerts@master] Promote the TransitPeeringIn/OutSaturation alerts to p.aging

https://gerrit.wikimedia.org/r/1155620

fgiunchedi mentioned this in T356140: blackbox alerts: add instance names to tickets created by alerting.Jun 30 2025, 2:24 PM
cmooney added a comment.Jul 9 2025, 10:15 AM

@ayounsi just a data-point but the QFX5120 in the codfw expansion cage, on 23.4R2.13, are exporting the BFD info:

gnmi_bfd_peer_session_state{instance="lsw1-e1-codfw:9804", job="gnmi", local_address="10.192.255.42", peer_local_discriminator="20", prometheus="ops", remote_address="10.192.255.40", site="codfw"}

We probably need to think about that fleet upgrade after all :)

Maintenance_bot removed a project: Patch-For-Review.Jul 9 2025, 10:32 AM
cmooney added a comment.EditedOct 16 2025, 5:33 PM

Just a note to say that the Nokia's do not appear to support the OpenConfig GNMI paths for OSPF.

Running this test:

sudo -u gnmic /usr/local/bin/gnmic sub -d --format event -a "ssw1-d1-eqiad.mgmt.eqiad.wmnet" --port 57400 --tls-ca "/etc/ssl/localcerts/network_devices_bundle.pem" --encoding json --mode once -u rancid --password "<password>" --path "openconfig:/network-instances/network-instance/protocols/protocol/ospfv2"

Results in this error back:

2025/10/16 17:31:25.737566 /home/runner/work/gnmic/gnmic/pkg/app/gnmi_client_subscribe.go:124: [gnmic] failed to subscribe: rpc error: code = InvalidArgument desc = Path not valid - unknown element 'ospfv2'. Options are [config, state, static-routes, local-aggregates, bgp, isis, identifier, name]

If I change the path to just /protocols a bunch of data comes back (specifically all the BGP stuff). If you grep the returned data for /protocols in its entirety 'ospf' does not appear :(

For now, given they also don't support the OSPF SNMP MIB either, I've added collection for some basic state data using the Nokia native paths, so we can alert if there is an issue:

https://gerrit.wikimedia.org/r/c/operations/homer/public/+/1196704

https://phabricator.wikimedia.org/P84041

cmooney added a comment.Oct 17 2025, 1:31 PM

Further to note that the Nokias do support the Openconfig BGP paths, apart from this one which is no main issue:

/network-instances/network-instance/protocols/protocol/bgp/neighbors/neighbor/state/interface-error

They do not, however, support the OpenConfig BFD paths, if you try to subscribe it returns:

2025/10/17 13:24:41.043493 /home/runner/work/gnmic/gnmic/pkg/app/collector.go:123: [gnmic] target "ssw1-d1-eqiad.mgmt.eqiad.wmnet:57400": subscription bfd rcv error: rpc error: code = InvalidArgument desc = Path not valid - unknown element 'bfd'. Options are [acl, interfaces, lacp, lldp, @, network-instances, components, qos, routing-policy, sampling, system]

So we'll need to get that using Nokia's own paths. For now I will leave it, having OSPF plus BGP status alerts will be enough day one for the new switches, we can get the BFD added over the coming month or two to have faster detection in alerts.

gerritbot added a comment.Oct 17 2025, 1:36 PM

Change #1196917 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/puppet@production] gnmic: Adjust BGP collection for Nokia compatibility

https://gerrit.wikimedia.org/r/1196917

gerritbot added a project: Patch-For-Review.Oct 17 2025, 1:36 PM
gerritbot added a comment.Oct 22 2025, 11:49 AM

Change #1196917 merged by Cathal Mooney:

[operations/puppet@production] gnmic: Adjust BGP collection for Nokia compatibility

https://gerrit.wikimedia.org/r/1196917

ayounsi closed subtask T390052: Enable gNMI on SRX devices and fasw as Resolved.Dec 12 2025, 7:18 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits