Change Details

== Common information * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **type**: flink-native-kubernetes == Firing alerts --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1)

== Common information * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **type**: flink-native-kubernetes == Firing alerts --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1)

== Common information * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **type**: flink-native-kubernetes == Firing alerts --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_194_79 * **instance**: 10.194.194.79:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-5 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 0 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_0_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_5 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_205_194 * **instance**: 10.194.205.194:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-1 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 1 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_1_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_1 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_10 * **task_attempt_num**: 10 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_2 * **task_attempt_num**: 2 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_3 * **task_attempt_num**: 3 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_4 * **task_attempt_num**: 4 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 4192003fc935bad153eec9244e8a333e * **operator_name**: elasticsearch_sink_psi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_5 * **task_attempt_num**: 5 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 5c8a6fc6c61d02fed3f22aab948707d1 * **operator_name**: elasticsearch_sink_chi:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_6 * **task_attempt_num**: 6 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_7 * **task_attempt_num**: 7 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_8 * **task_attempt_num**: 8 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: Search update lag is below 95% target in codfw * **title**: (ticket) search update-lag-codfw SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **app**: flink-app-consumer-search * **component**: taskmanager * **host**: 10_194_207_90 * **instance**: 10.194.207.90:9999 * **job**: k8s-pods * **job_id**: a830c541fe6b0a08742b19fb0e01cfa7 * **job_name**: cirrus_streaming_updater_consumer_search_codfw * **kubernetes_namespace**: cirrus-streaming-updater * **kubernetes_pod_name**: flink-app-consumer-search-taskmanager-1-6 * **operator_id**: 89c3a6ff2d8ad52ab6bd12bd02092849 * **operator_name**: elasticsearch_sink_omega:_Writer * **prometheus**: k8s * **recorder**: thanos-rule@main * **release**: consumer-search * **revision**: 2 * **routed_via**: consumer-search * **service**: search * **severity**: task * **site**: codfw * **sloth_id**: search-update-lag-codfw * **sloth_service**: search * **sloth_severity**: ticket * **sloth_slo**: update-lag-codfw * **source**: thanos * **subtask_index**: 2 * **task_attempt_id**: 5e40d0a9457045bbc888f8c120d67e78_85bc842284628bb3dd502e791460192a_2_9 * **task_attempt_num**: 9 * **task_id**: 85bc842284628bb3dd502e791460192a * **task_name**: split_by_cluster_group_____elasticsearch_sink_chi:_Writer__elasticsearch_sink_psi:_Writer__elasticsearch_sink_omega:_Writer__elasticsearch_sink_unknown_log____elasticsearch_sink_unknown:_Writer_ * **team**: data-platform * **tm_id**: flink_app_consumer_search_taskmanager_1_6 * **type**: flink-native-kubernetes * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%222%22%2Csloth_id%3D%22search-update-lag-codfw%22%2Csloth_service%3D%22search%22%2Csloth_slo%3D%22update-lag-codfw%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1)