Change Details

== Common information * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform == Firing alerts --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1011:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1012:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1013:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1014:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1016:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1)

== Common information * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform == Firing alerts --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1)

== Common information * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform == Firing alerts --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1011:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1012:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1013:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1014:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1) --- * **summary**: WDQS main update lag is below 95% target * **title**: (ticket) wdqs main-update-lag SLO error budget burn rate is too fast. * **alertname**: SLOBudgetBurn * **cluster**: wdqs-main * **instance**: wdqs1016:9193 * **job**: blazegraph * **prometheus**: ops * **recorder**: thanos-rule@main * **revision**: 4 * **severity**: task * **site**: eqiad * **sloth_id**: wdqs-main-update-lag * **sloth_service**: wdqs * **sloth_severity**: ticket * **sloth_slo**: main-update-lag * **source**: thanos * **team**: data-platform * [Source](https://thanos.wikimedia.org/graph?g0.expr=%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate2h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate1d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%283+%2A+0.05%29%29%29+or+%28max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate6h%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29+and+max+without+%28sloth_window%29+%28slo%3Asli_error%3Aratio_rate3d%7Brevision%3D%224%22%2Csloth_id%3D%22wdqs-main-update-lag%22%2Csloth_service%3D%22wdqs%22%2Csloth_slo%3D%22main-update-lag%22%7D+%3E+%281+%2A+0.05%29%29%29&g0.tab=1)