Page MenuHomePhabricator
Create Paste
Paste Active Pastes

Active Pastes
Use Results
Edit Query

  • P96603 (An Untitled Masterwork)
    cmooney@wikilap:~/deezlabel$ time ./deezlabel.py https://www.deezer.com/us/album/109238682
    Label: Evidence Music
    Getting releases 100%
    ...
    • Tue, Oct 6, 6:22 PM
    • 309 Lines
    Author: cmooney
  • P96599 ==> logs/payments-syslog <==
    2026-10-06T18:14:01+00:00 345283d40ee9 gravy_gateway_fraud: 1329:1329.3 Scores from fraud service: {"success":false,"error":"<!doctype html>\n<html lang=en>\n<title>500 Internal Server Error<\/title>\n<h1>Internal Server Error<\/h1>\n<p>The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.<\/p>\n","status":500}
    2026-10-06T18:14:01+00:00 345283d40ee9 gravy_gateway_fraud: 1329:1329.3 Running velocity filter for 'bin_hash'
    2026-10-06T18:14:01+00:00 345283d40ee9 gravy_gateway_fraud: 1329:1329.3 bin_hash is false-y, skipping velocity filter
    2026-10-06T18:14:01+00:00 345283d40ee9 gravy_gateway_fraud: 1329:1329.3 Running pattern filter for 'brazilUSD'
    2026-10-06T18:14:01+00:00 345283d40ee9 gravy_gateway_fraud: 1329:1329.3 "Filtered" "process" "0" 172.20.0.1
    ...
    • Tue, Oct 6, 6:15 PM
    • 7 Lines
    • Bash Scripting
    Author: jgleeson
  • P96592 CirrusSearch perf eval, 2026-10-05 (UTC)
    test,dc,metric,unit,mean,max,delta_pct_vs_baseline,samples
    baseline,codfw,cpu_iowait_pct,%,0.1572,0.1939,0.0,17
    force the MLR window size to 100,codfw,cpu_iowait_pct,%,0.2364,0.2703,50.38,17
    disable MLR,codfw,cpu_iowait_pct,%,0.2796,0.2982,77.91,27
    force function score window size to 500,codfw,cpu_iowait_pct,%,0.2568,0.2879,63.39,21
    ...
    • Tue, Oct 6, 1:56 PM
    • 369 Lines
    • Plain Text
    Author: dcausse
  • P96591 dbctl commit (dc=codfw): 'pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -11,6 +11,6 @@
    "db2220": 100,
    "db2221": 300,
    ...
    • Tue, Oct 6, 10:38 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96590 dbctl commit (dc=codfw): 'Pooling back'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,7 +4,7 @@
    },
    {
    ...
    • Tue, Oct 6, 10:37 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96589 dbctl commit (dc=codfw): 'pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -11,6 +11,6 @@
    "db2220": 100,
    "db2221": 300,
    ...
    • Tue, Oct 6, 10:23 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96588 dbctl commit (dc=codfw): 'Pooling back'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,7 +4,7 @@
    },
    {
    ...
    • Tue, Oct 6, 10:22 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96587 dbctl commit (dc=all): 'Pooling back pc1'
    --- codfw/externalLoads/pc1 live
    +++ codfw/externalLoads/pc1 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Oct 6, 10:13 AM
    • 20 Lines
    Author: ProdPasteBot
  • P96586 dbctl commit (dc=all): 'testing'
    --- codfw/externalLoads/pc1 live
    +++ codfw/externalLoads/pc1 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Oct 6, 10:08 AM
    • 20 Lines
    Author: ProdPasteBot
  • P96585 dbctl commit (dc=codfw): 'pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -11,6 +11,6 @@
    "db2220": 100,
    "db2221": 300,
    ...
    • Tue, Oct 6, 10:08 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96584 dbctl commit (dc=codfw): 'Pooling back'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,7 +4,7 @@
    },
    {
    ...
    • Tue, Oct 6, 10:07 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96583 dbctl commit (dc=codfw): 'Pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,7 +3,7 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 9:58 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96582 dbctl commit (dc=codfw): 'pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -10,6 +10,7 @@
    "db2218": 300,
    "db2220": 100,
    ...
    • Tue, Oct 6, 9:53 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96581 dbctl commit (dc=codfw): 'Pooling back'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,6 +4,7 @@
    },
    {
    ...
    • Tue, Oct 6, 9:52 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96580 dbctl commit (dc=codfw): 'Pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,7 +3,7 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 9:43 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96579 dbctl commit (dc=codfw): 'Pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,7 +3,7 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 9:28 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96578 dbctl commit (dc=codfw): 'Pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,6 +3,7 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 9:13 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96577 dbctl commit (dc=codfw): 'testing'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,7 +3,6 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 9:12 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96576 db2169
    *************************** 1. row ***************************
    Slave_IO_State:
    Master_Host: db2159.codfw.wmnet
    Master_User: repl2024
    Master_Port: 3306
    ...
    • Tue, Oct 6, 8:32 AM
    • 55 Lines
    Author: ProdPasteBot
  • P96575 (An Untitled Masterwork)
    *************************** 1. row ***************************
    Slave_IO_State:
    Master_Host: db2157.codfw.wmnet
    Master_User: repl2024
    Master_Port: 3306
    ...
    • Tue, Oct 6, 8:32 AM
    • 55 Lines
    Author: ProdPasteBot
  • P96574 dbctl commit (dc=codfw): 'moving cloning'
    --- codfw/sectionLoads/s5 live
    +++ codfw/sectionLoads/s5 generated
    @@ -8,7 +8,6 @@
    "db2192": 300,
    "db2211": 300,
    ...
    • Tue, Oct 6, 8:29 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96573 dbctl commit (dc=codfw): 'moving cloning'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,7 +4,6 @@
    },
    {
    ...
    • Tue, Oct 6, 8:29 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96572 (An Untitled Masterwork)
    db1176# mysql -BAsD --init-command="SET sql_log_bin=0" mediabackups -e "select @@sql_log_bin"
    1
    db1176# mysql -BAsD mediabackups --init-command="SET sql_log_bin=0" -e "select @@sql_log_bin"
    0
    • Tue, Oct 6, 8:13 AM
    • 4 Lines
    • Shell
    Author: CWilliams-WMF
  • P96571 dbctl commit (dc=codfw): 'Pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,7 +4,7 @@
    },
    {
    ...
    • Tue, Oct 6, 8:10 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96570 dbctl commit (dc=codfw): 'Pooling back'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,7 +3,7 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 8:04 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96569 dbctl commit (dc=codfw): 'Pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,7 +4,7 @@
    },
    {
    ...
    • Tue, Oct 6, 7:55 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96568 dbctl commit (dc=codfw): 'Pooling back'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,7 +3,7 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 7:49 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96567 dbctl commit (dc=codfw): 'Pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,7 +4,7 @@
    },
    {
    ...
    • Tue, Oct 6, 7:40 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96566 dbctl commit (dc=codfw): 'Pooling back'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,7 +3,7 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 7:34 AM
    • 11 Lines
    Author: ProdPasteBot
  • P96565 dbctl commit (dc=codfw): 'Pooling in s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -4,6 +4,7 @@
    },
    {
    ...
    • Tue, Oct 6, 7:25 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96564 dbctl commit (dc=codfw): 'Pooling back'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,6 +3,7 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 7:19 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96563 db2168
    cumin2024@db2168.codfw.wmnet[(none)]> show slave status\G
    *************************** 1. row ***************************
    Slave_IO_State:
    Master_Host: db2159.codfw.wmnet
    Master_User: repl2024
    ...
    • Tue, Oct 6, 6:04 AM
    • 57 Lines
    Author: Marostegui
  • P96562 dbctl commit (dc=codfw): 'moving to s7'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -3,7 +3,6 @@
    "db2159": 0
    },
    ...
    • Tue, Oct 6, 5:31 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96561 dbctl commit (dc=codfw): 'moving to s7'
    --- codfw/sectionLoads/s6 live
    +++ codfw/sectionLoads/s6 generated
    @@ -4,7 +4,6 @@
    },
    {
    ...
    • Tue, Oct 6, 5:21 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96560 dbctl commit (dc=eqiad): 'stress tests'
    --- eqiad/sectionLoads/s1 live
    +++ eqiad/sectionLoads/s1 generated
    @@ -9,7 +9,6 @@
    "db1195": 100,
    "db1196": 300,
    ...
    • Mon, Oct 5, 10:33 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96559 dbctl commit (dc=codfw): 'stress tests'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,6 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Mon, Oct 5, 10:32 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96558 dbctl commit (dc=codfw): 'stress tests'
    --- codfw/sectionLoads/s2 live
    +++ codfw/sectionLoads/s2 generated
    @@ -5,7 +5,6 @@
    {
    "db2175": 300,
    ...
    • Mon, Oct 5, 10:27 AM
    • 10 Lines
    Author: ProdPasteBot
  • P96557 T56037 After step 2
    # Input: 6 logical thumbnails
    # Output: 12 thumbnail URLs (11 distinct URLs)
    # Cost: 6 HTTP request (4 imageinfo, 2 extra thumburls)
    # 1. Image info for Multilingual_SVG_example.svg
    ...
    • Sun, Oct 4, 9:00 PM
    • 39 Lines
    • Plain Text
    Author: Krinkle
  • P96556 T56037 Before
    # Input: 6 logical thumbnails
    # Output: 12 thumbnail URLs (11 distinct URLs)
    # Cost: 16 HTTP request (4 imageinfo, 12 thumburl)
    # 1. Image info for Multilingual_SVG_example.svg
    ...
    • Sun, Oct 4, 5:42 PM
    • 79 Lines
    • Plain Text
    Author: Krinkle
  • P96555 T56037 After step 1
    # Input: 6 logical thumbnails
    # Output: 12 thumbnail URLs (11 distinct URLs)
    # Cost: 10 HTTP request (4 imageinfo, 6 thumburls)
    # 1. Image info for Multilingual_SVG_example.svg
    ...
    • Sun, Oct 4, 5:33 PM
    • 55 Lines
    • Plain Text
    Author: Krinkle
  • P96554 Codemod for UploadWizard packageFile migration
    # Prepare step: in extension.json, rename "scripts" to "packageFiles" for ext.uploadWizard and ext.uploadWizard.page, put resources/ext.uploadWizard.js first in the list, and have that file require() the other files in their old order. I can also write that step into the script if you’d rather.
    import json, re, os
    os.chdir("/home/simon/src/mediawiki/extensions/UploadWizard")
    ...
    • Sun, Oct 4, 6:45 AM
    • 315 Lines
    • Python
    Author: simon04
  • P96553 git-review hook to prevent accidental pushing of security patches
    #!/bin/bash
    # Simple git-review hook to prevent accidentally pushing patches with commit summaries starting with 'SECURITY'.
    # Can be skipped with PUBLIC_SECURITY_PATCH=1.
    # To enable, copy this into ~/.config/git-review/hooks/pre-review and make sure it is executable.
    ...
    • Sat, Oct 3, 10:26 AM
    • 35 Lines
    • Bash Scripting
    Author: Tgr
  • P96551 Reimage failed (sre.hosts.reimage exit_code=99) - clear RAID / LVM fix
    # zuul1004.eqiad.wmnet - 2026-10-02
    # Reimage failed (sre.hosts.reimage exit_code=99), install-console showed only a
    # BusyBox shell. The disks still had the software RAID (md0) and LVM (vg0) from
    # the previous install, so partitioning in the installer got stuck.
    # Same issue and fix as on zuul1005 on 2026-09-28.
    ...
    • Fri, Oct 2, 7:43 PM
    • 36 Lines
    Author: Dzahn
  • P96549 etcd certificate validation failure on trixie - urllib3 edition
    swfrench@deploy1003:~$ cat test.py
    try:
    from urllib3.contrib import pyopenssl
    pyopenssl.inject_into_urllib3()
    except ImportError:
    ...
    • Fri, Oct 2, 4:15 PM
    • 60 Lines
    Author: Scott_French
  • P96548 etcd certificate validation failure on trixie
    swfrench@deploy1003:~$ lsb_release -c
    Codename: bookworm
    swfrench@deploy1003:~$ python3
    Python 3.11.2 (main, May 12 2026, 05:17:27) [GCC 12.2.0] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    ...
    • Fri, Oct 2, 2:47 PM
    • 47 Lines
    Author: Scott_French
  • P96547 Errors on llm-qwen3-14b deployment after moving it to ml-serve1015 24GB partition size
    $ kubectl -n llm describe isvc llm-qwen3-14b
    File "/srv/venv/lib/python3.12/site-packages/vllm/v1/engine/async_llm.py", line 246, in from_engine_args
    return cls(
    ^^^^
    File "/srv/venv/lib/python3.12/site-packages/vllm/v1/engine/async_llm.py", line 146, in __init__
    ...
    • Fri, Oct 2, 11:21 AM
    • 50 Lines
    • Shell
    Author: gkyziridis
  • P96546 (An Untitled Masterwork)
    [bking@cumin2003] ~$ 2026-10-01T20:19:14^C
    [bking@cumin2003] ~$ test-cookbook -c 1347713 sre.hadoop.roll-restart-workers test --start-datetime 2026-10-01T20:19:14
    INFO:__main__:Change exists in project operations/cookbooks with latest patch set being 1
    INFO:__main__:Setting up Cookbooks change 1347713 patch set 1 for testing
    INFO:__main__:Executing command /usr/bin/git -C /home/bking/cookbooks_testing/cookbooks-1347713 status --porcelain
    ...
    • Thu, Oct 1, 8:55 PM
    • 721 Lines
    Author: ProdPasteBot
  • P96545 (An Untitled Masterwork)
    [bking@cumin2003] ~$ 2026-10-01T20:19:14^C
    [bking@cumin2003] ~$ test-cookbook -c 1347713 sre.hadoop.roll-restart-workers test --start-datetime 2026-10-01T20:19:14
    INFO:__main__:Change exists in project operations/cookbooks with latest patch set being 1
    INFO:__main__:Setting up Cookbooks change 1347713 patch set 1 for testing
    INFO:__main__:Executing command /usr/bin/git -C /home/bking/cookbooks_testing/cookbooks-1347713 status --porcelain
    ...
    • Thu, Oct 1, 8:42 PM
    • 251 Lines
    Author: ProdPasteBot
  • P96544 (An Untitled Masterwork)
    taavi@cloudcontrol1011 ~ $ sudo wmcs-magnum-kubectl get openstackclusters -A
    NAMESPACE NAME CLUSTER READY NETWORK BASTION IP AGE
    magnum-system kube-2js6t-7j8ml kube-2js6t true d8a16ddf-c01f-4f22-8b67-8ed18b4b1b45 112d
    magnum-system kube-i98u3-22kl5 kube-i98u3 true d8a16ddf-c01f-4f22-8b67-8ed18b4b1b45 13d
    magnum-system kube-o6s0d-njsqm kube-o6s0d true d8a16ddf-c01f-4f22-8b67-8ed18b4b1b45 47m
    • Thu, Oct 1, 2:59 PM
    • 5 Lines
    Author: • taavi
  • P96542 Old temporary files in HDFS
    nshahquinn-wmf@stat1009:~$ sudo -u analytics-product kerberos-run-command analytics-product hdfs dfs -du -h
    79.9 K .Trash
    234.0 M .skein
    1.3 M .sparkStaging
    69.1 M .staging
    ...
    • Wed, Sep 30, 10:26 PM
    • 192 Lines
    Author: nshahquinn-wmf
  • P96541 (An Untitled Masterwork)
    ## urllib ##
    print(urllib.request.urlopen('https://conf1009.eqiad.wmnet:4001/version', timeout=5).read().decode())
    {"etcdserver":"3.4.23","etcdcluster":"3.4.0"}
    ...
    • Wed, Sep 30, 2:53 PM
    • 421 Lines
    Author: FCeratto-WMF
  • P96540 (An Untitled Masterwork)
    external-services, kafka-logging-eqiad, Endpoints (v1) has changed:
    ...
    release: external-services
    heritage: Helm
    subsets:
    ...
    • Wed, Sep 30, 12:52 PM
    • 65 Lines
    Author: tappof
  • P96539 (An Untitled Masterwork)
    cmooney@urldownloader1003:~$ sudo journalctl -u squid -n 10000 | grep rolesanywhere.us-east-1.amazonaws.com
    Sep 30 08:23:36 urldownloader1003 squid[2585873]: @cee: { "ecs.version": "1.7.0", "event.category": ["network", "web"], "event.dataset": "squid.access", "event.duration": "160", "event.kind": "event", "event.outcome": "unknown", "event.type": ["access", "connection"], "host.name": "urldownloader1003", "host.domain": "wikimedia.org", "host.hostname": "urldownloader1003.wikimedia.org", "host.ip": "208.80.154.75", "client.ip": "10.68.7.92", "timestamp": "2026-09-30T08:23:36+0000", "http.request.method": "CONNECT", "url.full": "rolesanywhere.us-east-1.amazonaws.com:443", "url.path": "-", "url.domain": "rolesanywhere.us-east-1.amazonaws.com", "http.response.status_code": 200, "http.response.bytes": 7544, "http.version": "1.1", "http.request.referrer": "-", "user_agent.original": "Go-http-client/1.1", "labels.request_status": "TCP_TUNNEL", "labels.hierarchy_status": "HIER_DIRECT", "source.ip": "10.68.7.92", "service.type": "squid"}
    ...
    • Wed, Sep 30, 8:56 AM
    • 39 Lines
    Author: cmooney
  • P96536 more_like track_total_hits perf bench
    === size=4 ===
    track_total_hits=4 took n= 1000 mean= 146.5 p50= 131.0 p90= 261.0 p99= 503.1 max= 794.0
    track_total_hits=4 wall_ms n= 1000 mean= 150.3 p50= 133.9 p90= 264.2 p99= 506.6 max= 797.2
    track_total_hits=true took n= 1000 mean= 252.4 p50= 213.0 p90= 453.0 p99= 792.1 max= 1235.0
    track_total_hits=true wall_ms n= 1000 mean= 256.6 p50= 216.9 p90= 456.2 p99= 795.4 max= 1237.6
    ...
    • Tue, Sep 29, 10:01 AM
    • 16 Lines
    • Plain Text
    Author: dcausse
  • P96535 (An Untitled Masterwork)
    root@cloudcephosd1050:~# pvs
    PV VG Fmt Attr PSize PFree
    /dev/sda ceph-64a852f6-e0db-4c53-80f1-c04bc03644b7 lvm2 a-- <6.99t 0
    /dev/sdb ceph-cff2b984-db95-49aa-83a4-bfcfa85135fb lvm2 a-- <6.99t 0
    /dev/sdc ceph-373e8af6-c977-4946-bb5f-07e344375d97 lvm2 a-- <6.99t 0
    ...
    • Tue, Sep 29, 9:14 AM
    • 58 Lines
    Author: fgiunchedi
  • P96534 (An Untitled Masterwork)
    root@cloudcephosd1035:~# vgs
    VG #PV #LV #SN Attr VSize VFree
    ceph-0733c1be-7fb7-48d9-a902-48a7877d6ffd 1 1 0 wz--n- 3.49t 0
    ceph-3055f76c-83fa-48b1-864b-1f6db21c4f84 1 1 0 wz--n- 3.49t 0
    ceph-3f038290-8fdf-4bec-8d75-2a1d674377d9 1 1 0 wz--n- 3.49t 0
    ...
    • Tue, Sep 29, 9:11 AM
    • 55 Lines
    Author: fgiunchedi
  • P96533 Patches ready for review
    oncall: Add Klaxon to the aux clusters https://phabricator.wikimedia.org/T438897
    trafficserver: add mapping for oncall https://phabricator.wikimedia.org/T439279
    service: move oncall to production https://phabricator.wikimedia.org/T439279
    wikimedia.org: add oncall https://phabricator.wikimedia.org/T439279
    oncall: add discovery ingress records https://phabricator.wikimedia.org/T439279
    ...
    • Mon, Sep 28, 9:04 PM
    • 17 Lines
    Author: andrea.denisse
  • P96532 fio yaml
    - name: Set up FIO
    hosts: io-0.search.eqiad1.wikimedia.cloud
    become: yes
    gather_facts: yes
    ...
    • Mon, Sep 28, 7:59 PM
    • 149 Lines
    Author: bking
  • P96531 (An Untitled Masterwork)
    POD_CREATION_DATE=$(date --date=$(kubectl -n shellbox-timeline get pods -o json | jq '.items | .[0] | .metadata.creationTimestamp' | sed -e s/\"//g) +"%s")
    CERT_CREATION_TIME=$(date --date=$(kubectl -n shellbox-timeline get certificates -o json | jq '.items | .[0] | .status.notBefore' | sed -e s/\"//g) +"%s")
    ...
    • Mon, Sep 28, 3:37 PM
    • 9 Lines
    Author: Joe
  • P96530 (An Untitled Masterwork)
    root@cumin1004:~# cumin cloudvirt* 'grep "model name" /proc/cpuinfo | sort -u'
    47 hosts will be targeted:
    cloudvirt[2004-2006]-dev.codfw.wmnet,cloudvirt[1040-1080].eqiad.wmnet,cloudvirtlocal[1001-1003].eqiad.wmnet
    OK to proceed on 47 hosts? Enter the number of affected hosts to confirm or "q" to quit: 47
    ===== NODE GROUP =====
    ...
    • Mon, Sep 28, 6:50 AM
    • 20 Lines
    Author: fgiunchedi
  • P96529 issue running claudebox after first build
    mutante@waran:~/repos/claudebox$ sudo ./build
    No existing claudebox.local image; nothing to back up.
    Building claudebox.build-20260925-125829 ...
    [+] Building 120.6s (4/10) docker:default
    ...
    • Fri, Sep 25, 9:51 PM
    • 34 Lines
    Author: Dzahn
  • P96528 (An Untitled Masterwork)
    GrowthExperiments:revalidateLinkRecommendations.php: Running on growthexperiments
    -----------------------------------------------------------------
    abwiki
    -----------------------------------------------------------------
    abwiki Revalidating link recommendations:
    ...
    • Fri, Sep 25, 11:45 AM
    • 474 Lines
    Author: ProdPasteBot
  • P96527 airflow-test-k8s to airflow3
    Comparing release=production, chart=wmf-stable/airflow, namespace=airflow-test-k8s
    airflow-test-k8s, airflow-config, ConfigMap (v1) has changed:
    ...
    xcom_objectstorage_compression =
    xcom_objectstorage_path = s3://s3_dpe@logs.airflow-test-k8s.dse-k8s-eqiad/xcoms
    ...
    • Fri, Sep 25, 10:55 AM
    • 1,084 Lines
    • Diff
    Author: atsuko
  • P96526 Stuck recoveries in opensearch-semantic-search@codfw
    enwiki_content_1789402322 8 1.6d peer init opensearch-semantic-search-masters-1 opensearch-semantic-search-masters-1 opensearch-semantic-search-masters-6 opensearch-semantic-search-masters-6 n/a n/a 0 0 0.0% 0 0b 0b 0.0% 0b -1 0 -1.0%
    enwiki_content_1789402322 8 1.6d peer init opensearch-semantic-search-masters-1 opensearch-semantic-search-masters-1 opensearch-semantic-search-masters-2 opensearch-semantic-search-masters-2 n/a n/a 0 0 0.0% 0 0b 0b 0.0% 0b -1 0 -1.0%
    frwiki_content_1789392702 6 1.6d peer init opensearch-semantic-search-data-1 opensearch-semantic-search-data-1 opensearch-semantic-search-masters-5 opensearch-semantic-search-masters-5 n/a n/a 0 0 0.0% 0 0b 0b 0.0% 0b -1 0 -1.0%
    • Fri, Sep 25, 10:12 AM
    • 3 Lines
    Author: dcausse
  • P96525 (An Untitled Masterwork)
    💔cdanis@deploy1003.eqiad.wmnet /var/lib/mediawiki-cache-warmup 🕧☕ git diff --no-index --stat =(sudo ss -tp | grep -F 10.64.16.93:https | grep envoy | sort ) =( sleep 5s; sudo ss -tp | grep -F 10.64.16.93:https | grep envoy | sort)
    /tmp/{zsh8FEMA5 => zshF5qJoU} | 16 ++++++++--------
    1 file changed, 8 insertions(+), 8 deletions(-)
    💔cdanis@deploy1003.eqiad.wmnet /var/lib/mediawiki-cache-warmup 🕧☕ git diff --no-index --stat =(sudo ss -tp | grep -F 10.64.16.93:https | grep envoy | sort ) =( sleep 5s; sudo ss -tp | grep -F 10.64.16.93:https | grep envoy | sort)
    /tmp/{zshHaFtvd => zshr1AfuN} | 17 ++++++++---------
    ...
    • Thu, Sep 24, 4:18 PM
    • 9 Lines
    Author: ProdPasteBot
  • P96524 (An Untitled Masterwork)
    taavi@cloudcontrol1007 ~ $ os role remove --user seanleong-wmde --project bastion viewer
    taavi@cloudcontrol1007 ~ $ os role assignment list --user seanleong-wmde --names
    +--------+------------------------+-------+-------------------------+--------+--------+-----------+
    | Role | User | Group | Project | Domain | System | Inherited |
    ...
    • Thu, Sep 24, 3:31 PM
    • 11 Lines
    • Shell
    Author: • taavi
  • P96523 ExternalPython script.py
    from __future__ import annotations
    import cloudpickle
    import sys
    import os
    ...
    • Thu, Sep 24, 12:48 PM
    • 85 Lines
    • Python
    Author: atsuko
  • P96521 (An Untitled Masterwork)
    #!/usr/bin/env python3
    def get_needs_retry(expected, status):
    return [
    key for key in ["Slave_IO_Running", "Slave_SQL_Running"]
    ...
    • Thu, Sep 24, 7:53 AM
    • 89 Lines
    • Python
    Author: CWilliams-WMF
  • P96520 (An Untitled Masterwork)
    acmechief-test1001
    acmechief-test2001
    an-test-client1002
    an-test-coord1002
    an-test-druid1001
    ...
    • Thu, Sep 24, 6:59 AM
    • 301 Lines
    Author: tappof
  • P96517 (An Untitled Masterwork)
    rzl@cumin1003:~$ sudo confctl --object-type discovery select name=eqiad set/pooled=true
    The selector you chose has selected the following objects:
    {"/liftwing-openapi-server": ["eqiad"], "/mw-web-next": ["eqiad"], "/shellbox-constraints": ["eqiad"], "/wcqs": ["eqiad"], "/mathoid": ["eqiad"], "/pki": ["eqiad"], "/wdqs-internal-main": ["eqiad"], "/netbox": ["eqiad"], "/recommendation-api": ["eqiad"], "/sessionstore": ["eqiad"], "/mw-api-ext-next": ["eqiad"], "/thanos-web": ["eqiad"], "/shellbox-video": ["eqiad"], "/wdqs-main": ["eqiad"], "/config-master": ["eqiad"], "/eventgate-main": ["eqiad"], "/k8s-ingress-wikikube-ro": ["eqiad"], "/k8s-ingress-dse": ["eqiad"], "/search": ["eqiad"], "/shellbox": ["eqiad"], "/eventgate-logging-external": ["eqiad"], "/linkrecommendation": ["eqiad"], "/docker-registry": ["eqiad"], "/mw-api-ext-ro": ["eqiad"], "/mw-web-ro": ["eqiad"], "/releases": ["eqiad"], "/schema": ["eqiad"], "/search-psi": ["eqiad"], "/helm-charts": ["eqiad"], "/inference": ["eqiad"], "/zotero": ["eqiad"], "/restbase-async": ["eqiad"], "/thumbor": ["eqiad"], "/push-notifications": ["eqiad"], "/k8s-ingress-aux-rw": ["eqiad"], "/restbase-backend": ["eqiad"], "/shellbox-media": ["eqiad"], "/restbase": ["eqiad"], "/search-omega": ["eqiad"], "/rest-gateway-ro": ["eqiad"], "/eventstreams": ["eqiad"], "/swift": ["eqiad"], "/k8s-ingress-aux-ro": ["eqiad"], "/wdqs-internal-scholarly": ["eqiad"], "/mobileapps": ["eqiad"], "/codesearch": ["eqiad"], "/device-analytics": ["eqiad"], "/mw-web-next-ro": ["eqiad"], "/k8s-ingress-staging": ["eqiad"], "/logstash": ["eqiad"], "/shellbox-timeline": ["eqiad"], "/tegola-vector-tiles": ["eqiad"], "/toolhub": ["eqiad"], "/thanos-query": ["eqiad"], "/druid-public-broker": ["eqiad"], "/mwdebug": ["eqiad"], "/rest-gateway": ["eqiad"], "/kartotherian": ["eqiad"], "/mw-jobrunner": ["eqiad"], "/sophroid": ["eqiad"], "/druid-public-coordinator": ["eqiad"], "/echostore": ["eqiad"], "/mw-api-ext-next-ro": ["eqiad"], "/proton": ["eqiad"], "/eventgate-analytics": ["eqiad"], "/k8s-ingress-ml-serve": ["eqiad"], "/shellbox-syntaxhighlight": ["eqiad"], "/citoid": ["eqiad"], "/mw-api-ext": ["eqiad"], "/mw-web": ["eqiad"], "/puppetdb-api": ["eqiad"], "/mw-api-int-ro": ["eqiad"], "/apertium": ["eqiad"], "/k8s-ingress-wikikube-rw": ["eqiad"], "/mw-api-int": ["eqiad"], "/apus": ["eqiad"], "/cxserver": ["eqiad"], "/k8s-ingress-dse-aa": ["eqiad"], "/puppetboard": ["eqiad"], "/wikifeeds": ["eqiad"], "/thanos-swift": ["eqiad"], "/wdqs-scholarly": ["eqiad"], "/apt": ["eqiad"], "/eventgate-analytics-external": ["eqiad"], "/mwdebug-next": ["eqiad"], "/termbox": ["eqiad"], "/urldownloader": ["eqiad"]}
    Ok to continue? [y/N]
    confctl>y
    ...
    • Wed, Sep 23, 5:45 PM
    • 187 Lines
    Author: RLazarus
  • P96516 (An Untitled Masterwork)
    diff --git a/spicerack/mysql.py b/spicerack/mysql.py
    index 941b05a..6a98110 100644
    --- a/spicerack/mysql.py
    +++ b/spicerack/mysql.py
    @@ -7,6 +7,7 @@ from dataclasses import dataclass
    ...
    • Wed, Sep 23, 5:14 PM
    • 37 Lines
    • Diff
    Author: CWilliams-WMF
  • P96514 (An Untitled Masterwork)
    1808301693 Query SELECT /* Campaign::getCampaignMixins */ notice_mixins.nmxn_mixin_name,notice_mixins.nmxn_enabled,notice_mixin_params.nmxnp_param_name,notice_mixin_params.nmxnp_param_value FROM `cn_notices` `notices` JOIN `cn_notice_mixins` `notice_mixins` ON ((notices.not_id = notice_mixins.nmxn_not_id)) LEFT JOIN `cn_notice_mixin_params` `notice_mixin_params` ON ((notice_mixins.nmxn_id = notice_mixin_params.nmxnp_notice_mixin_id)) WHERE notices.not_name = 'wlm_2026_fr' AND notice_mixins.nmxn_enabled = 1
    • Wed, Sep 23, 4:41 PM
    • 1 Line
    Author: Marostegui
  • P96513 scap logs (2026-09-23 warning)
    14:22:36 Checking whether requested changes are valid for backport...
    14:22:38 Root change '1344292' processed with 0 relevant dependencies
    14:22:38 Root change '1344293' processed with 0 relevant dependencies
    14:22:38 Voting on 2 change(s)
    14:22:38 Change 1344292 was already merged
    ...
    • Wed, Sep 23, 3:07 PM
    • 258 Lines
    Author: Urbanecm_WMF
  • P96512 (An Untitled Masterwork)
    MariaDB [civicrm]> SELECT SUBSTRING_INDEX(a.subject, 'failed with ', -1) AS reason, COUNT(DISTINCT cr.id) AS n
    -> FROM civicrm_activity a
    -> JOIN civicrm_contribution_recur cr ON cr.id = a.source_record_id
    -> WHERE a.activity_type_id = (
    -> SELECT v.value FROM civicrm_option_value v
    ...
    • Wed, Sep 23, 1:49 PM
    • 30 Lines
    • MySQL
    Author: jgleeson
  • P96511 (An Untitled Masterwork)
    A:cmooney@ssw1-a1-eqiad# show system lldp neighbor interface *
    +---------------+-------------------+-----------------------------+---------------------+------------------------+----------------------+---------------+
    | Name | Neighbor | Neighbor System Name | Neighbor Chassis ID | Neighbor First Message | Neighbor Last Update | Neighbor Port |
    +===============+===================+=============================+=====================+========================+======================+===============+
    | ethernet-1/1 | 88:18:F1:C8:0D:1C | lsw1-a1-eqiad | 88:18:F1:C8:0D:1C | 11 minutes ago | 4 seconds ago | ethernet-1/56 |
    ...
    • Wed, Sep 23, 1:13 PM
    • 24 Lines
    Author: cmooney
  • P96510 (An Untitled Masterwork)
    ```
    Info: Applying configuration version '(bb7ad28223) Muehlenhoff - Uninstall intel-microcode on VMs'
    Notice: /Stage[main]/Prometheus::Blackbox_exporter/Debconf::Set[prometheus-blackbox-exporter/want_cap_net_raw]/Exec[debconf-set-selections set boolean prometheus-blackbox-exporter/want_cap_net_raw]/returns: debconf: DbDriver "config": /var/cache/debconf/config.dat is locked by another process: Resource temporarily unavailable
    Error: 'echo set prometheus-blackbox-exporter/want_cap_net_raw boolean "true" | debconf-set-selections' returned 1 instead of one of [0]
    Error: /Stage[main]/Prometheus::Blackbox_exporter/Debconf::Set[prometheus-blackbox-exporter/want_cap_net_raw]/Exec[debconf-set-selections set boolean prometheus-blackbox-exporter/want_cap_net_raw]/returns: change from 'notrun' to ['0'] failed: 'echo set prometheus-blackbox-exporter/want_cap_net_raw boolean "true" | debconf-set-selections' returned 1 instead of one of [0] (corrective)
    ...
    • Wed, Sep 23, 12:18 PM
    • 30 Lines
    Author: tappof
  • P96509 POP site networks in $network::constants::production_networks, which aren't in $network::constants::mw_appserver_networks
    10.2.3.0/24 LVS low-traffic (internal) services esams
    10.2.4.0/24 LVS low-traffic (internal) services ulsfo
    10.2.5.0/24 LVS low-traffic (internal) services eqsin
    10.2.6.0/24 LVS low-traffic (internal) services drmrs
    10.2.7.0/24 LVS low-traffic (internal) services magru
    ...
    • Wed, Sep 23, 12:14 PM
    • 72 Lines
    Author: cmooney
  • P96508 Core site networks in $network::constants::production_networks, which aren't in $network::constants::mw_appserver_networks
    10.2.1.0/24 LVS low-traffic (internal) services codfw
    10.2.2.0/24 LVS low-traffic (internal) services eqiad
    10.64.5.0/24 analytics1-a-eqiad
    10.64.20.0/24 cloud-hosts1-eqiad
    10.64.21.0/24 analytics1-b-eqiad
    ...
    • Wed, Sep 23, 12:13 PM
    • 152 Lines
    Author: cmooney
  • P96507 Server IDs for LDAP replication
    $ grep openldap::server_id hieradata/hosts/*
    hieradata/hosts/cloudservices2004-dev.yaml:profile::openldap::server_id: 3
    hieradata/hosts/cloudservices2005-dev.yaml:profile::openldap::server_id: 4
    hieradata/hosts/ldap-replica1003.yaml:profile::openldap::server_id: 13
    hieradata/hosts/ldap-replica1004.yaml:profile::openldap::server_id: 14
    ...
    • Wed, Sep 23, 11:11 AM
    • 16 Lines
    Author: MoritzMuehlenhoff
  • P96506 (An Untitled Masterwork)
    root@deploy1003:~# kube-env admin eqiad
    root@deploy1003:~# cd /srv/deployment-charts/helmfile.d/admin_ng
    root@deploy1003:/srv/deployment-charts/helmfile.d/admin_ng# helmfile -e eqiad -lname=external-services diff
    skipping missing values file matching "external-services/values.yaml"
    skipping missing values file matching "values/eqiad/external-services-values.yaml"
    ...
    • Wed, Sep 23, 8:00 AM
    • 100 Lines
    Author: tappof
  • P96505 (An Untitled Masterwork)
    Mail_&_Guardian 16218 https://en.wikipedia.org/wiki/Mail_&_Guardian
    Oxford_English_Dictionary 13568 https://en.wikipedia.org/wiki/Oxford_English_Dictionary
    DR-DOS 12929 https://en.wikipedia.org/wiki/DR-DOS
    Archive.today 11883 https://en.wikipedia.org/wiki/Archive.today
    Ministry_of_Foreign_Affairs_(China) 10759 https://en.wikipedia.org/wiki/Ministry_of_Foreign_Affairs_(China)
    ...
    • Tue, Sep 22, 9:40 PM
    • 201 Lines
    Author: Ladsgroup
  • P96504 (An Untitled Masterwork)
    root@sretest2013:~# ip -br addr show
    lo UNKNOWN 127.0.0.1/8 208.80.153.224/32 208.80.153.225/32 2620:0:860:ed1a::2/128 2620:0:860:ed1a::1/128 ::1/128
    eno1 DOWN
    eno2 DOWN
    enxbe3af2b6059f DOWN
    ...
    • Tue, Sep 22, 6:07 PM
    • 23 Lines
    Author: cmooney
  • P96503 (An Untitled Masterwork)
    [1138605.925389] systemd-shutdown[1]: Unable to finalize remaining MD devices, ignoring.
    [1138707.455447] bnxt_en 0000:6a:00.1: QPLIB: bnxt_re_is_fw_stalled: FW STALL Detected. cmdq[0x13]=0x2 waited (1138690684 > 100000) msec active 1
    [1138707.469927] bnxt_en 0000:6a:00.1 bnxt_re1: Failed to destroy HW QP
    [1138707.477102] ------------[ cut here ]------------
    [1138707.482500] WARNING: CPU: 64 PID: 1 at drivers/infiniband/core/cq.c:322 ib_free_cq+0xf7/0x130 [ib_core]
    ...
    • Tue, Sep 22, 6:03 PM
    • 101 Lines
    Author: cmooney
  • P96502 dbctl commit (dc=codfw): 'Optimizer issues fixed'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -6,7 +6,7 @@
    "db2168": 300,
    "db2182": 300,
    ...
    • Tue, Sep 22, 5:51 PM
    • 11 Lines
    Author: ProdPasteBot
  • P96501 dbctl commit (dc=codfw): 'Optimizer issues fixed'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -6,7 +6,7 @@
    "db2168": 300,
    "db2182": 300,
    ...
    • Tue, Sep 22, 5:36 PM
    • 11 Lines
    Author: ProdPasteBot
  • P96500 dbctl commit (dc=codfw): 'Optimizer issues fixed'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -6,7 +6,7 @@
    "db2168": 300,
    "db2182": 300,
    ...
    • Tue, Sep 22, 5:21 PM
    • 11 Lines
    Author: ProdPasteBot
  • P96499 dbctl commit (dc=codfw): 'Optimizer issues fixed'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -6,6 +6,7 @@
    "db2168": 300,
    "db2182": 300,
    ...
    • Tue, Sep 22, 5:06 PM
    • 10 Lines
    Author: ProdPasteBot
  • P96498 (An Untitled Masterwork)
    1: ps1-a1-eqiad
    2: ps1-a2-eqiad
    3: ps1-a3-eqiad
    4: ps1-a4-eqiad
    5: ps1-a5-eqiad
    ...
    • Tue, Sep 22, 4:33 PM
    • 43 Lines
    Author: cmooney
  • P96497 (An Untitled Masterwork)
    💙cdanis@cumin1004.eqiad.wmnet ~ 🕛☕ confctl --quiet --object-type discovery select 'dnsdisc=mw.*' get | sort
    {"codfw": {"pooled": false, "references": [], "ttl": 300}, "tags": "dnsdisc=mw-api-ext"}
    {"codfw": {"pooled": false, "references": [], "ttl": 300}, "tags": "dnsdisc=mw-api-ext-next"}
    {"codfw": {"pooled": false, "references": [], "ttl": 300}, "tags": "dnsdisc=mw-api-int"}
    {"codfw": {"pooled": false, "references": [], "ttl": 300}, "tags": "dnsdisc=mwdebug"}
    ...
    • Tue, Sep 22, 4:13 PM
    • 27 Lines
    Author: ProdPasteBot
  • P96496 dbctl commit (dc=codfw): 'optimizer issues'
    --- codfw/sectionLoads/s7 live
    +++ codfw/sectionLoads/s7 generated
    @@ -6,7 +6,6 @@
    "db2168": 300,
    "db2182": 300,
    ...
    • Tue, Sep 22, 3:57 PM
    • 10 Lines
    Author: ProdPasteBot
  • P96495 rclone bug reproducer
    mvernon@ms-backup1003:~$ s3cmd ls s3://mcv21test
    2024-08-20 13:10 8286485 s3://mcv21test/1-month-old_kittens_32.jpg
    2024-08-20 14:21 224878555 s3://mcv21test/Apollo_Butterfly_under_the_microscope,_4k.webm
    2024-08-20 13:10 539645 s3://mcv21test/Café_de_Flore.jpg
    2024-08-20 12:56 20144 s3://mcv21test/Gnome-edit-delete.svg
    ...
    • Tue, Sep 22, 3:19 PM
    • 13 Lines
    Author: MatthewVernon
  • P96494 (An Untitled Masterwork)
    tappof@deploy1003:~$ scap sync-world --k8s-only --k8s-confirm-diff -Dbuild_mw_container_image:False
    ___ ____
    ⎛ ⎛ ,----
    \ //==--'
    _//|,.·//==--' ____________________________
    ...
    • Tue, Sep 22, 1:30 PM
    • 6,809 Lines
    Author: tappof
  • P96493 ceph-csi-rbd
    Comparing release=ceph-csi-rbd, chart=/home/atsuko/src/operations/deployment-charts/charts/ceph-csi-rbd/, namespace=kube-system
    kube-system, ceph-config, ConfigMap (v1) has changed:
    ...
    metadata:
    name: "ceph-config"
    ...
    • Tue, Sep 22, 12:54 PM
    • 1,675 Lines
    • Diff
    Author: atsuko
  • P96492 ceph-csi-cephfs
    Comparing release=ceph-csi-cephfs, chart=/home/atsuko/src/operations/deployment-charts/charts/ceph-csi-cephfs/, namespace=kube-system
    kube-system, ceph-cephfs-hdd, StorageClass (storage.k8s.io) has changed:
    ...
    kind: StorageClass
    metadata:
    ...
    • Tue, Sep 22, 12:48 PM
    • 692 Lines
    • Diff
    Author: atsuko
  • P96491 dbctl commit (dc=eqiad): 'issues'
    --- eqiad/readOnlyBySection live
    +++ eqiad/readOnlyBySection generated
    @@ -1,3 +1 @@
    -{
    - "es7": "Maintenance - T430765"
    ...
    • Tue, Sep 22, 9:47 AM
    • 7 Lines
    Author: ProdPasteBot
  • P96490 (An Untitled Masterwork)
    [09:32:29] marostegui@cumin1004:~$ sudo cookbook sre.mysql.depool es1035 -r "issues"
    Acquired lock for key /spicerack/locks/cookbooks/sre.mysql.depool:es1035: {'concurrency': 1, 'created': '2026-09-22 09:32:40.108544+00:00', 'owner': 'marostegui@cumin1004 [80133]', 'ttl': 60}
    START - Cookbook sre.mysql.depool depool es1035: issues
    es1035 is a primary or DC master of es7 (RW): setting whole section as read-only!
    Previous configuration saved. To restore it run: dbctl config restore /var/cache/conftool/dbconfig/20260922-093240-marostegui.json
    ...
    • Tue, Sep 22, 9:46 AM
    • 9 Lines
    Author: Marostegui
  • P96489 dbctl commit (dc=eqiad): 'issues'
    --- eqiad/readOnlyBySection live
    +++ eqiad/readOnlyBySection generated
    @@ -1 +1,3 @@
    -{}
    +{
    ...
    • Tue, Sep 22, 9:32 AM
    • 7 Lines
    Author: ProdPasteBot
  • P96488 (An Untitled Masterwork)
    for section in x1 x3 x4 es6 es7 s6 s5 s2 s3 s7 s8 s4 s1; do
    echo "${section}"
    sudo cookbook sre.switchdc.databases.prepare -t T436500 --section "${section}" eqiad codfw
    echo
    echo Press any key to proceed, or CTRL+c to exit
    ...
    • Tue, Sep 22, 8:51 AM
    • 8 Lines
    • Shell
    Author: CWilliams-WMF
  • P96487 (An Untitled Masterwork)
    <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
    <html><head>
    <title>302 Found</title>
    </head><body>
    <h1>Found</h1>
    ...
    • Tue, Sep 22, 8:15 AM
    • 7 Lines
    Author: ProdPasteBot
  • P96486 (An Untitled Masterwork)
    ocess 1514741 (uwsgi) total-vm:129048kB, anon-rss:68860kB, file-rss:76kB, shmem-rss:116kB, UID:53061 pgtables:240kB oom_score_adj:873
    [3213798.618590] Memory cgroup out of memory: Killed process 1514742 (uwsgi) total-vm:1153288kB, anon-rss:999092kB, file-rss:76kB, shmem-rss:116kB, UID:53061 pgtables:2640kB oom_score_adj:873
    [3215088.623352] Memory cgroup out of memory: Killed process 1530451 (uwsgi) total-vm:2684172kB, anon-rss:2594760kB, file-rss:128kB, shmem-rss:116kB, UID:53061 pgtables:5240kB oom_score_adj:873
    [3215088.628588] Memory cgroup out of memory: Killed process 1530358 (uwsgi) total-vm:118372kB, anon-rss:58836kB, file-rss:0kB, shmem-rss:656kB, UID:53061 pgtables:216kB oom_score_adj:873
    [3215088.695999] Memory cgroup out of memory: Killed process 1530449 (uwsgi) total-vm:675124kB, anon-rss:615552kB, file-rss:0kB, shmem-rss:116kB, UID:53061 pgtables:1404kB oom_score_adj:873
    ...
    • Tue, Sep 22, 7:53 AM
    • 530 Lines
    Author: fgiunchedi
Next
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits