Page MenuHomePhabricator

Tarrow (Tom_WMDE)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Mar 29 2015, 4:07 PM (426 w, 2 d)
Availability
Available
LDAP User
Tarrow
MediaWiki User
T Arrow (WMDE) [ Global Accounts ]

Recent Activity

Yesterday

Tarrow moved T337715: SQL PV is above 85% utilisation from Doing to Done on the Wikibase.cloud (Kanban board Q2 2023) board.
Tue, May 30, 3:23 PM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow added a comment to T337715: SQL PV is above 85% utilisation.

Followed the same steps as in T326077, size is now doubled without outage to 240GB

Tue, May 30, 3:23 PM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow added a comment to T334221: improve responsiveness of header when logged out.

@Rosalie_WMDE and I had a chat and looked at how we are using icons. It's all fairly obscure and unclear but this is what we think is currently happening and what we should do.

Tue, May 30, 1:57 PM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow added a comment to T337715: SQL PV is above 85% utilisation.

It appears that we saw substantial growth just after restoring replication and this continued for around 3 days before levelling off again.

Tue, May 30, 9:10 AM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow created T337715: SQL PV is above 85% utilisation.
Tue, May 30, 8:36 AM · Wikibase.cloud (Kanban board Q2 2023)

Sat, May 20

Tarrow created T337117: Provide wikibase.cloud users with a way to reuse Wikidata users scripts and gadgets.
Sat, May 20, 12:24 PM · Wikibase.cloud

Fri, May 19

Tarrow created T337038: Aid Wikibase administrators to pick and then set their license and terms of service.
Fri, May 19, 1:59 PM · Wikibase.cloud
Tarrow created T337035: Secondary SQL database is failing to replicate.
Fri, May 19, 1:35 PM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow updated the task description for T331614: [Session] Documentation for Wikibase Cloud.
Fri, May 19, 1:02 PM · Wikibase.cloud, Wikimedia-Hackathon-2023
Tarrow created T337026: Create process to pull in translatewiki updates to mediawiki.
Fri, May 19, 12:08 PM · Wikibase.cloud

Tue, May 16

Tarrow moved T336530: Replace deprecated validators with ParamValidator in wbstack/mediawiki scripts from In Review to Blocked/Stalled on the Wikibase.cloud (WB Cloud Sprint 20) board.
Tue, May 16, 9:21 AM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow placed T336530: Replace deprecated validators with ParamValidator in wbstack/mediawiki scripts up for grabs.

As per the comment on the PR this looks good to me; local manual testing failed but almost certainly not due to this change but rather due to the changes this is based upon

Tue, May 16, 8:29 AM · Wikibase.cloud (Kanban board Q2 2023)

Mon, May 15

Tarrow updated the task description for T325894: Investigate missing Admin Users on Wiki Creation.
Mon, May 15, 1:02 PM · Wikibase.cloud
Tarrow updated the task description for T335963: Introduce an emergency sign up blocker .
Mon, May 15, 12:53 PM · Wikibase.cloud
Tarrow updated the task description for T335961: Introduce sign up rate alerting.
Mon, May 15, 12:40 PM · Wikibase.cloud
Tarrow added a comment to T335961: Introduce sign up rate alerting.

Did we discuss the relative risk / reward trade off of having no limit? To me it seems that merely alerting after this limit is reached leaves a long time for bad things to happen if the alerts fires at an inconvenient time like the start of a long weekend.

Mon, May 15, 12:32 PM · Wikibase.cloud
Tarrow added a comment to T314481: Create chart showing the amount of total items/properties on Platform Summary Dashboard.

After inspecting this we believe that there is a necessity for a common api that returns wiki metrics for use here as well as in T324099 and whatever "discovery platform we build"

Mon, May 15, 12:25 PM · Wikibase.cloud
Tarrow added a comment to T324099: Create a chart showing distribution of Wikibases .

We looked at this and noticed that the details of the implementation are likely to overlap quite a lot with "Important note for implementation: We want to, in the future, make this insightful for our users as well, so they can find each other."

Mon, May 15, 12:17 PM · Wikibase.cloud
Tarrow updated the task description for T334110: [4h timebox] SQL secondary is regularly being killed due to OOM.
Mon, May 15, 12:14 PM · Wikibase.cloud
Tarrow moved T312256: Unexpected values in labels for units from Blocked/Stalled to Sprint Backlog on the Wikibase.cloud (WB Cloud Sprint 20) board.
Mon, May 15, 9:21 AM · Wikibase.cloud (Kanban board Q2 2023), MW-1.40-notes (1.40.0-wmf.4; 2022-10-03), Patch-For-Review
Tarrow claimed T336530: Replace deprecated validators with ParamValidator in wbstack/mediawiki scripts.
Mon, May 15, 9:15 AM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow placed T336537: Fix Skaffold failing to deploy api in wbaas-deploy up for grabs.

Merged (and added a slightly more descriptive commit message). Since there is nothing to deploy and no more work to be done I move this straight to done

Mon, May 15, 8:16 AM · Wikibase.cloud (WB Cloud Sprint 20)
Tarrow claimed T336537: Fix Skaffold failing to deploy api in wbaas-deploy.
Mon, May 15, 7:03 AM · Wikibase.cloud (WB Cloud Sprint 20)

Fri, May 12

Tarrow moved T335853: Spin up an Elasticsearch 7.10.2 cluster from In Review to Waiting for Deploy to Production on the Wikibase.cloud (WB Cloud Sprint 20) board.
Fri, May 12, 1:51 PM · Wikibase.cloud (Kanban board Q2 2023)

Wed, May 10

Tarrow added a comment to T330389: Run Mediawiki Jobs in the background not at the end of requests.

We talked a little in person about the awkwardness of the k8s client we currently use. This is another place where the importance of T323211 has been surfaced

Wed, May 10, 9:38 AM · Wikibase.cloud (Kanban board Q2 2023)

Mon, May 8

Tarrow moved T333563: Renable elasticsearch on wikis that have had it disabled from Blocked/Stalled to Sprint Backlog on the Wikibase.cloud (WB Cloud Sprint 19) board.
Mon, May 8, 9:19 AM · Wikibase.cloud

Apr 23 2023

Tarrow added a comment to T335096: Platform-Nginx dynamically route traffic to the appropriate MediaWiki backend.

Looks like it does closely what we want it to do! To me using the auth_request module for this feels slightly counter intuitive but seems to work. To me this is because the use case for auth requires an upstream check on every request; for routing we would actually prefer something more like a short term cache perhaps with some sensible default behaviour.

Apr 23 2023, 7:55 AM · Wikibase.cloud
Tarrow updated the task description for T335096: Platform-Nginx dynamically route traffic to the appropriate MediaWiki backend.
Apr 23 2023, 7:44 AM · Wikibase.cloud

Apr 20 2023

Tarrow renamed T334110: [4h timebox] SQL secondary is regularly being killed due to OOM from SQL secondary is regularly being killed due to OOM to [4h timebox] SQL secondary is regularly being killed due to OOM.
Apr 20 2023, 2:01 PM · Wikibase.cloud
Tarrow updated the task description for T327752: (Reference) URI's cannot be created by non-admin users.
Apr 20 2023, 1:51 PM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow updated the task description for T330999: Investigate Upgrading Elasticsearch Beyond 7.10.2.
Apr 20 2023, 1:42 PM · Wikibase.cloud
Tarrow moved T330998: Update ElasticSearch to 7.10.2 from Tech prioritized backlog to Ready to Pick Up on the Wikibase.cloud board.
Apr 20 2023, 1:38 PM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow updated the task description for T330998: Update ElasticSearch to 7.10.2.
Apr 20 2023, 1:36 PM · Wikibase.cloud (Kanban board Q2 2023)
Tarrow claimed T335096: Platform-Nginx dynamically route traffic to the appropriate MediaWiki backend.
Apr 20 2023, 10:02 AM · Wikibase.cloud
Tarrow added a comment to T335096: Platform-Nginx dynamically route traffic to the appropriate MediaWiki backend.

a wiki will continue pointing to the old app server until it's maintenance update script is run. This should prevent us needing to manually add patches to change the routing.

Apr 20 2023, 9:24 AM · Wikibase.cloud
Tarrow assigned T334920: Make MediaWiki maintenance scripts in progress output visible to Deniz_WMDE.
Apr 20 2023, 9:19 AM · Wikibase.cloud
Tarrow added a comment to T334191: Re-introduce the fallback to default Search when ElasticSearch is broken.

Should this now move into review ?

Apr 20 2023, 8:27 AM · Wikibase.cloud (WB Cloud Sprint 19), Patch-For-Review
Tarrow created T335096: Platform-Nginx dynamically route traffic to the appropriate MediaWiki backend.
Apr 20 2023, 8:25 AM · Wikibase.cloud

Apr 19 2023

Tarrow added a comment to T334914: 🔵 Update 1.38 wiki databases to 1.39.

We've subsequently been rolling fowards by batches for 5/10/15 at a time

Apr 19 2023, 12:26 PM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334914: 🔵 Update 1.38 wiki databases to 1.39.

We decided that trying to implement this view on long running tasks was taking too long and therefore thought we ought to try and move forwards.

Apr 19 2023, 12:25 PM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow claimed T334914: 🔵 Update 1.38 wiki databases to 1.39.
Apr 19 2023, 7:54 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334914: 🔵 Update 1.38 wiki databases to 1.39 from Blocked/Stalled to Doing on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 19 2023, 7:54 AM · Wikibase.cloud (WB Cloud Sprint 18)

Apr 18 2023

Addshore awarded T327428: Investigate ways to reduce the resources consumed by ES a Party Time token.
Apr 18 2023, 11:01 PM · Wikibase.cloud, Patch-For-Review
Tarrow moved T334718: Update api database scripts to support MediaWiki 1.39 from In Verification to Done on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 7:11 PM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334573: 🔵 Deploy 1.39 mediawiki release to prod from In Verification to Done on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 7:11 PM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334184: Add alert for non-green elasticsearch cluster state.

Sounds like a good start.

Apr 18 2023, 7:10 PM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow placed T334920: Make MediaWiki maintenance scripts in progress output visible up for grabs.
Apr 18 2023, 1:38 PM · Wikibase.cloud
Tarrow added a comment to T333563: Renable elasticsearch on wikis that have had it disabled.

I believe that the snipped I posted above did not successfully filter out deleted wikis. Manually inspecting the output of WikiSetting::where(['name' => "wwExtEnableElasticSearch", 'value' => 0])->with('wiki')->get()->pluck('wiki')->where('deleted_at', null) I currently only see 7.

Apr 18 2023, 1:38 PM · Wikibase.cloud
Tarrow moved T334920: Make MediaWiki maintenance scripts in progress output visible from In Review to Waiting for Deploy to Staging on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 12:36 PM · Wikibase.cloud
Tarrow added a comment to T334920: Make MediaWiki maintenance scripts in progress output visible.

Have tested this locally by:

  • checking out main branch of the deploy repo and applying it to my local cluster
  • tweaking the api db provision and use versions ( wikiDbProvisionVersion: mw1.38-wbs1 + wikiDbUseVersion: mw1.38-wbs1) to be 1.38
  • checking out the patch (https://github.com/wbstack/mediawiki/pull/348) locally
  • building and deploying this new image using skaffold (skaffold run -m mediawiki-139)
  • running the update process as follows:
    • marking wiki read only (kubectl exec -it deployment/api-app-backend -- bash -c "php artisan wbs-wiki:setSetting domain peanutwiki.wbaas.localhost wgReadOnly migrate-to-139")
    • in a second terminal tailing the mediawiki backend logs k logs --follow mediawiki-139-app-backend-c84fd9ddb-fhnzp
    • dispatching the update job form the scheduling pod kubectl exec -it deployments/api-scheduler -- bash -c "php artisan job:dispatchNow MediawikiUpdate wikis.domain peanutwiki.wbaas.localhost mw1.38-wbs1 mw1.39-wbs1 mediawiki-139"
Apr 18 2023, 12:33 PM · Wikibase.cloud
Tarrow claimed T334920: Make MediaWiki maintenance scripts in progress output visible.
Apr 18 2023, 12:18 PM · Wikibase.cloud
Tarrow added a comment to T334914: 🔵 Update 1.38 wiki databases to 1.39.

This seems to work; we're happy-ish that we are not totally blocked by T334912. However we still agree that it would be nicer to understand what is happening during the long running update.php. Therefore we block this until we have reviewed (and merged and deployed to staging + production) T334920

Apr 18 2023, 11:20 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334914: 🔵 Update 1.38 wiki databases to 1.39 from Doing to Blocked/Stalled on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 11:18 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334912: Investigate "no text in this page" errors.

The issue also appears to be resolved after rolling the workload forward on Q160. We still saw issues on Q161/Q162 etc.

Apr 18 2023, 11:16 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334914: 🔵 Update 1.38 wiki databases to 1.39.

Marked beyond-notability.wikibase.cloud as readonly with kubectl exec -it deployment/api-app-backend -- bash -c "php artisan wbs-wiki:setSetting domain beyond-notability.wikibase.cloud wgReadOnly migrate-to-139" and run update.php with kubectl exec -it deployments/api-scheduler -- bash -c "php artisan job:dispatchNow MediawikiUpdate wikis.domain beyond-notability.wikibase.cloud mw1.38-wbs1 mw1.39-wbs1 mediawiki-139" as part of investigating T334912

Apr 18 2023, 11:09 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334912: Investigate "no text in this page" errors.

This does appear to have resolved the issue in viewing the page; lets try rolling back to 1.39 workloads and then doing update.php to try and determine if this error is the result of a database mismatch

Apr 18 2023, 10:51 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334912: Investigate "no text in this page" errors.

To investigate if this is an issue with 1.39 we roll this back to being routed to 1.39 workloads (https://github.com/wmde/wbaas-deploy/pull/851)

Apr 18 2023, 10:19 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow created T334920: Make MediaWiki maintenance scripts in progress output visible.
Apr 18 2023, 9:29 AM · Wikibase.cloud
Tarrow moved T333559: Prevent elasticsearch from being disabled on Wikis after some failure from Blocked/Stalled to Waiting for Deploy to Staging on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 9:20 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334573: 🔵 Deploy 1.39 mediawiki release to prod from Waiting for Deploy to Production to In Verification on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 9:20 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T333290: 🔵 Update staging to use MediaWiki 1.39 from In Verification to Done on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 9:19 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334914: 🔵 Update 1.38 wiki databases to 1.39.

Yesterday we did the following.
Generate one small batch consisting of coffeebase.wikibase.cloud, mywayordatwayy.wikibase.cloud and andrew.wikibase.cloud. We marked these read only; switched the routing (https://github.com/wmde/wbaas-deploy/pull/849); ran the update script and marked them as read write again before manually confirming that they appear to be OK.

Apr 18 2023, 8:53 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow updated the task description for T334914: 🔵 Update 1.38 wiki databases to 1.39.
Apr 18 2023, 8:43 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow renamed T334573: 🔵 Deploy 1.39 mediawiki release to prod from 🔵 Deploy 1.39 to prod to 🔵 Deploy 1.39 mediawiki release to prod.
Apr 18 2023, 8:42 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow renamed T334914: 🔵 Update 1.38 wiki databases to 1.39 from 🔵 Update 1.38 wikis to 1.39 to 🔵 Update 1.38 wiki databases to 1.39.
Apr 18 2023, 8:40 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T312256: Unexpected values in labels for units .

@ 2023-04-18T09:38:53+01:00
Updating Q556295: revision: 862243 updates: 14 on WikiFCD

Apr 18 2023, 8:39 AM · Wikibase.cloud (Kanban board Q2 2023), MW-1.40-notes (1.40.0-wmf.4; 2022-10-03), Patch-For-Review
Tarrow moved T327646: 🔷 Upgrade Wikibase Cloud Mediawiki Version to 1.39 from Blocked/Stalled to Doing on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 8:37 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow updated the task description for T334573: 🔵 Deploy 1.39 mediawiki release to prod.
Apr 18 2023, 8:35 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334914: 🔵 Update 1.38 wiki databases to 1.39 from Sprint Backlog to Doing on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 8:31 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow created T334914: 🔵 Update 1.38 wiki databases to 1.39.
Apr 18 2023, 8:31 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334718: Update api database scripts to support MediaWiki 1.39 from Waiting for Deploy to Production to In Verification on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 18 2023, 8:30 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334912: Investigate "no text in this page" errors.

Previously we had the assumption that this was due to some unusual level of load on the DBs from updating a bit wiki; however this morning while no updates are running it is still apparent.

Apr 18 2023, 8:29 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow renamed T334846: PHP Deprecated: Use of PersonalUrls hook (used in onPersonalUrlsConfirmAccount) was deprecatedInvestigate from Do not log deprecated method errors in Mediawiki to PHP Deprecated: Use of PersonalUrls hook (used in onPersonalUrlsConfirmAccount) was deprecatedInvestigate .
Apr 18 2023, 8:27 AM · Wikibase.cloud (WB Cloud Sprint 19), Patch-For-Review
Tarrow added a comment to T334846: PHP Deprecated: Use of PersonalUrls hook (used in onPersonalUrlsConfirmAccount) was deprecatedInvestigate .

I'm wondering if this as actually more than just a deprecated method. It appears to me that this might be causing some issue. While investigating TBC I noticed that when trying to load a problematic page I saw these errors in the logs:

{
  "textPayload": "[warning] [error-json] {\"id\":\"7c7dad14242f9dca7946d0ff\",\"type\":\"ErrorException\",\"file\":\"/var/www/html/w/includes/HookContainer/HookContainer.php\",\"line\":137,\"message\":\"PHP Deprecated: Use of PersonalUrls hook (used in onPersonalUrlsConfirmAccount) was deprecated in MediaWiki 1.39. [Called from MediaWiki\\\\HookContainer\\\\HookContainer::run]\",\"code\":0,\"url\":\"/wiki/Item:Q160\",\"caught_by\":\"mwe_handler\",\"backtrace\":[{\"function\":\"handleError\",\"class\":\"MWExceptionHandler\",\"type\":\"::\",\"args\":[\"integer\",\"string\",\"string\",\"string\",\"array\"]},{\"file\":\"/var/www/html/w/includes/debug/MWDebug.php\",\"line\":381,\"function\":\"trigger_error\",\"args\":[\"string\",\"integer\"]},{\"file\":\"/var/www/html/w/includes/debug/MWDebug.php\",\"line\":352,\"function\":\"sendRawDeprecated\",\"class\":\"MWDebug\",\"type\":\"::\",\"args\":[\"string\",\"boolean\",\"string\"]},{\"file\":\"/var/www/html/w/includes/debug/MWDebug.php\",\"line\":233,\"function\":\"deprecatedMsg\",\"class\":\"MWDebug\",\"type\":\"::\",\"args\":[\"string\",\"string\",\"string\",\"integer\"]},{\"file\":\"/var/www/html/w/includes/GlobalFunctions.php\",\"line\":765,\"function\":\"deprecated\",\"class\":\"MWDebug\",\"type\":\"::\",\"args\":[\"string\",\"string\",\"string\",\"integer\"]},{\"file\":\"/var/www/html/w/includes/HookContainer/HookContainer.php\",\"line\":334,\"function\":\"wfDeprecated\",\"args\":[\"string\",\"string\",\"boolean\"]},{\"file\":\"/var/www/html/w/includes/HookContainer/HookContainer.php\",\"line\":137,\"function\":\"callLegacyHook\",\"class\":\"MediaWiki\\\\HookContainer\\\\HookContainer\",\"type\":\"->\",\"args\":[\"string\",\"array\",\"array\",\"array\"]},{\"file\":\"/var/www/html/w/includes/HookContainer/HookRunner.php\",\"line\":3048,\"function\":\"run\",\"class\":\"MediaWiki\\\\HookContainer\\\\HookContainer\",\"type\":\"->\",\"args\":[\"string\",\"array\",\"array\"]},{\"file\":\"/var/www/html/w/includes/skins/SkinTemplate.php\",\"line\":582,\"function\":\"onPersonalUrls\",\"class\":\"MediaWiki\\\\HookContainer\\\\HookRunner\",\"type\":\"->\",\"args\":[\"array\",\"Title\",\"MediaWiki\\\\Skin\\\\Timeless\\\\SkinTimeless\"]},{\"file\":\"/var/www/html/w/includes/skins/SkinTemplate.php\",\"line\":1262,\"function\":\"buildPersonalUrls\",\"class\":\"SkinTemplate\",\"type\":\"->\",\"args\":[\"boolean\"]},{\"file\":\"/var/www/html/w/includes/skins/SkinTemplate.php\",\"line\":790,\"function\":\"buildContentNavigationUrlsInternal\",\"class\":\"SkinTemplate\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/includes/skins/SkinTemplate.php\",\"line\":762,\"function\":\"getPortletsTemplateData\",\"class\":\"SkinTemplate\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/includes/skins/Skin.php\",\"line\":667,\"function\":\"getCategoryLinks\",\"class\":\"SkinTemplate\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/includes/skins/SkinTemplate.php\",\"line\":259,\"function\":\"getCategories\",\"class\":\"Skin\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/includes/skins/SkinTemplate.php\",\"line\":146,\"function\":\"prepareQuickTemplate\",\"class\":\"SkinTemplate\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/includes/skins/SkinTemplate.php\",\"line\":177,\"function\":\"generateHTML\",\"class\":\"SkinTemplate\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/includes/OutputPage.php\",\"line\":2876,\"function\":\"outputPage\",\"class\":\"SkinTemplate\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/includes/MediaWiki.php\",\"line\":922,\"function\":\"output\",\"class\":\"OutputPage\",\"type\":\"->\",\"args\":[\"boolean\"]},{\"file\":\"/var/www/html/w/includes/MediaWiki.php\",\"line\":562,\"function\":\"main\",\"class\":\"MediaWiki\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/index.php\",\"line\":54,\"function\":\"run\",\"class\":\"MediaWiki\",\"type\":\"->\",\"args\":[]},{\"file\":\"/var/www/html/w/index.php\",\"line\":50,\"function\":\"wfIndexMain\",\"args\":[]}]}",
  "insertId": "31krgev0v8lpmfbq",
  "resource": {
    "type": "k8s_container",
    "labels": {
      "namespace_name": "default",
      "project_id": "wikibase-cloud",
      "container_name": "mediawiki",
      "pod_name": "mediawiki-139-app-web-5b64d94c46-zpjm4",
      "location": "europe-west3-a",
      "cluster_name": "wbaas-3"
    }
  },
  "timestamp": "2023-04-18T08:19:51.499605218Z",
  "severity": "ERROR",
  "labels": {
    "k8s-pod/app_kubernetes_io/component": "app-web",
    "k8s-pod/pod-template-hash": "5b64d94c46",
    "k8s-pod/app_kubernetes_io/name": "mediawiki",
    "compute.googleapis.com/resource_name": "gke-wbaas-3-n2-highmem-16-pool-85ebecb9-8r1o",
    "k8s-pod/app_kubernetes_io/instance": "mediawiki-139"
  },
  "logName": "projects/wikibase-cloud/logs/stderr",
  "receiveTimestamp": "2023-04-18T08:19:56.401987819Z"
}
Apr 18 2023, 8:26 AM · Wikibase.cloud (WB Cloud Sprint 19), Patch-For-Review
Tarrow created T334912: Investigate "no text in this page" errors.
Apr 18 2023, 8:16 AM · Wikibase.cloud (WB Cloud Sprint 18)

Apr 17 2023

Tarrow created T334846: PHP Deprecated: Use of PersonalUrls hook (used in onPersonalUrlsConfirmAccount) was deprecatedInvestigate .
Apr 17 2023, 12:40 PM · Wikibase.cloud (WB Cloud Sprint 19), Patch-For-Review
Tarrow updated the task description for T334573: 🔵 Deploy 1.39 mediawiki release to prod.
Apr 17 2023, 11:35 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334573: 🔵 Deploy 1.39 mediawiki release to prod from Sprint Backlog to Waiting for Deploy to Production on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 17 2023, 11:31 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow updated the task description for T334573: 🔵 Deploy 1.39 mediawiki release to prod.
Apr 17 2023, 9:53 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334185: Add `uptime` metric and alert for an endpoint that relies on elasticsearch from Waiting for Deploy to Staging to Waiting for Deploy to Production on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 17 2023, 7:40 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow placed T334058: Try using `masterTerminationFix` in ElasticSearch Helm Chart to prevent cluster from ending up in failed state up for grabs.
Apr 17 2023, 7:35 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T334058: Try using `masterTerminationFix` in ElasticSearch Helm Chart to prevent cluster from ending up in failed state from Doing to Done on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 17 2023, 7:35 AM · Wikibase.cloud (WB Cloud Sprint 18)

Apr 14 2023

Tarrow added a comment to T334718: Update api database scripts to support MediaWiki 1.39.

PR to deploy new image to production https://github.com/wmde/wbaas-deploy/pull/847

Apr 14 2023, 10:43 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow created T334718: Update api database scripts to support MediaWiki 1.39.
Apr 14 2023, 10:38 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow moved T333559: Prevent elasticsearch from being disabled on Wikis after some failure from Waiting for Deploy to Staging to Blocked/Stalled on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 14 2023, 10:24 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a comment to T334185: Add `uptime` metric and alert for an endpoint that relies on elasticsearch.

https://github.com/wmde/wbaas-deploy/pull/845
https://github.com/wmde/wbaas-deploy/pull/846

Apr 14 2023, 9:36 AM · Wikibase.cloud (WB Cloud Sprint 18)

Apr 13 2023

Tarrow added a comment to T334191: Re-introduce the fallback to default Search when ElasticSearch is broken.

We met and saw that there may be issues with the generic wikipage SQL backed search index not being updated when CirrusSearch is enabled.

Apr 13 2023, 12:48 PM · Wikibase.cloud (WB Cloud Sprint 19), Patch-For-Review
Tarrow moved T333563: Renable elasticsearch on wikis that have had it disabled from Sprint Backlog to Blocked/Stalled on the Wikibase.cloud (WB Cloud Sprint 18) board.
Apr 13 2023, 9:24 AM · Wikibase.cloud
Tarrow updated the task description for T334573: 🔵 Deploy 1.39 mediawiki release to prod.
Apr 13 2023, 9:16 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow updated the task description for T334573: 🔵 Deploy 1.39 mediawiki release to prod.
Apr 13 2023, 9:04 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow closed T334107: Fix QuickStatements OAuth for MediaWiki 1.39 as Resolved.
Apr 13 2023, 8:54 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow closed T334107: Fix QuickStatements OAuth for MediaWiki 1.39, a subtask of T327646: 🔷 Upgrade Wikibase Cloud Mediawiki Version to 1.39, as Resolved.
Apr 13 2023, 8:54 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow closed T332297: 🔵 Prepare an image for MediaWiki version 1.39 as Resolved.
Apr 13 2023, 8:53 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow closed T332297: 🔵 Prepare an image for MediaWiki version 1.39, a subtask of T327646: 🔷 Upgrade Wikibase Cloud Mediawiki Version to 1.39, as Resolved.
Apr 13 2023, 8:53 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a parent task for T332297: 🔵 Prepare an image for MediaWiki version 1.39: T327646: 🔷 Upgrade Wikibase Cloud Mediawiki Version to 1.39.
Apr 13 2023, 8:52 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a parent task for T333824: Resolve database migration error for MediaWiki 1.39: T327646: 🔷 Upgrade Wikibase Cloud Mediawiki Version to 1.39.
Apr 13 2023, 8:52 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a parent task for T334107: Fix QuickStatements OAuth for MediaWiki 1.39: T327646: 🔷 Upgrade Wikibase Cloud Mediawiki Version to 1.39.
Apr 13 2023, 8:52 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added a parent task for T334573: 🔵 Deploy 1.39 mediawiki release to prod: T327646: 🔷 Upgrade Wikibase Cloud Mediawiki Version to 1.39.
Apr 13 2023, 8:52 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow added subtasks for T327646: 🔷 Upgrade Wikibase Cloud Mediawiki Version to 1.39: T334573: 🔵 Deploy 1.39 mediawiki release to prod, T332297: 🔵 Prepare an image for MediaWiki version 1.39, T333824: Resolve database migration error for MediaWiki 1.39, T334107: Fix QuickStatements OAuth for MediaWiki 1.39.
Apr 13 2023, 8:52 AM · Wikibase.cloud (WB Cloud Sprint 18)
Tarrow renamed T334185: Add `uptime` metric and alert for an endpoint that relies on elasticsearch from Add `uptime` metric for an endpoint that relies on elasticsearch to Add `uptime` metric and alert for an endpoint that relies on elasticsearch.
Apr 13 2023, 8:49 AM · Wikibase.cloud (WB Cloud Sprint 18)