Page MenuHomePhabricator
Create Task
Maniphest T385199

Gather PHP 8.1 profiling data
Closed, ResolvedPublic
Actions

Description

As we have done in the past with impactful migrations, it would be great if we could send ArcLamp profiling data from PHP8.1 to a
separate pipeline

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
Fix channel name for ArcLamp pipeline for PHP8Orioperations/puppetproduction+2 -2
Set up ArcLamp pipeline for PHP8CDanisoperations/puppetproduction+4 -0
Route PHP8 Excimer profiles to separate ArcLamp sinksCDanisoperations/mediawiki-configmaster+7 -0
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT396296 Upgrade symfony/* to PHP 8.1 versions
 ResolvedReedyT373753 Drop symfony/polyfill-php 73-81 from mediawiki-vendor
 StalledNoneT255792 Quibble runs core:unit tests twice!
 OpenNoneT232915 Red-green in PHPUnit code coverage are hard to read
 ResolvedNoneT376276 PHP 8.4: Implicitly nullable parameter declarations deprecated
 ResolvedNoneT379587 PHP 8.4: Implicitly nullable parameter declarations deprecated in 3rd party vendor libs
 ResolvedReedyT378424 PHP 8.4: Implicitly nullable parameter declarations deprecated in qrcode vendor libs
 ResolvedKrinkleT358666 Drop PHP 8.1 support from MediaWiki
 ResolvedKrinkleT360995 Migrate Wikimedia production from PHP 8.1 to PHP 8.3
 ResolvedJdforrester-WMFT353362 Make PHP 8.3 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries)
 ResolvedJdforrester-WMFT352085 Make PHP 8.2 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries)
 ResolvedJdforrester-WMFT360560 Make PHP 8.2 voting on development branch of Wikibase
 ResolvedLucas_Werkmeister_WMDET324202 Remove use of utf8_encode and utf8_decode in Wikibase
 ResolvedNoneT353161 [CLIENT] Creation of dynamic property MediaWiki\Title\Title::$wikibasePushedDeleteToRepo is deprecated
 ResolvedJdforrester-WMFT360709 Make PHP 8.2 voting on development (master) branch of Math extension
 ResolvedDaimonaT381728 Use PHP 8.3 in MediaWiki-Docker
 ResolvedJdforrester-WMFT398491 Move CI images to WMF PHP 8.3 packages
 DeclinedNoneT401255 Switch PHP 8.3 image of MediaWiki-Docker from Sury to WMF
 Resolved• Scott_FrenchT401254 Upgrade mw-debug/next to PHP 8.3
 Resolved• Scott_FrenchT401252 Configure title-case consistency mapping for PHP 8.1 -> 8.3 transition
 Resolved• Scott_FrenchT399884 Configure production MediaWiki image builds for PHP 8.3
 ResolvedcscottT401855 ☂ PHP 8.3 issues found during WMF rollout
 Resolved• Scott_FrenchT402424 PHP Deprecated: Using ${var} in strings is deprecated, use {$var} instead in /srv/monitoring/lib.php on line 99
 DuplicatePRODUCTION ERRORNoneT403514 Expectation (readQueryRows <= 10000) by MediaWiki\Actions\ActionEntryPoint::execute not met (actual: 12860)
 ResolvedPRODUCTION ERRORMichaelT407403 Error: Invalid serialization data for DatePeriod object
 ResolvedPRODUCTION ERRORMichaelT408852 PHP Deprecated: DateTime::__construct(): Passing null to parameter #1 ($datetime) of type string is deprecated
 ResolvedMichaelT401005 Investigate Production Errors from ComputedUserImpactLookup::getPageViewData
 DuplicatePRODUCTION ERRORNoneT409248 PHP Warning: Trying to access array offset on null
 ResolvedTgrT402597 Exploratory testing on PHP 8.3 for MediaWiki Platform Team components
 ResolvedNoneT402804 Exploratory testing on PHP 8.3 for MediaWiki authentication stack
 Resolved• DAlangi_WMFT403484 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: Login
 ResolvedTgrT403485 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: Central session
 Resolved• DAlangi_WMFT403486 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: Signup
 ResolvedTgrT403487 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: OAuth
 ResolvedTgrT403488 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: 2FA
 Resolved• AtienoT402809 Exploratory testing on PHP 8.3 for MediaWiki Interfaces Team components
 ResolvedNoneT402810 Exploratory testing on PHP 8.3 for Content Transform Team components
 ResolvedbrouberolT403110 Prepare dumps-on-k8s (mediawiki-dumps-legacy) for migration to PHP 8.3
 Resolved• Scott_FrenchT403655 Configure mw-next-routing for the PHP 8.3 migration
 Resolved• Scott_FrenchT403657 Configure the WikimediaEvents extension for the PHP 8.3 migration
 Resolved• Scott_FrenchT403284 Migrate production Shellbox services to PHP 8.3
 Resolved• Scott_FrenchT403283 Prepare PHP 8.3 service images for Shellbox
 Resolved• Scott_FrenchT398246 Prepare PHP 8.3 production images
 Resolved• Scott_FrenchT398245 Prepare WMF PHP 8.3 packages for bullseye
 ResolvedKrinkleT400109 Ensure MediaWiki-Core-Profiler works with php-xhprof 2.x (PHP 8.3)
 ResolvedKrinkleT401152 Switch wmf-config/Profiler from Tideways to XHProf
 Resolved• Scott_FrenchT403772 Migrate parsoidtest1001 to PHP 8.3
 ResolvedKrinkleT405031 lcobucci/clock needs upgrading for PHP 8.3
 ResolvedTgrT363639 web-auth/webauthn-lib must be upgraded to 4+ for PHP 8.2+ support
 Resolved• Scott_FrenchT405955 MediaWiki on PHP 8.3 production workload migration
 ResolvedjnucheT411277 Patchdemo wiki creation fails due to PHP 8.1 not supported by MW
 ResolvedJdforrester-WMFT411372 wikilambda-catalyst-end-to-end broken due to new version of composer after PHP 8.1 -> 8.3 migration
 ResolvedBUG REPORT• bd808T411235 Beta cluster scap using php8.1 container; php8.2 is now required
 ResolvedReedyT380185 Prepare for newer geoip2/geoip2 library
 ResolvedReedyT338103 Micro-optimize ApiResult::isMetadataKey with str_starts_with once we support PHP8+
 Resolvedseanleong-WMDET379930 Use WeakMap instead of an array in RestrictedEntityLookupFactory
 StalledNoneT334726 Use return type `never` in Wikibase
 OpenNoneT328919 Upgrade PHPUnit in MediaWiki code to PHPUnit 10
 ResolvedLucas_Werkmeister_WMDET328741 Test failures under PHPUnit 9.6: "Expecting E_DEPRECATED and E_USER_DEPRECATED is deprecated and will no longer be possible in PHPUnit 10"
 ResolvedDaimonaT342110 Upgrade to PHPUnit 9.6
 ResolvedDaimonaT342259 Move MediaWikiIntegrationTestCase setup and teardown away from run()
 ResolvedDaimonaT342301 Remove MediaWikiIntegrationTestCase::$tablesUsed in favour of automatic query tracking
 OpenNoneT332865 PHPUnit data providers should be simple static functions that return plain data
 ResolvedUmherirrenderT337130 Make PHPUnit dataProvider LexemeFieldTestBase::getTestData static (WikibaseLexemeCirrusSearch extension)
 ResolvedArendpieterT337135 Make PHPUnit dataProvider on UstringLibraryTest and LuaEngineUnitTestBase static
 ResolvedUmherirrenderT337144 Make PHPUnit dataProvider static in AbuseFilter tests
 ResolvedUmherirrenderT337155 Make PHPUnit dataProvider static in ReadingLists tests
 Resolved• mszaboT337156 Make PHPUnit dataProvider static in IPInfo tests
 ResolvedtstarlingT337157 Make PHPUnit dataProvider static in LoginNotify tests
 ResolvedUmherirrenderT337158 Make PHPUnit dataProvider static in Flow tests
 Resolved• Dreamy_JazzT337159 Make PHPUnit dataProvider static in CheckUser tests
 Resolved• Dreamy_JazzT346044 Remove CheckUserUnionQueryBuilder
 ResolvedPhysikerweltT337160 Make PHPUnit dataProvider static in Math tests
 ResolvedTgrT337161 Make PHPUnit dataProvider static in OAuth tests
 ResolvedUmherirrenderT337162 Make PHPUnit dataProvider static in ProofreadPage tests
 ResolvedUmherirrenderT337163 Make PHPUnit dataProvider static in CirrusSearch tests
 ResolvedNoneT337164 Make PHPUnit dataProvider static in FileImporter tests
 ResolvedUmherirrenderT337165 Make PHPUnit dataProvider static in GrowthExperiments tests
 ResolvedNoneT337166 Make PHPUnit dataProvider static in CampaignEvents tests
 ResolvedNoneT371467 [GENERAL] Make PHPUnit dataProvider static in Wikibase-related extensions
 ResolvedkarapayneWMDET337154 Make PHPUnit dataProvider static in Wikibase tests
 ResolvedAudreyPenven_WMDET380604 Make provideLuaData static
 ResolvedAudreyPenven_WMDET380605 Make EntityMetaTagsCreatorTestCase's provideTestGetMetaTags dataProvider static
 ResolvedLucas_Werkmeister_WMDET337153 Make PHPUnit dataProvider static in WikibaseQualityConstraints tests
 ResolvedLucas_Werkmeister_WMDET337151 Make PHPUnit dataProvider static in WikibaseLexeme tests
 ResolvedUmherirrenderT337152 Make PHPUnit dataProvider static in WikibaseMediaInfo tests
 ResolvedthiemowmdeT337150 Make PHPUnit dataProvider static in Wikidata.org tests
 ResolvedLucas_Werkmeister_WMDET337148 Make PHPUnit dataProvider static in WikibaseCirrusSearch tests
 ResolvedUmherirrenderT393065 Make PHPUnit dataProvider on ExtensionJsonTestBase static
 ResolvedUmherirrenderT393079 Make PHPUnit dataProvider static in CommunityConfiguration tests
 ResolvedUmherirrenderT393080 Make PHPUnit dataProvider static in AutoModerator tests
 ResolvedUmherirrenderT393081 Make PHPUnit dataProvider on AbstractChangesListSpecialPageTestCase static
 ResolvedUmherirrenderT393082 Make PHPUnit dataProvider on OutputTransformStageTestBase static
 ResolvedUmherirrenderT393084 Make PHPUnit dataProvider on TypeDefTestCaseTrait static
 Resolved• mszaboT393115 Make PHPUnit dataProvider on PasswordTestCase static
 ResolvedxSavitarT393122 Make PHPUnit dataProvider on BundleSizeTestBase static
 ResolvedUmherirrenderT393132 Make PHPUnit dataProvider on RevisionRecordTests static
 ResolvedUmherirrenderT393207 Make PHPUnit dataProvider on ExtensionServicesTestBase static
 ResolvedUmherirrenderT393219 Make PHPUnit dataProvider on RestStructureTest static
 ResolvedUmherirrenderT410731 Fix all Wikimedia production code and MW extensions PHPUnit tests data providers real providers (and use static methods)
 ResolvedDaimonaT345481 Migrate Parser and extension tests away from deprecated PHPUnit TestSuite subclassing
 ResolvedcscottT422866 Migrate parser tests to new phpunit:config mechanism
 ResolvedArendpieterT358394 Stop using internal PHPUnit code in Scribunto
 OpenNoneT363064 MediaWiki.Commenting.MissingCovers.MissingCovers does not support PHPUnit 10.x attributes
 ResolvedUmherirrenderT363641 IPUtils: Expecting E_WARNING and E_USER_WARNING is deprecated and will no longer be possible in PHPUnit 10
 Resolved• larissagauliaT363650 Minify: Expecting E_WARNING and E_USER_WARNING is deprecated and will no longer be possible in PHPUnit 10
 ResolvedUmherirrenderT362858 equivset: Expecting E_ERROR and E_USER_ERROR is deprecated
 ResolvedJdforrester-WMFT395743 Use of package ockcyp/covers-validator in libaries is not compatible with PHPUnit 10
 OpenNoneT420851 Use of ExtensionJsonTestBase causes "Empty data set provided by data provider" failures under PHPUnit 10
 OpenNoneT420853 Use of AbstractSchemaTestBase causes "Empty data set provided by data provider" failures under PHPUnit 10
 ResolvedArendpieterT420854 LuaEngineTestBase causes "Empty data set provided by data provider" failures for lua errors under PHPUnit 10
 OpenNoneT420856 Use of HTMLFormFieldTestCase causes "Empty data set provided by data provider" failures under PHPUnit 10
 ResolvedReedyT420857 Skipping in EnWikiFormulaeTest does not work under PHPUnit 10
 OpenNoneT420859 EntityHandlerTestCase causes invalid data provider failures under PHPUnit 10
 OpenNoneT420860 OutputTransformStageTestBase causes invalid data provider failures under PHPUnit 10
 ResolvedUmherirrenderT421178 Fix PHPUnit 10 deprecation notice "Providing invalid named argument $... for method ... is deprecated and will not be supported in PHPUnit 11.0." in wmf deployed code
 OpenNoneT426489 Replace withConsecutive() in PHPUnit tests to support PHPUnit 10
 ResolvedUmherirrenderT426490 Replace withConsecutive() in Echo tests to support PHPUnit 10
 ResolvedUmherirrenderT426491 Replace withConsecutive() in TimedMediaHandler tests to support PHPUnit 10
 ResolvedsiebrandT426492 Replace withConsecutive() in Translate tests to support PHPUnit 10
 ResolvedUmherirrenderT426493 Replace withConsecutive() in Wikibase tests to support PHPUnit 10
 Resolved• Dreamy_JazzT426497 GlobalPreferencesHandlerTest in IPInfo causes "Empty data set provided by data provider" failures under PHPUnit 10
 ResolvedUmherirrenderT426498 Replace setMethodsExcept() in PHPUnit tests to support PHPUnit 10
 ResolvedUmherirrenderT426499 Replace setMethodsExcept() in OAuth tests to support PHPUnit 10
 ResolvedUmherirrenderT426500 Replace setMethodsExcept() in Wikibase tests to support PHPUnit 10
 ResolvedUmherirrenderT426504 Replace getInvocationCount() in PHPUnit tests to support PHPUnit 10
 ResolvedUmherirrenderT426505 Replace getInvocationCount() in EventBus tests to support PHPUnit 10
 ResolvedUmherirrenderT426506 Replace getInvocationCount() in GrowthExperiments tests to support PHPUnit 10
 ResolvedUmherirrenderT426507 Replace getInvocationCount() in TestKitchen tests to support PHPUnit 10
 ResolvedUmherirrenderT426508 Replace getInvocationCount() in Wikibase tests to support PHPUnit 10
 OpenNoneT426517 Update giorgiosironi/eris in mediawiki/core for php8.4 support / PHPUnit 10 support
 OpenNoneT427159 CommonsMetadata failure under PHPUnit 10 with NameAlreadyInUseException: The name "LocalFileMock" is already in use
 OpenNoneT427320 PerformanceBudgetTest::testTotalModulesSize reported as risky test under PHPUnit 10
 ResolvedNoneT428967 Rework/Analyse output buffer situation in integration tests around "MediaWikiIntegrationTestCase::wfResetOutputBuffersBarrier" for PHPUnit 10 compatibility
 OpenDaimonaT420009 See if it's possible to run PHPUnit tests without `stderr=true` and without `ob_start`
 ResolvedJdforrester-WMFT319055 Upgrade to psr/container 2.x
 ResolvedJdforrester-WMFT328921 Drop PHP 7.4 and PHP 8.0 support from MediaWiki
 ResolvedKrinkleT319432 Migrate WMF production from PHP 7.4 to PHP 8.1
 Resolved• Scott_FrenchT383845 MediaWiki on PHP 8.1 production traffic ramp-up
 ResolvedoriT385199 Gather PHP 8.1 profiling data

Event Timeline

jijiki created this task.Jan 30 2025, 4:08 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 30 2025, 4:08 PM
jijiki added a parent task: T383845: MediaWiki on PHP 8.1 production traffic ramp-up.Jan 30 2025, 4:09 PM
• mszabo subscribed.Jan 30 2025, 5:50 PM
jijiki moved this task from Incoming 🐫 to this.quarter 🍕 on the serviceops-deprecated board.Feb 3 2025, 1:24 PM
gerritbot added a comment.Feb 6 2025, 6:06 PM

Change #1117945 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/mediawiki-config@master] Route PHP8 Excimer profiles to separate ArcLamp sinks

https://gerrit.wikimedia.org/r/1117945

gerritbot added a project: Patch-For-Review.Feb 6 2025, 6:06 PM

Change #1117946 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/puppet@production] Set up ArcLamp pipeline for PHP8

https://gerrit.wikimedia.org/r/1117946

gerritbot added a comment.Feb 6 2025, 6:24 PM

Change #1117946 merged by CDanis:

[operations/puppet@production] Set up ArcLamp pipeline for PHP8

https://gerrit.wikimedia.org/r/1117946

gerritbot added a comment.Feb 6 2025, 6:30 PM

Change #1117945 merged by jenkins-bot:

[operations/mediawiki-config@master] Route PHP8 Excimer profiles to separate ArcLamp sinks

https://gerrit.wikimedia.org/r/1117945

Stashbot added a comment.Feb 6 2025, 6:31 PM

Mentioned in SAL (#wikimedia-operations) [2025-02-06T18:31:05Z] <cdanis@deploy2002> Started scap sync-world: Backport for [[gerrit:1117945|Route PHP8 Excimer profiles to separate ArcLamp sinks (T383845 T385395 T385199)]]

Stashbot mentioned this in T383845: MediaWiki on PHP 8.1 production traffic ramp-up.Feb 6 2025, 6:31 PM
Stashbot mentioned this in T385395: 503 error when edit large size pages on PHP 8.1.
CDanis subscribed.Feb 6 2025, 6:32 PM
Stashbot added a comment.Feb 6 2025, 6:33 PM

Mentioned in SAL (#wikimedia-operations) [2025-02-06T18:33:53Z] <cdanis@deploy2002> cdanis: Backport for [[gerrit:1117945|Route PHP8 Excimer profiles to separate ArcLamp sinks (T383845 T385395 T385199)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Stashbot added a comment.Feb 6 2025, 6:42 PM

Mentioned in SAL (#wikimedia-operations) [2025-02-06T18:42:04Z] <cdanis@deploy2002> Finished scap sync-world: Backport for [[gerrit:1117945|Route PHP8 Excimer profiles to separate ArcLamp sinks (T383845 T385395 T385199)]] (duration: 10m 58s)

Maintenance_bot removed a project: Patch-For-Review.Feb 6 2025, 7:30 PM
gerritbot added a comment.Feb 7 2025, 1:48 AM

Change #1117998 had a related patch set uploaded (by Ori; author: Ori):

[operations/puppet@production] Fix channel name for ArcLamp pipeline for PHP8

https://gerrit.wikimedia.org/r/1117998

gerritbot added a project: Patch-For-Review.Feb 7 2025, 1:48 AM
gerritbot added a comment.Feb 7 2025, 1:59 AM

Change #1117998 merged by Ori:

[operations/puppet@production] Fix channel name for ArcLamp pipeline for PHP8

https://gerrit.wikimedia.org/r/1117998

Maintenance_bot removed a project: Patch-For-Review.Feb 7 2025, 2:30 AM
Reedy renamed this task from Gather PHP8.1 profiling data to Gather PHP 8.1 profiling data .Mar 7 2025, 11:07 PM
Krinkle added a subscriber: ori.EditedMar 19 2025, 11:47 PM

Be careful when using Arc Lamp profiles from the last few weeks in side-by-side comparisons, because of T389243. \cc @ori

In T389243#10648713, @Krinkle wrote:

This is causing performance.wikimedia.org flamegraphs to show bogus data [on PHP 8.1].

Specifically, it means we have no telemetry [in PHP 8.1] on the first few whole seconds of a response — which for the majority of requests, is the entire duration of the response.

ori added a comment.Mar 20 2025, 6:10 AM

Ack, thanks for the heads up.

Krinkle mentioned this in T391516: https://performance.wikimedia.org/php-profiling/ leads to 404 for all listed sources.Apr 9 2025, 7:13 PM
ori closed this task as Resolved.Apr 23 2025, 4:39 PM
ori claimed this task.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits