Change Details

We want to migrate the async jobs to use PHP7, and to be able to do so job-by-job. In order to do this, we need to: * Pick a couple jobs to test first, change their configuration in changeprop to sending the PHP_ENGINE=php7 cookie * Once we're convinced by both the latencies and the overall performance, switch the other jobs progressively * Check that logs/errors are collected * Check that metrics are collected * Amend the apache configuration to remove the need for the cookie * Revert the addition of the cookie to changeprop Job list, roughly we'll migrate in that order: [x] updateBetaFeaturesUserCounts (510703) [x] RecordLintJob (511436) [x] htmlCacheUpdate (511649) [x] wikibase-addUsagesForPage (511913) [x] ORESFetchScoresJob (512858) [x] RecentChangesUpdate() (Hight traffic, user visible)(512872) [] MessageIndexRebuildJob [] flaggedrevs_CacheUpdate [] deleteLinks [] cdnPurge [] cdnPurg [] refreshLinks (too much traffic) [] RefreshLinks (too much traffic) [] refreshLinksPrioritized (too much traffic) [] EchoNotificationDeleteJob [] wikibase-InjectRCRecords [] categoryMembershipChange [] AssembleUploadChunks [] BounceHandlerJob [] CentralAuthCreateLocalAccountJob [] enotifNotify [] gwtoolsetGWTFileBackendCleanupJob [] LocalPageMoveJob [] LocalRenameUserJob [] LoginNotifyChecks [] MassMessageJob [] MassMessageSubmitJob [] MessageGroupStatesUpdaterJob [] PublishStashedFile [] GlobalUserPageLocalJobSubmitJob [] renameUser [] ThumbnailRender (?) [] TranslationsUpdateJob [] TranslateRenderJob [] TranslatablePageMoveJob [] TranslateDeleteJob [] UpdateRepoOnDelete [] UpdateRepoOnMove [] webVideoTranscode [] webVideoTranscodePrioritized [] wikibase-UpdateUsagesForPage (super high traffic) [] ChangeNotification (hight rate) [] CognateCacheUpdateJob (basically a wrapper over HTMLCacheUpdatejob) [] EchoNotificationJob [] cirrusSearchCheckerJob (Tricky. It runs from a cron script scheduling bulk jobs with a set of pageIds and uses delay 1,2,3,4... to scatter the jobs in time) [] cirrusSearchMassIndex [] sendMail [] cirrusSearchDeleteArchive [] deletePage [] cirrusSearchOtherIndex [] refreshLinksDynamic [] LocalSharedHelpPageCacheUpdateJob [] cirrusSearchJobChecker [] constraintsTableUpdate [] synchroniseThreadArticleData [] cirrusSearchLinksUpdatePrioritized [] cirrusSearchElasticaWrite [] compileArticleMetadata [] clearUserWatchlist [] BounceHandlerNotificationJob [] cirrusSearchIncomingLinkCount [] MessageGroupStatsRebuildJob [] cpjobqueue.error [] gwtoolsetUploadMetadataJob [] CognateLocalJobSubmitJob [] cirrusSearchDeletePages [] TTMServerMessageUpdateJob [] LocalRenameUserJob [] userGroupExpiry [] crosswikiSuppressUser [] securePollPopulateVoterList [] CentralAuthUnattachUserJob [] --domain [] htmlCacheUpdate [] LocalGlobalUserPageCacheUpdateJob [] globalUsageCachePurge [] constraintsRunCheck [] MassMessageServerSideJob [] activityUpdateJob [] translationNotificationJob [] cirrusSearchLinksUpdate mediawiki/includes/jobqueue/jobs/ ``` 1 LoginNotifyChecks 2 RecordLintJob 3 EchoNotificationDeleteJob 8 cirrusSearchIncomingLinkCount 8 enotifNotify 10 activityUpdateJob 58 cirrusSearchLinksUpdatePrioritized 63 recentChangesUpdate 64 refreshLinks 72 categoryMembershipChange 81 cirrusSearchLinksUpdate 165 htmlCacheUpdate 2000 cirrusSearchCheckerJob ``` Graphs: * https://grafana.wikimedia.org/d/000000400/jobqueue-eventbus?orgId=1

We want to migrate the async jobs to use PHP7, and to be able to do so job-by-job. In order to do this, we need to: * Pick a couple jobs to test first, change their configuration in changeprop to sending the PHP_ENGINE=php7 cookie * Once we're convinced by both the latencies and the overall performance, switch the other jobs progressively * Check that logs/errors are collected * Check that metrics are collected * Amend the apache configuration to remove the need for the cookie * Revert the addition of the cookie to changeprop Job list, roughly we'll migrate in that order: [x] updateBetaFeaturesUserCounts (510703) [x] RecordLintJob (511436) [x] htmlCacheUpdate (511649) [x] wikibase-addUsagesForPage (511913) [x] ORESFetchScoresJob (512858) [x] RecentChangesUpdate() (Hight traffic, user visible)(512872) [x] refreshLinks (too much traffic) [] MessageIndexRebuildJob [] flaggedrevs_CacheUpdate [] deleteLinks [] cdnPurge [] cdnPurg [] refreshLinksPrioritized (too much traffic) [] EchoNotificationDeleteJob [] wikibase-InjectRCRecords [] categoryMembershipChange [] AssembleUploadChunks [] BounceHandlerJob [] CentralAuthCreateLocalAccountJob [] enotifNotify [] gwtoolsetGWTFileBackendCleanupJob [] LocalPageMoveJob [] LocalRenameUserJob [] LoginNotifyChecks [] MassMessageJob [] MassMessageSubmitJob [] MessageGroupStatesUpdaterJob [] PublishStashedFile [] GlobalUserPageLocalJobSubmitJob [] renameUser [] ThumbnailRender (?) [] TranslationsUpdateJob [] TranslateRenderJob [] TranslatablePageMoveJob [] TranslateDeleteJob [] UpdateRepoOnDelete [] UpdateRepoOnMove [] webVideoTranscode [] webVideoTranscodePrioritized [] wikibase-UpdateUsagesForPage (super high traffic) [] ChangeNotification (hight rate) [] CognateCacheUpdateJob (basically a wrapper over HTMLCacheUpdatejob) [] EchoNotificationJob [] cirrusSearchCheckerJob (Tricky. It runs from a cron script scheduling bulk jobs with a set of pageIds and uses delay 1,2,3,4... to scatter the jobs in time) [] cirrusSearchMassIndex [] sendMail [] cirrusSearchDeleteArchive [] deletePage [] cirrusSearchOtherIndex [] refreshLinksDynamic [] LocalSharedHelpPageCacheUpdateJob [] cirrusSearchJobChecker [] constraintsTableUpdate [] synchroniseThreadArticleData [] cirrusSearchLinksUpdatePrioritized [] cirrusSearchElasticaWrite [] compileArticleMetadata [] clearUserWatchlist [] BounceHandlerNotificationJob [] cirrusSearchIncomingLinkCount [] MessageGroupStatsRebuildJob [] cpjobqueue.error [] gwtoolsetUploadMetadataJob [] CognateLocalJobSubmitJob [] cirrusSearchDeletePages [] TTMServerMessageUpdateJob [] LocalRenameUserJob [] userGroupExpiry [] crosswikiSuppressUser [] securePollPopulateVoterList [] CentralAuthUnattachUserJob [] --domain [] htmlCacheUpdate [] LocalGlobalUserPageCacheUpdateJob [] globalUsageCachePurge [] constraintsRunCheck [] MassMessageServerSideJob [] activityUpdateJob [] translationNotificationJob [] cirrusSearchLinksUpdate mediawiki/includes/jobqueue/jobs/ ``` 1 LoginNotifyChecks 2 RecordLintJob 3 EchoNotificationDeleteJob 8 cirrusSearchIncomingLinkCount 8 enotifNotify 10 activityUpdateJob 58 cirrusSearchLinksUpdatePrioritized 63 recentChangesUpdate 64 refreshLinks 72 categoryMembershipChange 81 cirrusSearchLinksUpdate 165 htmlCacheUpdate 2000 cirrusSearchCheckerJob ``` Graphs: * https://grafana.wikimedia.org/d/000000400/jobqueue-eventbus?orgId=1

We want to migrate the async jobs to use PHP7, and to be able to do so job-by-job. In order to do this, we need to: * Pick a couple jobs to test first, change their configuration in changeprop to sending the PHP_ENGINE=php7 cookie * Once we're convinced by both the latencies and the overall performance, switch the other jobs progressively * Check that logs/errors are collected * Check that metrics are collected * Amend the apache configuration to remove the need for the cookie * Revert the addition of the cookie to changeprop Job list, roughly we'll migrate in that order: [x] updateBetaFeaturesUserCounts (510703) [x] RecordLintJob (511436) [x] htmlCacheUpdate (511649) [x] wikibase-addUsagesForPage (511913) [x] ORESFetchScoresJob (512858) [x] RecentChangesUpdate() (Hight traffic, user visible)(512872) [x] refreshLinks (too much traffic) [] MessageIndexRebuildJob [] flaggedrevs_CacheUpdate [] deleteLinks [] cdnPurge [] cdnPurg [] refreshLinks (too much traffic) [] RefreshLinks (too much traffic) [] refreshLinksPrioritized (too much traffic) [] EchoNotificationDeleteJob [] wikibase-InjectRCRecords [] categoryMembershipChange [] AssembleUploadChunks [] BounceHandlerJob [] CentralAuthCreateLocalAccountJob [] enotifNotify [] gwtoolsetGWTFileBackendCleanupJob [] LocalPageMoveJob [] LocalRenameUserJob [] LoginNotifyChecks [] MassMessageJob [] MassMessageSubmitJob [] MessageGroupStatesUpdaterJob [] PublishStashedFile [] GlobalUserPageLocalJobSubmitJob [] renameUser [] ThumbnailRender (?) [] TranslationsUpdateJob [] TranslateRenderJob [] TranslatablePageMoveJob [] TranslateDeleteJob [] UpdateRepoOnDelete [] UpdateRepoOnMove [] webVideoTranscode [] webVideoTranscodePrioritized [] wikibase-UpdateUsagesForPage (super high traffic) [] ChangeNotification (hight rate) [] CognateCacheUpdateJob (basically a wrapper over HTMLCacheUpdatejob) [] EchoNotificationJob [] cirrusSearchCheckerJob (Tricky. It runs from a cron script scheduling bulk jobs with a set of pageIds and uses delay 1,2,3,4... to scatter the jobs in time) [] cirrusSearchMassIndex [] sendMail [] cirrusSearchDeleteArchive [] deletePage [] cirrusSearchOtherIndex [] refreshLinksDynamic [] LocalSharedHelpPageCacheUpdateJob [] cirrusSearchJobChecker [] constraintsTableUpdate [] synchroniseThreadArticleData [] cirrusSearchLinksUpdatePrioritized [] cirrusSearchElasticaWrite [] compileArticleMetadata [] clearUserWatchlist [] BounceHandlerNotificationJob [] cirrusSearchIncomingLinkCount [] MessageGroupStatsRebuildJob [] cpjobqueue.error [] gwtoolsetUploadMetadataJob [] CognateLocalJobSubmitJob [] cirrusSearchDeletePages [] TTMServerMessageUpdateJob [] LocalRenameUserJob [] userGroupExpiry [] crosswikiSuppressUser [] securePollPopulateVoterList [] CentralAuthUnattachUserJob [] --domain [] htmlCacheUpdate [] LocalGlobalUserPageCacheUpdateJob [] globalUsageCachePurge [] constraintsRunCheck [] MassMessageServerSideJob [] activityUpdateJob [] translationNotificationJob [] cirrusSearchLinksUpdate mediawiki/includes/jobqueue/jobs/ ``` 1 LoginNotifyChecks 2 RecordLintJob 3 EchoNotificationDeleteJob 8 cirrusSearchIncomingLinkCount 8 enotifNotify 10 activityUpdateJob 58 cirrusSearchLinksUpdatePrioritized 63 recentChangesUpdate 64 refreshLinks 72 categoryMembershipChange 81 cirrusSearchLinksUpdate 165 htmlCacheUpdate 2000 cirrusSearchCheckerJob ``` Graphs: * https://grafana.wikimedia.org/d/000000400/jobqueue-eventbus?orgId=1