Change Details

We want to migrate the async jobs to use PHP7, and to be able to do so job-by-job. In order to do this, we need to: * Pick a couple jobs to test first, change their configuration in changeprop to sending the PHP_ENGINE=php7 cookie * Once we're convinced by both the latencies and the overall performance, switch the other jobs progressively * Check that logs/errors are collected * Check that metrics are collected * Amend the apache configuration to remove the need for the cookie * Revert the addition of the cookie to changeprop Job list, roughly we'll migrate in that order: [x] updateBetaFeaturesUserCounts (510703) [x] RecordLintJob (511436) [x] htmlCacheUpdate (511649) [x] wikibase-addUsagesForPage (511913) [x] ORESFetchScoresJob (512858) [x] RecentChangesUpdate() (Hight traffic, user visible)(512872) [x] refreshLinks (too much traffic) [x] cirrusSearchCheckerJob (Tricky. It runs from a cron script scheduling bulk jobs with a set of pageIds and uses delay 1,2,3,4... to scatter the jobs in time [x] cirrusSearchDeleteArchive [x] cirrusSearchDeletePages [x] cirrusSearchElasticaWrite [x] cirrusSearchIncomingLinkCount [x] cirrusSearchLinksUpdate [x] cirrusSearchLinksUpdatePrioritized [x] cirrusSearchOtherIndex [x] cdnPurge [x] categoryMembershipChange [x] ThumbnailRender [x] constraintsRunCheck [x] webVideoTranscode [x] webVideoTranscodePrioritized The following jobs will be migrated as we are migrating jobrunners to serve via PHP7 only: [] refreshLinksPrioritized (too much traffic) [] TranslationsUpdateJob [] TranslateRenderJob [] TranslatablePageMoveJob [] TranslateDeleteJob [] translationNotificationJob [] wikibase-UpdateUsagesForPage (super high traffic) [] ChangeNotification (hight rate) [] CognateCacheUpdateJob (basically a wrapper over HTMLCacheUpdatejob) [] flaggedrevs_CacheUpdate [] deleteLinks [] EchoNotificationDeleteJob [] wikibase-InjectRCRecords [] AssembleUploadChunks [] BounceHandlerJob [] CentralAuthCreateLocalAccountJob [] enotifNotify [] gwtoolsetGWTFileBackendCleanupJob [] LocalPageMoveJob [] LocalRenameUserJob [] LoginNotifyChecks [] MassMessageJob [] MassMessageSubmitJob [] MassMessageServerSideJob [] MessageGroupStatesUpdaterJob [] MessageIndexRebuildJob [] PublishStashedFile [] GlobalUserPageLocalJobSubmitJob [] renameUser [] UpdateRepoOnDelete [] UpdateRepoOnMove [] EchoNotificationJob [] cirrusSearchMassIndex [] sendMail [] deletePage [] refreshLinksDynamic [] LocalSharedHelpPageCacheUpdateJob [] cirrusSearchJobChecker [] constraintsTableUpdate [] synchroniseThreadArticleData [] compileArticleMetadata [] clearUserWatchlist [] BounceHandlerNotificationJob [] MessageGroupStatsRebuildJob [] cpjobqueue.error [] gwtoolsetUploadMetadataJob [] CognateLocalJobSubmitJob [] TTMServerMessageUpdateJob [] LocalRenameUserJob [] userGroupExpiry [] crosswikiSuppressUser [] securePollPopulateVoterList [] CentralAuthUnattachUserJob [] LocalGlobalUserPageCacheUpdateJob [] globalUsageCachePurge [] activityUpdateJob mediawiki/includes/jobqueue/jobs/ ``` 1 LoginNotifyChecks 2 RecordLintJob 3 EchoNotificationDeleteJob 8 cirrusSearchIncomingLinkCount 8 enotifNotify 10 activityUpdateJob 58 cirrusSearchLinksUpdatePrioritized 63 recentChangesUpdate 64 refreshLinks 72 categoryMembershipChange 81 cirrusSearchLinksUpdate 165 htmlCacheUpdate 2000 cirrusSearchCheckerJob ``` Graphs: * https://grafana.wikimedia.org/d/000000400/jobqueue-eventbus?orgId=1

We want to migrate the async jobs to use PHP7, and to be able to do so job-by-job. In order to do this, we need to: * Pick a couple jobs to test first, change their configuration in changeprop to sending the PHP_ENGINE=php7 cookie * Once we're convinced by both the latencies and the overall performance, switch the other jobs progressively * Check that logs/errors are collected * Check that metrics are collected * Amend the apache configuration to remove the need for the cookie * Revert the addition of the cookie to changeprop Job list, roughly we'll migrate in that order: [x] updateBetaFeaturesUserCounts (510703) [x] RecordLintJob (511436) [x] htmlCacheUpdate (511649) [x] wikibase-addUsagesForPage (511913) [x] ORESFetchScoresJob (512858) [x] RecentChangesUpdate() (Hight traffic, user visible)(512872) [x] refreshLinks (too much traffic) [x] cirrusSearchCheckerJob (Tricky. It runs from a cron script scheduling bulk jobs with a set of pageIds and uses delay 1,2,3,4... to scatter the jobs in time [x] cirrusSearchDeleteArchive [x] cirrusSearchDeletePages [x] cirrusSearchElasticaWrite [x] cirrusSearchIncomingLinkCount [x] cirrusSearchLinksUpdate [x] cirrusSearchLinksUpdatePrioritized [x] cirrusSearchOtherIndex [x] cdnPurge [x] categoryMembershipChange [x] ThumbnailRender [x] constraintsRunCheck [x] webVideoTranscode [x] webVideoTranscodePrioritized The following jobs will be migrated as we are migrating jobrunners to serve via PHP7 only: [x] refreshLinksPrioritized (too much traffic) [x] TranslationsUpdateJob [x] TranslateRenderJob [x] TranslatablePageMoveJob [x] TranslateDeleteJob [x] translationNotificationJob [x] wikibase-UpdateUsagesForPage (super high traffic) [x] ChangeNotification (hight rate) [x] CognateCacheUpdateJob (basically a wrapper over HTMLCacheUpdatejob) [x] flaggedrevs_CacheUpdate [x] deleteLinks [x] EchoNotificationDeleteJob [x] wikibase-InjectRCRecords [x] AssembleUploadChunks [x] BounceHandlerJob [x] CentralAuthCreateLocalAccountJob [x] enotifNotify [x] gwtoolsetGWTFileBackendCleanupJob [x] LocalPageMoveJob [x] LocalRenameUserJob [x] LoginNotifyChecks [x] MassMessageJob [x] MassMessageSubmitJob [x] MassMessageServerSideJob [x] MessageGroupStatesUpdaterJob [x] MessageIndexRebuildJob [x] PublishStashedFile [x] GlobalUserPageLocalJobSubmitJob [x] renameUser [x] UpdateRepoOnDelete [x] UpdateRepoOnMove [x] EchoNotificationJob [x] cirrusSearchMassIndex [x] sendMail [x] deletePage [x] refreshLinksDynamic [x] LocalSharedHelpPageCacheUpdateJob [x] cirrusSearchJobChecker [x] constraintsTableUpdate [x] synchroniseThreadArticleData [x] compileArticleMetadata [x] clearUserWatchlist [x] BounceHandlerNotificationJob [x] MessageGroupStatsRebuildJob [x] cpjobqueue.error [x] gwtoolsetUploadMetadataJob [x] CognateLocalJobSubmitJob [x] TTMServerMessageUpdateJob [x] LocalRenameUserJob [x] userGroupExpiry [x] crosswikiSuppressUser [x] securePollPopulateVoterList [x] CentralAuthUnattachUserJob [x] LocalGlobalUserPageCacheUpdateJob [x]globalUsageCachePurge [x] activityUpdateJob Notes: mediawiki/includes/jobqueue/jobs/ ``` 1 LoginNotifyChecks 2 RecordLintJob 3 EchoNotificationDeleteJob 8 cirrusSearchIncomingLinkCount 8 enotifNotify 10 activityUpdateJob 58 cirrusSearchLinksUpdatePrioritized 63 recentChangesUpdate 64 refreshLinks 72 categoryMembershipChange 81 cirrusSearchLinksUpdate 165 htmlCacheUpdate 2000 cirrusSearchCheckerJob ``` Graphs: * https://grafana.wikimedia.org/d/000000400/jobqueue-eventbus?orgId=1

We want to migrate the async jobs to use PHP7, and to be able to do so job-by-job. In order to do this, we need to: * Pick a couple jobs to test first, change their configuration in changeprop to sending the PHP_ENGINE=php7 cookie * Once we're convinced by both the latencies and the overall performance, switch the other jobs progressively * Check that logs/errors are collected * Check that metrics are collected * Amend the apache configuration to remove the need for the cookie * Revert the addition of the cookie to changeprop Job list, roughly we'll migrate in that order: [x] updateBetaFeaturesUserCounts (510703) [x] RecordLintJob (511436) [x] htmlCacheUpdate (511649) [x] wikibase-addUsagesForPage (511913) [x] ORESFetchScoresJob (512858) [x] RecentChangesUpdate() (Hight traffic, user visible)(512872) [x] refreshLinks (too much traffic) [x] cirrusSearchCheckerJob (Tricky. It runs from a cron script scheduling bulk jobs with a set of pageIds and uses delay 1,2,3,4... to scatter the jobs in time [x] cirrusSearchDeleteArchive [x] cirrusSearchDeletePages [x] cirrusSearchElasticaWrite [x] cirrusSearchIncomingLinkCount [x] cirrusSearchLinksUpdate [x] cirrusSearchLinksUpdatePrioritized [x] cirrusSearchOtherIndex [x] cdnPurge [x] categoryMembershipChange [x] ThumbnailRender [x] constraintsRunCheck [x] webVideoTranscode [x] webVideoTranscodePrioritized The following jobs will be migrated as we are migrating jobrunners to serve via PHP7 only: [x] refreshLinksPrioritized (too much traffic) [x] TranslationsUpdateJob [x] TranslateRenderJob [x] TranslatablePageMoveJob [x] TranslateDeleteJob [x] translationNotificationJob [] wikibase-UpdateUsagesForPage (super high traffic)b [] ChangeNotification (x] wikibase-UpdateUsagesForPage (super hight rate traffic) [x] ChangeNotification (hight rate) [x] CognateCacheUpdateJob (basically a wrapper over HTMLCacheUpdatejob) [] flaggedrevs_CacheUpdate [] deleteLinksx] flaggedrevs_CacheUpdate [] EchoNotificationDx] deleteJobLinks [] wikibase-InjectRCRecordsx] EchoNotificationDeleteJob [] AssembleUploadChunksx] wikibase-InjectRCRecords [] BounceHandlerJobx] AssembleUploadChunks [] CentralAuthCreateLocalAccountJobx] BounceHandlerJob [] enotifNotifyx] CentralAuthCreateLocalAccountJob [] gwtoolsetGWTFileBackendCleanupJobx] enotifNotify [] LocalPageMoveJobx] gwtoolsetGWTFileBackendCleanupJob [x] LocalRenameUserJobPageMoveJob [x] LoginNotifyCheckscalRenameUserJob [] MassMessageJobx] LoginNotifyChecks [x] MassMessageSubmitJobJob [x] MassMessageServerSideJobubmitJob [] MessageGroupStatesUpdaterJobx] MassMessageServerSideJob [x] MessageIndexRebuildJobGroupStatesUpdaterJob [] PublishStashedFilex] MessageIndexRebuildJob [] GlobalUserPageLocalJobSubmitJobx] PublishStashedFile [] renameUserx] GlobalUserPageLocalJobSubmitJob [] UpdateRepoOnDeletex] renameUser [x] UpdateRepoOnMoveDelete [] EchoNotificationJobx] UpdateRepoOnMove [] cirrusSearchMassIndexx] EchoNotificationJob [] sendMailx] cirrusSearchMassIndex [] deletePagex] sendMail [] refreshLinksDynamicx] deletePage [] LocalSharedHelpPageCacheUpdateJobx] refreshLinksDynamic [] cirrusSearchJobCheckerx] LocalSharedHelpPageCacheUpdateJob [] constraintsTableUpdatex] cirrusSearchJobChecker [] synchroniseThreadArticleDatax] constraintsTableUpdate [] compilex] synchroniseThreadArticleMetadataeData [] clearUserWatchlistx] compileArticleMetadata [] BounceHandlerNotificationJobx] clearUserWatchlist [] MessageGroupStatsRebuildJobx] BounceHandlerNotificationJob [] cpjobqueue.errorx] MessageGroupStatsRebuildJob [] gwtoolsetUploadMetadataJobx] cpjobqueue.error [] CognateLocalJobSubmitJobx] gwtoolsetUploadMetadataJob [] TTMServerMessageUpdateJobx] CognateLocalJobSubmitJob [] LocalRenameUserJobx] TTMServerMessageUpdateJob [] userGroupExpiryx] LocalRenameUserJob [] crosswikiSuppressUserx] userGroupExpiry [] securePollPopulateVoterListx] crosswikiSuppressUser [] CentralAuthUnattachUserJobx] securePollPopulateVoterList [] LocalGlobalUserPageCacheUpdateJobx] CentralAuthUnattachUserJob [] gx] LocalGlobalUserPageCachePurgeUpdateJob [x]globalUsageCachePurge [x] activityUpdateJob Notes: mediawiki/includes/jobqueue/jobs/ ``` 1 LoginNotifyChecks 2 RecordLintJob 3 EchoNotificationDeleteJob 8 cirrusSearchIncomingLinkCount 8 enotifNotify 10 activityUpdateJob 58 cirrusSearchLinksUpdatePrioritized 63 recentChangesUpdate 64 refreshLinks 72 categoryMembershipChange 81 cirrusSearchLinksUpdate 165 htmlCacheUpdate 2000 cirrusSearchCheckerJob ``` Graphs: * https://grafana.wikimedia.org/d/000000400/jobqueue-eventbus?orgId=1