Page MenuHomePhabricator
Create Task
Maniphest T364249

New upstream release for Pygments (2.18.0)
Open, Stalled, Needs TriagePublicFeature
Actions

Description

A new upstream version of Pygments is now available: 2.18.0.

This release includes updates for the wikitext lexer by @Diskdance:

Previously: T351744: New upstream release for Pygments (2.17.2)

Details

SubjectRepoBranchLines +/-
Pygmentize: report stderr when exit code != 0 and stdout is emptymediawiki/extensions/SyntaxHighlight_GeSHimaster+5 -1
Update Pygments to 2.18.0mediawiki/extensions/SyntaxHighlight_GeSHimaster+19 -1
syntaxhighlight: Update Pygments to 2.18.0mediawiki/libs/Shellboxmaster+2 -2
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 StalledFeatureNoneT364249 New upstream release for Pygments (2.18.0)
 StalledKrinkleT319432 Migrate WMF production from PHP 7.4 to PHP 8.1
 ResolvedtstarlingT292552 Rename articles and users to update our case mapping to PHP 7.4 and Unicode 11
 ResolvedJdforrester-WMFT316078 Make PHP 8.1 voting on development (master) branch of MW ecosystem (core, extensions, skins, libraries)
 ResolvedJdforrester-WMFT319065 All Wikimedia production extensions and skins must support PHP 8.1
 ResolvedtstarlingT314212 str_replace(): Passing null to parameter #3 ($subject) of type array|string is deprecated
 ResolvedReedyT311448 Echo PHP 8.1 support
 ResolvedBUG REPORTtstarlingT289925 FILTER_SANITIZE_STRING is deprecated in PHP 8.1
 ResolvedtstarlingT320726 Fix RandomImageGenerator as used in tests to work on PHP 8.1 without errors or warnings
 ResolvedDaimonaT311451 Re-enable PHP 8.1 CI on css-sanitizer
 ResolvedDaimonaT311452 Taint Check Plugin release
 ResolvedNoneT307506 Address PHP 8.1 job failures on various PHP libs
 ResolvedJdforrester-WMFT311450 Re-enable PHP 8.1 CI on RemexHTML
 ResolvedBUG REPORTNoneT308406 RemexHtml should support PHP 8.1
 ResolvedtstarlingT307630 mediawiki/libs/RemexHtml phan issues under 8.1
 ResolvedJdforrester-WMFT311463 Re-enable PHP 8.1 CI on Zest
 ResolvedssastryT307632 mediawiki/libs/Zest phan issues under 8.1
 ResolvedkostajhT321600 GrowthExperiments PHP 8.1 support
 ResolvedkostajhT321691 StructuredDiscussions support for PHP 8.1
 ResolvedthiemowmdeT321692 FileImporter support for PHP 8.1
 ResolvedtstarlingT322098 GeoData support for PHP 8.1
 ResolvedtstarlingT322099 TwoColConflict support for PHP 8.1
 ResolvedBUG REPORT• Lucas_Werkmeister_WMDET319219 Wikibase gives deprecated warnings on php 8.1
 ResolvedhooT301249 Handle deprecation of Serializable interface in Wikibase
 ResolvedhooT305785 Wikibase Snak hashes (and thus "mainsnak", "references" and "qualifiers" hashes) depend on legacy PHP serialization
 ResolvedJdforrester-WMFT322233 PageViewInfo support for PHP 8.1
 ResolvedthiemowmdeT322408 CirrusSearch support for PHP 8.1
 ResolvedkostajhT322838 PageTriage PHP 8.1 support
 ResolvedUmherirrenderT323056 STVTallierTest::testFinishTally() fails under PHP 8.0 and later
 ResolvedPRODUCTION ERROR• brookeT289189 getid3: PHP Warning: Division by zero
 ResolvedTheresNoTimeT332356 function strftime() is deprecated in php8.1 used by Calendar extension
 ResolvedtstarlingT322278 MediaWiki core should pass Phan on PHP 8.1
 OpenJdforrester-WMFT320818 Configure CI to test the Wikimedia production gate code against PHP 8.1 as well as PHP 7.4
 ResolvedlarissagauliaT321709 PHP 8.1 Upgrade Performance <-> SRE Service Ops coordination
 ResolvedJMeybohmT345561 Upgrade the MediaWiki servers to ICU 67
 ResolvedMoritzMuehlenhoffT350767 Rebuild PHP 7.4 packages for Bullseye
 OpenNoneT290536 Serve production traffic via Kubernetes
 ResolvedjijikiT280497 Benchmark performance of MediaWiki on k8s
 ResolvedaaronT293630 Investigate performance degradation at high concurrencies in php-fpm
OpenjijikiT292707 Migrate Wikitech to Kubernetes
 In ProgressClement_GoubertT321786 Deploy mediawiki kubernetes services
 ResolvedClement_GoubertT321895 Create mw-api-int helmfile deployment
 ResolvedClement_GoubertT321896 Create mw-api-ext helmfile deployment
 ResolvedClement_GoubertT321897 Create mw-jobrunner helmfile deployment
 StalledClement_GoubertT321899 Create mw-videoscaler helmfile deployment
 ResolvedClement_GoubertT321900 Create mw-web helmfile deployment
 ResolvedClement_GoubertT323296 Stop spamming SAL with helmfile on scap deployments
 ResolvedClement_GoubertT323621 Make mw-web and mw-api-ext available behind LVS
 ResolvedJoeT323349 Improve performance of deployment to mw on k8s
 ResolvedcolewhiteT325085 Increase in Logstash warnings
 ResolvedClement_GoubertT331318 Find a sensible way to direct traffic to mw-on-k8s
 ResolvedClement_GoubertT331268 Migrate testwikidata to Kubernetes
 In ProgressClement_GoubertT333120 Migrate internal traffic to k8s
 ResolvedClement_GoubertT334060 Migrate linkrecommendations to mw-api-int
 ResolvedClement_GoubertT334061 Migrate push-notifications to mw-api-int
 ResolvedClement_GoubertT334062 Migrate recommendation-api to mw-api-int
 InvalidClement_GoubertT334063 Migrate tegola-vector-tiles to mw-api-int
 ResolvedJoeT334064 Migrate termbox to mw-api-int
 ResolvedClement_GoubertT334065 Migrate api-gateway to mw-api-int
 ResolvedClement_GoubertT334204 Migrate cxserver to mw-api-int
 ResolvedClement_GoubertT334456 Monitor all mw-on-k8s deployments with httpbb
 ResolvedClement_GoubertT334561 Add mw-on-k8s deployments to mediawiki certificates
 ResolvedJoeT342252 Migrate rdf-streaming-updater to connect to mw-on-k8s
 ResolvedJoeT346447 Migrate wikifeeds to mw-api-int
 ResolvedJoeT346448 Migrate all eventgate installations to mw-api-int
 ResolvedJMeybohmT347397 Migrate functions-orchestrator service to mw-api-int
 ResolvedJoeT350846 Migrate mobileapps to k8s
 ResolvedClement_GoubertT357785 Migrate mw-page-content-change-enrich to mw-api-int
 ResolvedClement_GoubertT358213 Migrate restbase from mwapi-async to mw-api-int
 ResolvedClement_GoubertT298265 Have internal MediaWiki to MediaWiki HTTP requests use an envoyproxy on appservers
 DeclinedClement_GoubertT360625 Alter changeprop chart to use the service mesh
 ResolvedClement_GoubertT360767 Migrate changeprop to mw-api-int
 ResolvedelukeyT362316 Migrate ml-services to mw-api-int
 StalledKrinkleT333269 Benchmark baremetal vs k8s mediawiki perf (2023)
 ResolvedjijikiT336025 ResourceLoader icon rasterization fails via MediaWiki-on-Kubernetes
 ResolvedJoeT336037 Add configuration file support to mw-on-k8s.lua ATS script
 ResolvedJoeT336038 Add traffic sampling support to mw-on-k8s.lua ATS script
 ResolvedClement_GoubertT337490 Migrate group0 to Kubernetes
 ResolvedBUG REPORTClement_GoubertT340483 ExtensionDistributor is broken on k8s
 ResolvedClement_GoubertT337489 Run QTE test suite on testwiki on kubernetes
 ResolvedClement_GoubertT340549 Migrate group1 to Kubernetes
 ResolvedClement_GoubertT341078 Direct 0.5% of all traffic to mw-on-k8s
 ResolvedClement_GoubertT341463 Direct 1% of all traffic to mw-on-k8s
 ResolvedClement_GoubertT341780 Direct 5% of all traffic to mw-on-k8s
 ResolvedJoeT341825 Max upload size on k8s is 2M
 ResolvedClement_GoubertT342748 mw-on-k8s app container CPU throttling at low average load
 ResolvedClement_GoubertT343306 Wikikube CPU capacity issue
 ResolvedJclark-ctrT343708 Physical re-labeling of mw1497 and mw1498 to kubernetes1025 and kubernetes1026
 ResolvedJMeybohmT343978 Allow more flexibility in ResourceQuota and LimitRanger config
 ResolvedJoeT283056 Create a mwdebug deployment for mediawiki on kubernetes
 ResolvedJoeT284417 Add the puppet CA to the MediaWiki deployment
 ResolvedNoneT284418 Add conditional to mediawiki-config for stuff running on kubernetes
 ResolvedjijikiT284420 Add all redis and memcached backends to mw on k8s automatically
 ResolvedjijikiT284421 Enable TLS termination on the mwdebug deployment. fix the service definition in the chart
 ResolveddancyT284581 Ownership of the /tmp/mw-cache directories should be www-data in the mediawiki-multiversion image
 ResolveddancyT284582 The restricted/mediawiki-multiversion image should include the production version of private/PrivateSettings.php
 ResolvedJoeT285298 Make all httpbb tests pass on the mwdebug deployment.
 ResolvedJoeT285309 Install wiki-specific php extensions in the mediawiki production image
 ResolvedjeenaT285325 Check out www-portals repo in the mediawiki-webserver and in the mediawiki-multiversion images
 ResolvedJoeT285232 The restricted/mediawiki-webserver image should include skins and resources
 ResolvedJoeT286491 Access mwdebug kubernetes deployment via the 'X-Wikimedia-Debug' header
 ResolveddancyT287512 GitInfo is missing from mwdebug-kubernetes deployment
 ResolvedJoeT287570 Ensure the code is deployed to mediawiki on k8s when it is deployed to production
 Resolved• dpifkeT288164 Ensure WikimediaDebug "log" and "profile" features work with k8s-mwdebug
 ResolveddancyT287495 Create a variant of mediawiki-multiversion which installs php-tideways-xhprof
 ResolvedJoeT288851 Make logging work for mediawiki in k8s
 ResolvedClement_GoubertT326794 Ingest php-slowlog in logstash
 ResolvedcolewhiteT328318 Index orchestrator object fields from ECS 1.11.0 in OpenSearch
 ResolvedjijikiT290485 mediawiki-debug image does not produce profiling info
Resolved• dpifkeT288165 Create separate ArcLamp pipeline for k8s-mwdebug
 ResolvedLegoktmT288848 Make HTTP calls work within mediawiki on kubernetes
ResolvedClement_GoubertT343390 MW-on-k8s traffic logs fewer errors than expected (increase in jsonTruncated)
ResolvedJMeybohmT277876 Reserve resources for system daemons on kubernetes nodes
 ResolvedClement_GoubertT346422 Move 10% of mediawiki external requests to mw on k8s
 ResolvedClement_GoubertT344814 mw-on-k8s tls-proxy container CPU throttling at low average load
 OpenNoneT354532 Limit the concurrency of envoy in service mesh
 OpenClement_GoubertT345243 Remove tls-proxy cpu limits on eventstreams
 In ProgressClement_GoubertT345244 Remove tls-proxy cpu limits on eventgate
 ResolvedClement_GoubertT347493 Serve Wikidata traffic via Kubernetes
 ResolvedClement_GoubertT348122 Move 25% of mediawiki external requests to mw on k8s
 ResolvedhnowlanT349796 Move MediaWiki jobs to mw-on-k8s
 ResolvedakosiarisT352906 mediawiki k8s jobrunner fails connecting to cloudelastic with a TLS error
 OpenhnowlanT354791 Reclaim jobrunner hardware for k8s
 ResolvedClement_GoubertT355622 scap not installed on mw1486.eqiad.wmnet which breaks deployment: /usr/bin/scap: No such file or directory
 ResolvedNoneT355243 MediaModeration maintenance script scanFilesInScanTable.php indirectly calls $wgImageMagickConvertCommand
 ResolvedDreamy_JazzT355309 Don't use RENDER_NOW when generating thumbnails for PhotoDNA scans
 ResolvedPRODUCTION ERRORDreamy_JazzT355177 Error creating thumbnail: mkdir: cannot create directory '/sys/fs/cgroup/memory/mediawiki/job/XXXXX':
 ResolvedkostajhT356047 Attempt to generate thumbnail by requesting URL
 ResolvedjijikiT359154 Update DC switchover cookbooks to handle mw-jobrunners
 OpenNoneT351074 Move servers from the appserver/api cluster to kubernetes
 ResolvedkamilaT354413 Reboot issues for mw13[77-83].eqiad.wmnet
 ResolvedClement_GoubertT355532 Move 40% of mediawiki external requests to mw on k8s
 ResolvedClement_GoubertT355534 Move testwiki over to mw-on-k8s
 ResolvedakosiarisT357392 Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it
 OpenNoneT358588 A lot of `[info] Wikitext for this page has duplicate ids:` in logstash for mw-parsoid. Possibly related to PageBundle
 ResolvedakosiarisT358752 Reimage parse* hosts as kubernetes nodes
 ResolveddancyT357402 Scap should check errors coming from mw-on-k8s canaries during deployments
 ResolvedClement_GoubertT357508 Move 60% of mediawiki external requests to mw on k8s
 ResolvedClement_GoubertT358117 Adapt scap's testing strategy to mw-on-k8s
 ResolvedClement_GoubertT357507 Move 50% of mediawiki external requests to mw on k8s
 ResolvedClement_GoubertT360763 Move 70% of mediawiki external requests to mw on k8s
 OpenClement_GoubertT362323 Move 100% of external traffic to Kubernetes (excluding Votewiki)
 OpenjijikiT277711 Memcached, mcrouter in MediaWiki on Kubernetes
 ResolvedJoeT278220 Define the size of a pod for mediawiki in terms of resource usage
 StalledjijikiT346690 mcrouter daemonset on mw-on-k8s
 OpenNoneT363186 Cache mw-mcrouter service ClusterIP in apcu cache
 ResolvedJdforrester-WMFT362662 Rename X-Wikimedia-Debug k8s-experimental option
 ResolvedjijikiT365478 XWD: Allow choosing datacentre in k8s-mwdebug

Event Timeline

bd808 created this task.Sat, May 4, 7:03 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSat, May 4, 7:03 PM
gerritbot added a comment.Sat, May 4, 7:13 PM

Change #1027245 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[mediawiki/extensions/SyntaxHighlight_GeSHi@master] Update Pygments to 2.18.0

https://gerrit.wikimedia.org/r/1027245

gerritbot added a project: Patch-For-Review.Sat, May 4, 7:13 PM
gerritbot added a comment.Sat, May 4, 7:39 PM

Change #1027251 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[mediawiki/libs/Shellbox@master] syntaxhighlight: Update Pygments to 2.18.0

https://gerrit.wikimedia.org/r/1027251

Peachey88 merged a task: T364286: New upstream release for Pygments.Mon, May 6, 1:07 AM
Peachey88 added a subscriber: LibUp-bot.
Peachey88 removed a subscriber: LibUp-bot.
TheDJ added a project: User-TheDJ.Mon, May 6, 8:15 AM
bd808 mentioned this in T351744: New upstream release for Pygments (2.17.2).Wed, May 8, 3:57 PM
bd808 changed the task status from Open to Stalled.Thu, May 16, 9:26 PM

Pygments v2.18.0 requires Python 3.8+ as a runtime. The current test and default local development environments for MediaWiki are using Debian Buster containers which provide the EOL Python 3.7.3. Until these bump to a newer Debian distro with a newer Python version things are stuck. Debian Bookworm provides Python 3.11.2; Debian Bullseye provides Python 3.9.2.

bd808 added a comment.Thu, May 16, 9:59 PM

I am not exactly sure what to mark this as blocked on. Maybe T319432: Migrate WMF production from PHP 7.4 to PHP 8.1? I think that fundamentally this blocked until we bump all the things past Buster to Bullseye or newer. That PHP 8.1 task looks like the same fundamental block.

gerritbot added a comment.Thu, May 16, 11:30 PM

Change #1032606 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[mediawiki/extensions/SyntaxHighlight_GeSHi@master] Pygmentize: report stderr when exit code != 0 and stdout is empty

https://gerrit.wikimedia.org/r/1032606

TheDJ added a subtask: T319432: Migrate WMF production from PHP 7.4 to PHP 8.1.Mon, May 20, 1:22 PM
gerritbot added a comment.Mon, May 20, 1:31 PM

Change #1032606 merged by jenkins-bot:

[mediawiki/extensions/SyntaxHighlight_GeSHi@master] Pygmentize: report stderr when exit code != 0 and stdout is empty

https://gerrit.wikimedia.org/r/1032606

ReleaseTaggerBot added a project: MW-1.43-notes (1.43.0-wmf.6; 2024-05-21).Mon, May 20, 2:00 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL