Page MenuHomePhabricator

Wikitech job runner often OOMs on parsoidCachePrewarm
Closed, DuplicatePublic

Description

This seems to be happening relatively often, where the Wikitech special job runner service fails due to an OOM and then recovers again:

Dec 16 20:57:02 cloudweb1003 mwscript[11808]: 2023-12-16 20:57:02 parsoidCachePrewarm Special: revId=1771573 pageId=441472 page_touched=20230830123007 causeAction=view options=0 rootJobIsSelf=1 rootJobSignature=8d159ac15225c9214459e05d14364f3a20224c94 rootJobTimestamp=20231216205338 requestId=cdf2dfdf-2147-4bc7-bbff-318f1b742549 namespace=-1 title= (id=14802851,timestamp=20231216205338) STARTING
Dec 16 20:57:03 cloudweb1003 php[11813]: PHP Fatal error:  Allowed memory size of 157286400 bytes exhausted (tried to allocate 20480 bytes) in /srv/mediawiki/php-1.42.0-wmf.9/vendor/wikimedia/parsoid/src/Wt2Html/Grammar.php on line 3732
Dec 16 20:57:03 cloudweb1003 mwscript[11808]: Fatal error: Allowed memory size of 157286400 bytes exhausted (tried to allocate 20480 bytes) in /srv/mediawiki/php-1.42.0-wmf.9/vendor/wikimedia/parsoid/src/Wt2Html/Grammar.php on line 3732
Dec 16 20:57:03 cloudweb1003 php[11813]: PHP Fatal error:  Allowed memory size of 157286400 bytes exhausted (tried to allocate 20480 bytes) in /srv/mediawiki/php-1.42.0-wmf.9/includes/debug/logger/monolog/LogstashFormatter.php on line 218
Dec 16 20:57:03 cloudweb1003 mwscript[11808]: Fatal error: Allowed memory size of 157286400 bytes exhausted (tried to allocate 20480 bytes) in /srv/mediawiki/php-1.42.0-wmf.9/includes/debug/logger/monolog/LogstashFormatter.php on line 218
Dec 16 20:57:03 cloudweb1003 systemd[1]: wikitech_run_jobs.service: Main process exited, code=exited, status=255/EXCEPTION
Dec 16 20:57:03 cloudweb1003 systemd[1]: wikitech_run_jobs.service: Failed with result 'exit-code'.

Event Timeline

Do you have access to the titles where this is happening? That would help the performance debugging.