$ time php bin/parse.php --pageName 'Ken Schrader' --domain en.wikipedia.org < /dev/null
real	0m35.269s
user	0m7.081s
sys	0m0.332s

<cscott> intuition is that it's something about how we're pulling out data-parsoid or adding ids, i don't recall zest being used in that code but if it is it would fall under suspicion
<subbu> all the timeouts are in zest .. so, that points at zest.
<cscott> oh, there are other failures of this sort?  how many?
<subbu> before the disable-gc patch, htere were a few spread around the place and they are all gone now .. i thought even the zest ones were related to gc .. but since they persisted and the only ones remaining, i suspect it is zest related.
<subbu> let me point you to the logstash board, one sec.
<cscott> just rough order of magnitude is all i was looking for
<subbu> https://logstash.wikimedia.org/goto/af41f78bb2f15937d6638ded0c0adbce
<subbu> 206 instances
<subbu> of zest timeouts
<cscott> you're right that the more frequently this occurs w/ the limit always caused by zest makes it much more likely we're not simply unlucky in hitting execution time limits
<cscott> yeah, 206 is pretty definitive that it's actually zest at fault. ;)
<subbu> there is 1 that is not zest and that is: "PHP Fatal error: Maximum execution time of 180 seconds exceeded in /srv/deployment/parsoid/deploy/src/src/Utils/DOMTraverser.php on line 66 "
<cscott> hm!
<subbu> but, that could just be a zest fallout . i.e. this one took long but not 180s and tipped that one over the edge.
<subbu> but, not sure. :)
<subbu> anyway, look at that logstash board and you can get list of titles, etc.
<cscott> yeah, but i bet it's someplace that is using zest and DOMTraverser in close proximity

		$dpScriptElt = DOMCompat::getElementById( $doc, 'mw-pagebundle' );

			DOMDataUtils::injectPageBundle( $document, DOMDataUtils::getPageBundle( $document ) );

	public static function storeInPageBundle( DOMElement $node, Env $env, stdClass $data ): void {
		$uid = $node->getAttribute( 'id' ) ?? '';
		$document = $node->ownerDocument;
		$pb = self::getPageBundle( $document );
		$docDp = $pb->parsoid;
		$origId = $uid ?: null;
		if ( array_key_exists( $uid, $docDp->ids ) ) {
			$uid = null;
			// FIXME: Protect mw ids while tokenizing to avoid false positives.
			$env->log( 'info', 'Wikitext for this page has duplicate ids: ' . $origId );
		}
		if ( !$uid ) {
			do {
				$docDp->counter += 1;
				$uid = 'mw' . PHPUtils::counterToBase64( $docDp->counter );
			} while ( DOMCompat::getElementById( $document, $uid ) );
			self::addNormalizedAttribute( $node, 'id', $uid, $origId );
		}
		$docDp->ids[$uid] = $data->parsoid;
		if ( isset( $data->mw ) ) {
			$pb->mw->ids[$uid] = $data->mw;
		}
	}

	public static function getElementsById( DOMNode $context, string $id ): array {
		$doc = ( $context instanceof \DOMDocument ) ?
			$context : $context->ownerDocument;
		// PHP doesn't provide an DOMElement-scoped version of
		// getElementById, so we can't call this directly on $context --
		// but that's okay because (1) IDs should be unique, and
		// (2) we verify the scope of the returned element below
		// anyway (to work around bugs with deleted-but-not-gc'ed
		// nodes).
		$r = $doc->getElementById( $id );
		// Note that $r could be null here because the
		// DOMDocument hasn't had an "id attribute" set, even if the id
		// exists in the document. See:
		// http://php.net/manual/en/domdocument.getelementbyid.php
		if ( $r !== null ) {
			// Verify that this node is actually rooted in the
			// document (or in the context), since the element
			// isn't removed from the index immediately when it
			// is deleted. (Also PHP's call is not scoped.)
			for ( $parent = $r; $parent; $parent = $parent->parentNode ) {
				if ( $parent === $context ) {
					return [ $r ];
				}
			}
			// It's possible a deleted-but-still-indexed element was
			// shadowing a later-added element, so we can't return
			// null here directly; fallback to a full search.
		}
		// Do an xpath search, which is still a full traversal of the tree
		// (sigh) but 25% faster than traversing it wholly in PHP.
		$xpath = new \DOMXPath( $doc );
		$query = './/*[@id=' . self::xpathQuote( $id ) . ']';
		return iterator_to_array( $xpath->query( $query, $context ) );
	}

ssastry@scandium:/srv/deployment/parsoid/deploy/src$ time curl -x scandium.eqiad.wmnet:80 http://en.wikipedia.org/w/rest.php/en.wikipedia.org/v3/transform/wikitext/to/pagebundle/Ken%20Schrader/913657403 -X POST < /dev/null > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1431k    0 1431k    0     0  11228      0 --:--:--  0:02:10 --:--:--  340k

real	2m10.587s
user	0m0.036s
sys	0m0.020s