We are seeing JS Evaluator pods crash due to child processes error and need to handle these:
...
{"@timestamp":"2026-03-28T01:42:55.870Z","ecs.version":"8.10.0","http":{"request":{"id":"e20ca2fe-0b3c-4011-ade3-176bbaaabded"}},"log.level":"info","message":"...finished calling execute in evaluator","service":{"name":"function-evaluator"},"[span.id](http://span.id/)":"6cf181ef44fcad3c","[trace.id](http://trace.id/)":"4a88441f972e635adcb6beb5f39ac9d8"}
{"@timestamp":"2026-03-28T01:42:55.870Z","ecs.version":"8.10.0","http":{"request":{"id":"b9c4f1b8-222d-4e1d-b7a4-91d923c2100c"}},"log.level":"info","message":"calling execute in evaluator...","service":{"name":"function-evaluator"},"[span.id](http://span.id/)":"622e85992e067852","[trace.id](http://trace.id/)":"4b77f03352b3be0fb347f241a15ef592"}
{"@timestamp":"2026-03-28T01:42:55.871Z","ecs.version":"8.10.0","http":{"request":{"id":"b9c4f1b8-222d-4e1d-b7a4-91d923c2100c"}},"log.level":"info","message":"calling execute in executor..., original time: 2026-03-28T01:42:55.870Z","service":{"name":"function-evaluator"},"[span.id](http://span.id/)":"9241736da6451efb","[trace.id](http://trace.id/)":"2216a4a79fc186dd9ee2958764ac24bf"}
{"@timestamp":"2026-03-28T01:42:55.871Z","ecs.version":"8.10.0","http":{"request":{"id":"b9c4f1b8-222d-4e1d-b7a4-91d923c2100c"}},"log.level":"info","message":"...finished calling execute in executor, original time: 2026-03-28T01:42:55.871Z","service":{"name":"function-evaluator"},"[span.id](http://span.id/)":"9241736da6451efb","[trace.id](http://trace.id/)":"2216a4a79fc186dd9ee2958764ac24bf"}
{"@timestamp":"2026-03-28T01:42:55.888Z","ecs.version":"8.10.0","log.level":"info","message":"executor process termination completed; child process PID: 220621","service":{"name":"function-evaluator"},"[span.id](http://span.id/)":"2372c608faf28177","[trace.id](http://trace.id/)":"ce0d0980831307b24023091845f290ac"}
{"@timestamp":"2026-03-28T01:42:55.903Z","ecs.version":"8.10.0","labels":{"requestId":"2ad39502-b400-4a03-975f-41ba5073ba85"},"log.level":"info","message":"...finished calling executor in evaluator","service":{"name":"function-evaluator"},"[span.id](http://span.id/)":"2372c608faf28177","[trace.id](http://trace.id/)":"ce0d0980831307b24023091845f290ac"}
node:internal/process/promises:394
triggerUncaughtException(err, true /* fromPromise */);
^
[Error: No matching pid found] {
errno: -2,
code: 'ENOENT',
syscall: 'open',
path: '/proc/220634/stat'
}
Node.js v24.14.0Note:
We typically see the Orchestrator pods crash/restart (due to 'OOMKilled'); not so much activity in the Evaluator. Checking today (3/30/26), we see all pods experiencing it. The Py Eval pods and Orchestrator are both due to OOM.