Change Details

Many of my cron gridengine jobs have been failing for last 14 days for one of the following errors: ``` Traceback (most recent call last): File "/usr/bin/job", line 47, in <module> proc = subprocess.Popen(['/usr/bin/qstat', '-xml'], stdout=subprocess.PIPE) File "/usr/lib/python3.5/subprocess.py", line 676, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.5/subprocess.py", line 1221, in _execute_child restore_signals, start_new_session, preexec_fn) OSError: [Errno 12] Cannot allocate memory ``` ``` Traceback (most recent call last): File "/usr/bin/job", line 47, in <module> proc = subprocess.Popen(['/usr/bin/qstat', '-xml'], stdout=subprocess.PIPE) File "/usr/lib/python3.5/subprocess.py", line 676, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.5/subprocess.py", line 1221, in _execute_child restore_signals, start_new_session, preexec_fn) OSError: [Errno 12] Cannot allocate memory ``` It never occured to me before. It was thrown for a majority of tasks (cca 6 or 7 of 10 tasks last days) and even sends me an email with the stacktrace/traceback. It happens even for simple python scripts, that usually take miliseconds.

Many of my cron gridengine jobs have been failing for last 14 days for one of the following errors: ``` Traceback (most recent call last): File "/usr/bin/job", line 47, in <module> proc = subprocess.Popen(['/usr/bin/qstat', '-xml'], stdout=subprocess.PIPE) File "/usr/lib/python3.5/subprocess.py", line 676, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.5/subprocess.py", line 1221, in _execute_child restore_signals, start_new_session, preexec_fn) OSError: [Errno 12] Cannot allocate memory ``` ``` Traceback (most recent call last): File "/usr/bin/job", line 21, in <module> import xml.etree.ElementTree File "<frozen importlib._bootstrap>", line 969, in _find_and_load File "<frozen importlib._bootstrap>", line 958, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 673, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 669, in exec_module File "<frozen importlib._bootstrap_external>", line 773, in get_code File "<frozen importlib._bootstrap_external>", line 484, in _compile_bytecode MemoryError ``` It never occured to me before. It was thrown for a majority of tasks (cca 6 or 7 of 10 tasks last days) and even sends me an email with the stacktrace/traceback. It happens even for simple python scripts, that usually take miliseconds.

Many of my cron gridengine jobs have been failing for last 14 days for one of the following errors: ``` Traceback (most recent call last): File "/usr/bin/job", line 47, in <module> proc = subprocess.Popen(['/usr/bin/qstat', '-xml'], stdout=subprocess.PIPE) File "/usr/lib/python3.5/subprocess.py", line 676, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.5/subprocess.py", line 1221, in _execute_child restore_signals, start_new_session, preexec_fn) OSError: [Errno 12] Cannot allocate memory ``` ``` Traceback (most recent call last): File "/usr/bin/job", line 4721, in <module> proc = subprocess.Popen(['/usr/bin/qstat', '-xml'], stdout=subprocess.PIPE)import xml.etree.ElementTree File "/usr/lib/python3.5/subprocess.py"<frozen importlib._bootstrap>", line 676969, in __init__find_and_load restore_signalsFile "<frozen importlib._bootstrap>", line 958, start_new_session)in _find_and_load_unlocked File "/usr/lib/python3.5/subprocess.py"<frozen importlib._bootstrap>", line 1221673, in _execute_childload_unlocked restore_signalsFile "<frozen importlib._bootstrap_external>", start_new_sessionline 669, prein exec_fn)module OSError: [Errno 12] Cannot allocate memoryFile "<frozen importlib._bootstrap_external>", line 773, in get_code File "<frozen importlib._bootstrap_external>", line 484, in _compile_bytecode MemoryError ``` It never occured to me before. It was thrown for a majority of tasks (cca 6 or 7 of 10 tasks last days) and even sends me an email with the stacktrace/traceback. It happens even for simple python scripts, that usually take miliseconds.