Page MenuHomePhabricator
Paste P92915

Toolforge job pending
ActivePublic

Authored by Sebastian_Berlin-WMSE on May 26 2026, 6:43 AM.
Project Tags
None
Referenced Files
F84304603: Toolforge jpb pending
May 26 2026, 6:43 AM
Subscribers
None
tools.commonsdb-registry@tools-bastion-15:~$ kubectl describe pods
Name: make-declarations-wle-2016-j9dks
Namespace: tool-commonsdb-registry
Priority: 0
Service Account: default
Node: tools-k8s-worker-nfs-12/172.16.5.235
Start Time: Mon, 25 May 2026 05:49:44 +0000
Labels: app.kubernetes.io/component=jobs
app.kubernetes.io/created-by=commonsdb-registry
app.kubernetes.io/managed-by=toolforge-jobs-framework
app.kubernetes.io/name=make-declarations-wle-2016
app.kubernetes.io/version=2
batch.kubernetes.io/controller-uid=6586dddb-a092-4cb2-aacd-bd3c6bef2d41
batch.kubernetes.io/job-name=make-declarations-wle-2016
controller-uid=6586dddb-a092-4cb2-aacd-bd3c6bef2d41
job-name=make-declarations-wle-2016
jobs.toolforge.org/emails=all
jobs.toolforge.org/filelog=yes
toolforge=tool
toolforge.org/mount-storage=all
Annotations: cni.projectcalico.org/containerID: dffc2e83f65ca73213bcc1ab23cb7e9349d7ea4cfdd04dfaf1cc527ad1c94d52
cni.projectcalico.org/podIP: 192.168.204.45/32
cni.projectcalico.org/podIPs: 192.168.204.45/32
Status: Running
SeccompProfile: RuntimeDefault
IP: 192.168.204.45
IPs:
IP: 192.168.204.45
Controlled By: Job/make-declarations-wle-2016
Containers:
job:
Container ID: containerd://e246f1bda0c08e27a9ae01e1ea8df4aa0c7f7832e9f848b9ed3ec1fb8048198f
Image: tools-harbor.wmcloud.org/tool-commonsdb-registry/tool-commonsdb-registry:latest
Image ID: tools-harbor.wmcloud.org/tool-commonsdb-registry/tool-commonsdb-registry@sha256:31bd255332b76d23e1565c85b076b6ba04607bcd86baa5336ab9824a8c04f0ad
Port: <none>
Host Port: <none>
Command:
/bin/sh
-c
--
exec 1>>/data/project/commonsdb-registry/make-declarations-wle-2016.out;exec 2>>/data/project/commonsdb-registry/make-declarations-wle-2016.err;launcher env HOME=/workspace src/make_declaration.py -t mem:2.0Gi -t cpu:2.0 -t version:0.1.15 --verbose batch:category-47503701
State: Running
Started: Mon, 25 May 2026 05:49:49 +0000
Ready: True
Restart Count: 0
Limits:
cpu: 2
memory: 2Gi
Requests:
cpu: 2
memory: 1073741824
Environment:
NO_HOME: a buildservice pod does not need a home env
API_ENDPOINT: <set to the key 'API_ENDPOINT' in secret 'toolforge.envvar.v1.api-endpoint'> Optional: false
API_KEY: <set to the key 'API_KEY' in secret 'toolforge.envvar.v1.api-key'> Optional: false
DECLARATION_JOURNAL_URL: <set to the key 'DECLARATION_JOURNAL_URL' in secret 'toolforge.envvar.v1.declaration-journal-url'> Optional: false
MEMBER_CREDENTIALS_FILE: <set to the key 'MEMBER_CREDENTIALS_FILE' in secret 'toolforge.envvar.v1.member-credentials-file'> Optional: false
PRIVATE_KEY_FILE: <set to the key 'PRIVATE_KEY_FILE' in secret 'toolforge.envvar.v1.private-key-file'> Optional: false
PUBLIC_KEY_FILE: <set to the key 'PUBLIC_KEY_FILE' in secret 'toolforge.envvar.v1.public-key-file'> Optional: false
TOOL_REPLICA_PASSWORD: <set to the key 'TOOL_REPLICA_PASSWORD' in secret 'toolforge.envvar.v1.tool-replica-password'> Optional: false
TOOL_REPLICA_USER: <set to the key 'TOOL_REPLICA_USER' in secret 'toolforge.envvar.v1.tool-replica-user'> Optional: false
TOOL_TOOLSDB_PASSWORD: <set to the key 'TOOL_TOOLSDB_PASSWORD' in secret 'toolforge.envvar.v1.tool-toolsdb-password'> Optional: false
TOOL_TOOLSDB_USER: <set to the key 'TOOL_TOOLSDB_USER' in secret 'toolforge.envvar.v1.tool-toolsdb-user'> Optional: false
TSA_SKIP_VERIFY: <set to the key 'TSA_SKIP_VERIFY' in secret 'toolforge.envvar.v1.tsa-skip-verify'> Optional: false
TSA_URL: <set to the key 'TSA_URL' in secret 'toolforge.envvar.v1.tsa-url'> Optional: false
TOOL_TOOLFORGE_API_URL: https://api.svc.tools.eqiad1.wikimedia.cloud:30003
TOOL_REDIS_URI: redis://redis.svc.tools.eqiad1.wikimedia.cloud:6379
TOOL_ELASTICSEARCH_URL: http://elasticsearch.svc.tools.eqiad1.wikimedia.cloud:80
TOOL_DATA_DIR: /data/project/commonsdb-registry
Mounts:
/data/project from home (rw)
/data/scratch from scratch (rw)
/etc/ldap.conf from etcldap-conf (ro)
/etc/ldap.yaml from etcldap-yaml (ro)
/etc/novaobserver.yaml from etcnovaobserver-yaml (ro)
/etc/openstack/clouds.yaml from etcopenstack-clouds (ro)
/etc/wmcs-project from wmcs-project (ro)
/mnt/nfs/dumps-clouddumps1001.wikimedia.org from dumpsrc-clouddumps1001 (ro)
/mnt/nfs/dumps-clouddumps1002.wikimedia.org from dumpsrc-clouddumps1002 (ro)
/public/dumps from dumps (ro)
/var/lib/sss/pipes from sssd-pipes (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-4ssms (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
kube-api-access-4ssms:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
dumps:
Type: HostPath (bare host directory volume)
Path: /public/dumps
HostPathType: Directory
dumpsrc-clouddumps1001:
Type: HostPath (bare host directory volume)
Path: /mnt/nfs/dumps-clouddumps1001.wikimedia.org
HostPathType: Directory
dumpsrc-clouddumps1002:
Type: HostPath (bare host directory volume)
Path: /mnt/nfs/dumps-clouddumps1002.wikimedia.org
HostPathType: Directory
home:
Type: HostPath (bare host directory volume)
Path: /data/project
HostPathType: Directory
wmcs-project:
Type: HostPath (bare host directory volume)
Path: /etc/wmcs-project
HostPathType: File
scratch:
Type: HostPath (bare host directory volume)
Path: /data/scratch
HostPathType: Directory
etcldap-conf:
Type: HostPath (bare host directory volume)
Path: /etc/ldap.conf
HostPathType: File
etcldap-yaml:
Type: HostPath (bare host directory volume)
Path: /etc/ldap.yaml
HostPathType: File
etcnovaobserver-yaml:
Type: HostPath (bare host directory volume)
Path: /etc/novaobserver.yaml
HostPathType: File
etcopenstack-clouds:
Type: HostPath (bare host directory volume)
Path: /etc/openstack/clouds.yaml
HostPathType: File
sssd-pipes:
Type: HostPath (bare host directory volume)
Path: /var/lib/sss/pipes
HostPathType: Directory
QoS Class: Burstable
Node-Selectors: kubernetes.wmcloud.org/nfs-mounted=true
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Topology Spread Constraints: kubernetes.io/hostname:ScheduleAnyway when max skew 1 is exceeded for selector app.kubernetes.io/created-by=commonsdb-registry,app.kubernetes.io/managed-by=toolforge-jobs-framework,app.kubernetes.io/name=make-declarations-wle-2016,toolforge=tool
Events: <none>
Name: make-declarations-wlm-2016-cvdrq
Namespace: tool-commonsdb-registry
Priority: 0
Service Account: default
Node: tools-k8s-worker-nfs-10/172.16.1.214
Start Time: Fri, 22 May 2026 07:30:56 +0000
Labels: app.kubernetes.io/component=jobs
app.kubernetes.io/created-by=commonsdb-registry
app.kubernetes.io/managed-by=toolforge-jobs-framework
app.kubernetes.io/name=make-declarations-wlm-2016
app.kubernetes.io/version=2
batch.kubernetes.io/controller-uid=e3c7f92d-a942-434d-9019-21a06bc81b3b
batch.kubernetes.io/job-name=make-declarations-wlm-2016
controller-uid=e3c7f92d-a942-434d-9019-21a06bc81b3b
job-name=make-declarations-wlm-2016
jobs.toolforge.org/emails=all
jobs.toolforge.org/filelog=yes
toolforge=tool
toolforge.org/mount-storage=all
Annotations: cni.projectcalico.org/containerID: 457b75b87978370cf30fb5b46258b12da7a4dd7816bcfdf21fcc0b34d0a0f0c9
cni.projectcalico.org/podIP: 192.168.109.113/32
cni.projectcalico.org/podIPs: 192.168.109.113/32
Status: Running
SeccompProfile: RuntimeDefault
IP: 192.168.109.113
IPs:
IP: 192.168.109.113
Controlled By: Job/make-declarations-wlm-2016
Containers:
job:
Container ID: containerd://1821e5911a4e2a773b4526e8f5205da4cf36424b12e1c590cfb7b4f2540970ad
Image: tools-harbor.wmcloud.org/tool-commonsdb-registry/tool-commonsdb-registry:latest
Image ID: tools-harbor.wmcloud.org/tool-commonsdb-registry/tool-commonsdb-registry@sha256:31bd255332b76d23e1565c85b076b6ba04607bcd86baa5336ab9824a8c04f0ad
Port: <none>
Host Port: <none>
Command:
/bin/sh
-c
--
exec 1>>/data/project/commonsdb-registry/make-declarations-wlm-2016.out;exec 2>>/data/project/commonsdb-registry/make-declarations-wlm-2016.err;launcher env HOME=/workspace src/make_declaration.py -t mem:2.0Gi -t cpu:2.0 -t version:0.1.15 --verbose batch:category-48656297
State: Running
Started: Fri, 22 May 2026 07:30:57 +0000
Ready: True
Restart Count: 0
Limits:
cpu: 2
memory: 2Gi
Requests:
cpu: 2
memory: 1073741824
Environment:
NO_HOME: a buildservice pod does not need a home env
API_ENDPOINT: <set to the key 'API_ENDPOINT' in secret 'toolforge.envvar.v1.api-endpoint'> Optional: false
API_KEY: <set to the key 'API_KEY' in secret 'toolforge.envvar.v1.api-key'> Optional: false
DECLARATION_JOURNAL_URL: <set to the key 'DECLARATION_JOURNAL_URL' in secret 'toolforge.envvar.v1.declaration-journal-url'> Optional: false
MEMBER_CREDENTIALS_FILE: <set to the key 'MEMBER_CREDENTIALS_FILE' in secret 'toolforge.envvar.v1.member-credentials-file'> Optional: false
PRIVATE_KEY_FILE: <set to the key 'PRIVATE_KEY_FILE' in secret 'toolforge.envvar.v1.private-key-file'> Optional: false
PUBLIC_KEY_FILE: <set to the key 'PUBLIC_KEY_FILE' in secret 'toolforge.envvar.v1.public-key-file'> Optional: false
TOOL_REPLICA_PASSWORD: <set to the key 'TOOL_REPLICA_PASSWORD' in secret 'toolforge.envvar.v1.tool-replica-password'> Optional: false
TOOL_REPLICA_USER: <set to the key 'TOOL_REPLICA_USER' in secret 'toolforge.envvar.v1.tool-replica-user'> Optional: false
TOOL_TOOLSDB_PASSWORD: <set to the key 'TOOL_TOOLSDB_PASSWORD' in secret 'toolforge.envvar.v1.tool-toolsdb-password'> Optional: false
TOOL_TOOLSDB_USER: <set to the key 'TOOL_TOOLSDB_USER' in secret 'toolforge.envvar.v1.tool-toolsdb-user'> Optional: false
TSA_SKIP_VERIFY: <set to the key 'TSA_SKIP_VERIFY' in secret 'toolforge.envvar.v1.tsa-skip-verify'> Optional: false
TSA_URL: <set to the key 'TSA_URL' in secret 'toolforge.envvar.v1.tsa-url'> Optional: false
TOOL_TOOLFORGE_API_URL: https://api.svc.tools.eqiad1.wikimedia.cloud:30003
TOOL_REDIS_URI: redis://redis.svc.tools.eqiad1.wikimedia.cloud:6379
TOOL_ELASTICSEARCH_URL: http://elasticsearch.svc.tools.eqiad1.wikimedia.cloud:80
TOOL_DATA_DIR: /data/project/commonsdb-registry
Mounts:
/data/project from home (rw)
/data/scratch from scratch (rw)
/etc/ldap.conf from etcldap-conf (ro)
/etc/ldap.yaml from etcldap-yaml (ro)
/etc/novaobserver.yaml from etcnovaobserver-yaml (ro)
/etc/openstack/clouds.yaml from etcopenstack-clouds (ro)
/etc/wmcs-project from wmcs-project (ro)
/mnt/nfs/dumps-clouddumps1001.wikimedia.org from dumpsrc-clouddumps1001 (ro)
/mnt/nfs/dumps-clouddumps1002.wikimedia.org from dumpsrc-clouddumps1002 (ro)
/public/dumps from dumps (ro)
/var/lib/sss/pipes from sssd-pipes (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jhrdm (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
kube-api-access-jhrdm:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
dumps:
Type: HostPath (bare host directory volume)
Path: /public/dumps
HostPathType: Directory
dumpsrc-clouddumps1001:
Type: HostPath (bare host directory volume)
Path: /mnt/nfs/dumps-clouddumps1001.wikimedia.org
HostPathType: Directory
dumpsrc-clouddumps1002:
Type: HostPath (bare host directory volume)
Path: /mnt/nfs/dumps-clouddumps1002.wikimedia.org
HostPathType: Directory
home:
Type: HostPath (bare host directory volume)
Path: /data/project
HostPathType: Directory
wmcs-project:
Type: HostPath (bare host directory volume)
Path: /etc/wmcs-project
HostPathType: File
scratch:
Type: HostPath (bare host directory volume)
Path: /data/scratch
HostPathType: Directory
etcldap-conf:
Type: HostPath (bare host directory volume)
Path: /etc/ldap.conf
HostPathType: File
etcldap-yaml:
Type: HostPath (bare host directory volume)
Path: /etc/ldap.yaml
HostPathType: File
etcnovaobserver-yaml:
Type: HostPath (bare host directory volume)
Path: /etc/novaobserver.yaml
HostPathType: File
etcopenstack-clouds:
Type: HostPath (bare host directory volume)
Path: /etc/openstack/clouds.yaml
HostPathType: File
sssd-pipes:
Type: HostPath (bare host directory volume)
Path: /var/lib/sss/pipes
HostPathType: Directory
QoS Class: Burstable
Node-Selectors: kubernetes.wmcloud.org/nfs-mounted=true
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Topology Spread Constraints: kubernetes.io/hostname:ScheduleAnyway when max skew 1 is exceeded for selector app.kubernetes.io/created-by=commonsdb-registry,app.kubernetes.io/managed-by=toolforge-jobs-framework,app.kubernetes.io/name=make-declarations-wlm-2016,toolforge=tool
Events: <none>
Name: make-declarations-wlm-2017-vc4s4
Namespace: tool-commonsdb-registry
Priority: 0
Service Account: default
Node: <none>
Labels: app.kubernetes.io/component=jobs
app.kubernetes.io/created-by=commonsdb-registry
app.kubernetes.io/managed-by=toolforge-jobs-framework
app.kubernetes.io/name=make-declarations-wlm-2017
app.kubernetes.io/version=2
batch.kubernetes.io/controller-uid=605dd132-cc39-441f-b4bc-4fabc4ebc5fd
batch.kubernetes.io/job-name=make-declarations-wlm-2017
controller-uid=605dd132-cc39-441f-b4bc-4fabc4ebc5fd
job-name=make-declarations-wlm-2017
jobs.toolforge.org/emails=all
jobs.toolforge.org/filelog=yes
toolforge=tool
toolforge.org/mount-storage=all
Annotations: <none>
Status: Pending
SeccompProfile: RuntimeDefault
IP:
IPs: <none>
Controlled By: Job/make-declarations-wlm-2017
Containers:
job:
Image: tools-harbor.wmcloud.org/tool-commonsdb-registry/tool-commonsdb-registry:latest
Port: <none>
Host Port: <none>
Command:
/bin/sh
-c
--
exec 1>>/data/project/commonsdb-registry/make-declarations-wlm-2017.out;exec 2>>/data/project/commonsdb-registry/make-declarations-wlm-2017.err;launcher env HOME=/workspace src/make_declaration.py -t mem:2.0Gi -t cpu:2.0 -t version:0.1.15 --verbose batch:category-55661878
Limits:
cpu: 2
memory: 2Gi
Requests:
cpu: 2
memory: 1073741824
Environment:
NO_HOME: a buildservice pod does not need a home env
API_ENDPOINT: <set to the key 'API_ENDPOINT' in secret 'toolforge.envvar.v1.api-endpoint'> Optional: false
API_KEY: <set to the key 'API_KEY' in secret 'toolforge.envvar.v1.api-key'> Optional: false
DECLARATION_JOURNAL_URL: <set to the key 'DECLARATION_JOURNAL_URL' in secret 'toolforge.envvar.v1.declaration-journal-url'> Optional: false
MEMBER_CREDENTIALS_FILE: <set to the key 'MEMBER_CREDENTIALS_FILE' in secret 'toolforge.envvar.v1.member-credentials-file'> Optional: false
PRIVATE_KEY_FILE: <set to the key 'PRIVATE_KEY_FILE' in secret 'toolforge.envvar.v1.private-key-file'> Optional: false
PUBLIC_KEY_FILE: <set to the key 'PUBLIC_KEY_FILE' in secret 'toolforge.envvar.v1.public-key-file'> Optional: false
TOOL_REPLICA_PASSWORD: <set to the key 'TOOL_REPLICA_PASSWORD' in secret 'toolforge.envvar.v1.tool-replica-password'> Optional: false
TOOL_REPLICA_USER: <set to the key 'TOOL_REPLICA_USER' in secret 'toolforge.envvar.v1.tool-replica-user'> Optional: false
TOOL_TOOLSDB_PASSWORD: <set to the key 'TOOL_TOOLSDB_PASSWORD' in secret 'toolforge.envvar.v1.tool-toolsdb-password'> Optional: false
TOOL_TOOLSDB_USER: <set to the key 'TOOL_TOOLSDB_USER' in secret 'toolforge.envvar.v1.tool-toolsdb-user'> Optional: false
TSA_SKIP_VERIFY: <set to the key 'TSA_SKIP_VERIFY' in secret 'toolforge.envvar.v1.tsa-skip-verify'> Optional: false
TSA_URL: <set to the key 'TSA_URL' in secret 'toolforge.envvar.v1.tsa-url'> Optional: false
TOOL_TOOLFORGE_API_URL: https://api.svc.tools.eqiad1.wikimedia.cloud:30003
TOOL_REDIS_URI: redis://redis.svc.tools.eqiad1.wikimedia.cloud:6379
TOOL_ELASTICSEARCH_URL: http://elasticsearch.svc.tools.eqiad1.wikimedia.cloud:80
TOOL_DATA_DIR: /data/project/commonsdb-registry
Mounts:
/data/project from home (rw)
/data/scratch from scratch (rw)
/etc/ldap.conf from etcldap-conf (ro)
/etc/ldap.yaml from etcldap-yaml (ro)
/etc/novaobserver.yaml from etcnovaobserver-yaml (ro)
/etc/openstack/clouds.yaml from etcopenstack-clouds (ro)
/etc/wmcs-project from wmcs-project (ro)
/mnt/nfs/dumps-clouddumps1001.wikimedia.org from dumpsrc-clouddumps1001 (ro)
/mnt/nfs/dumps-clouddumps1002.wikimedia.org from dumpsrc-clouddumps1002 (ro)
/public/dumps from dumps (ro)
/var/lib/sss/pipes from sssd-pipes (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-xffrc (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-xffrc:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
dumps:
Type: HostPath (bare host directory volume)
Path: /public/dumps
HostPathType: Directory
dumpsrc-clouddumps1001:
Type: HostPath (bare host directory volume)
Path: /mnt/nfs/dumps-clouddumps1001.wikimedia.org
HostPathType: Directory
dumpsrc-clouddumps1002:
Type: HostPath (bare host directory volume)
Path: /mnt/nfs/dumps-clouddumps1002.wikimedia.org
HostPathType: Directory
home:
Type: HostPath (bare host directory volume)
Path: /data/project
HostPathType: Directory
wmcs-project:
Type: HostPath (bare host directory volume)
Path: /etc/wmcs-project
HostPathType: File
scratch:
Type: HostPath (bare host directory volume)
Path: /data/scratch
HostPathType: Directory
etcldap-conf:
Type: HostPath (bare host directory volume)
Path: /etc/ldap.conf
HostPathType: File
etcldap-yaml:
Type: HostPath (bare host directory volume)
Path: /etc/ldap.yaml
HostPathType: File
etcnovaobserver-yaml:
Type: HostPath (bare host directory volume)
Path: /etc/novaobserver.yaml
HostPathType: File
etcopenstack-clouds:
Type: HostPath (bare host directory volume)
Path: /etc/openstack/clouds.yaml
HostPathType: File
sssd-pipes:
Type: HostPath (bare host directory volume)
Path: /var/lib/sss/pipes
HostPathType: Directory
QoS Class: Burstable
Node-Selectors: kubernetes.wmcloud.org/nfs-mounted=true
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Topology Spread Constraints: kubernetes.io/hostname:ScheduleAnyway when max skew 1 is exceeded for selector app.kubernetes.io/created-by=commonsdb-registry,app.kubernetes.io/managed-by=toolforge-jobs-framework,app.kubernetes.io/name=make-declarations-wlm-2017,toolforge=tool
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 3m18s (x7 over 6m6s) default-scheduler 0/81 nodes are available: 1 Insufficient memory, 11 node(s) didn't match Pod's node affinity/selector, 3 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }, 3 node(s) had untolerated taint {toolforge.org/gateway: true}, 64 Insufficient cpu. preemption: 0/81 nodes are available: 17 Preemption is not helpful for scheduling, 64 No preemption victims found for incoming pod.
Warning FailedScheduling 58s (x26 over 5m57s) default-scheduler 0/81 nodes are available: 11 node(s) didn't match Pod's node affinity/selector, 3 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }, 3 node(s) had untolerated taint {toolforge.org/gateway: true}, 64 Insufficient cpu. preemption: 0/81 nodes are available: 17 Preemption is not helpful for scheduling, 64 No preemption victims found for incoming pod.