We're running our kubelet's with readOnlyPort (tcp/10255, plaintext HTTP) enabled and use that port to scrape kubelet and cadvisor metrics. With proper RBAC rules and client cert authentication in place for prometheus, we should be in a position to disable the readOnlyPort and use the default kubelet port (tcp/10250) instead.
Description
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | JMeybohm | T341984 Update Kubernetes clusters to 1.31 | |||
| Resolved | JMeybohm | T383413 Remove the kubelet readOnlyPort |
Event Timeline
Change #1109728 had a related patch set uploaded (by JMeybohm; author: JMeybohm):
[operations/deployment-charts@master] admin_ng RBAC: Fix prometheus clusterrole
Change #1109733 had a related patch set uploaded (by JMeybohm; author: JMeybohm):
[operations/puppet@production] kubelet: Use the chained certificate for TLS
Change #1109734 had a related patch set uploaded (by JMeybohm; author: JMeybohm):
[operations/puppet@production] prometheus::k8s: Move away from kubelet readOnlyPort
Change #1109735 had a related patch set uploaded (by JMeybohm; author: JMeybohm):
[operations/puppet@production] kubelet: Disable the readOnlyPort
Change #1109728 merged by jenkins-bot:
[operations/deployment-charts@master] admin_ng RBAC: Fix prometheus clusterrole
Mentioned in SAL (#wikimedia-operations) [2025-01-13T11:51:19Z] <jayme> disabling puppet on all hosts running kubelet - T383413
Change #1109733 merged by JMeybohm:
[operations/puppet@production] kubelet: Use the chained certificate for TLS
Mentioned in SAL (#wikimedia-operations) [2025-01-13T11:57:55Z] <jayme> re-enabling puppet on all hosts running kubelet - T383413
Change #1109734 merged by JMeybohm:
[operations/puppet@production] prometheus::k8s: Move away from kubelet readOnlyPort
Mentioned in SAL (#wikimedia-operations) [2025-01-13T14:41:56Z] <jayme> disabling puppet on all hosts running kubelet - T383413
Change #1109735 merged by JMeybohm:
[operations/puppet@production] kubelet: Disable the readOnlyPort
Mentioned in SAL (#wikimedia-operations) [2025-01-13T14:48:28Z] <jayme> re-enabling puppet on all hosts running kubelet - T383413