We (Search Platform and DPE SRE) have discussed the need for maintaining and applying OpenSearch cluster dynamic settings in a consistent and visible way in T414095 and T415822.

While I closed T415822, thinking that we could do the work with an initContainer immediately after cluster bootstrap, the Search Platform use case detailed in T414095 suggests we need something a bit more robust.

So far I have been unable to find a ready-made solution for this in the OpenSearch ecosystem. Thus, I believe it is appropriate to start discussing a home-grown solution.

I've created this Google doc to flesh out and collaborate on the design.

Creating this ticket as an umbrella task for the design/implementation/deployment.