In T325528 we found out that the Kserve upstream project now provides a Helm chart:
https://github.com/kserve/kserve/tree/master/charts
We will likely need to file some patches to upstream for our custom needs, but we could start by importing the upstream code to see how much it differs from our current needs.