Once we have the new spark-on-K8s job set up, we should consult with experts (jallemandou, xcollazo, ...) to get advice on how to tune its settings and make it run faster.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | gmodena | T431253 [DE2.4.2] WDQS v2 Scaling | |||
| Open | gmodena | T440523 [DE2.6.3] Achieve Launch Readiness for GA | |||
| Stalled | gmodena | T422179 Set up regular bulk data ingestion and indexing pipeline | |||
| Resolved | gmodena | T422522 WE2.5.8 WDQS v2 technical build | |||
| Declined | None | T425467 data-reload: Tune Spark params for the processing stage |