WMDE Analytics Tech Debt

This task was generated using the WMDE Analytics tech debt form. Please use the task templates linked on our project page to create tasks for the team. Thank you!

Why (Context & Benefit)

What problem are you trying to solve, and how will the team benefit? What would happen if we didn’t do this task?

WMDE Analytics would like to have standardized naming for all of our data processes. Specifically we need to come up with a standard for data processes that are intermediary and lead into final metric processes. As of now these processes are called request_metadata, but we would like them to be shifted to prep. We're using prep as a simple identifier as staging, the other option, would imply the movement of data into a staging area (these permanent tables still live in the data lake).

Sub Tasks

A breakdown of the steps to complete this task.

Resolving the Tech Debt

• Renaming all request_metadata tables in the data lake
• Fixing queries to use these new table names
• Renaming all request_metadata DAGs
• Redeploying DAGs and resetting any needed DAG variables

Finishing Up

• Required documentation is written
• The task is moved to Delivered (no reassignment necessary)