Note that a working DAG based on MariaDB based data has been successfully deployed by WMF, so a proof of concept here has been released and we can work from that towards our goals here. See https://phabricator.wikimedia.org/T362615#10106942 for the deployment message :)

Moved to in review for Analytics as the full checks of the notebooks were completed on Monday. Minor changes are pending, but just to the output file :)

Thanks @Htriedman! Removing you as a subscriber then :)

@Htriedman, wanted to bring this new task and T372537 to your all's attention :) This one is more urgent, but I figured we could discuss both at the same time? The plan for this is as was agreed to in T365699, that all values under 25 need to be replaced with a string "<25". If we end up including percentage columns, then those would similarly be restricted using the method described in the other open task here.

Note that there's a chance that this tool will be redone, so the maintainers should be checked with before work commences, and if it goes in a different direction then we could also decline this :)

Note that the .hql file for selecting the data and creating a CSV has been written and can be found in wd_query_segments_gen_csv_weekly.hql. As in T365699, for integer values an example is:

Resolving this as the data has been released per the above discussion of replacing <25 for all integers that are less than 25. It's not likely that we will have such values, but the guards against reporting them are set just in case :)

As with T370851, setup work for the DAG can now begin as the basic queries for these processes have been defined :)

Basic DAG setup work can begin as a query have been defined that can provide the WDQS queries we need. The prior work still needs approval, so just setup for now :)

wmde/analytics:MR#4 is up for this and will be reviewed in the coming days, so this is moved into our backlog :)

T370853_single_statement_wd_query_use.ipynb has the work associated with this task :) Moving this to review so that we can check the queries for this and the other WDQS task T370848.

T370848_discovery_single_wd_entity_query_use.ipynb has the work associated with this task :) Moving this to review so that we can check the queries for this and the other WDQS task T370853.

Stalling this as it's blocked by progress on T363583 as well as T366591 and T366592.

Stalling this to indicate that it's blocked by progress on T363583.

Stalling this to indicate that it's blocked by progress on T363583.