Arrange to periodically count up functions/implementations/tests in Wikifunctions content, and make the counts available for dashboarding. Initially, these counts will be obtained from wikilambda_zobject_function_join and wikilambda_zobject_labels tables.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | BUG REPORT | None | T344206 Special:MathStatus exception error on Wikifunctions | ||
| Resolved | Jdforrester-WMF | T342865 Post-creation work for wikifunctionswiki | |||
| Resolved | Jdforrester-WMF | T323399 Add Wikifunctions as a sibling project to the Portals once it launches | |||
| Resolved | cmassaro | T342820 Migrate wikifunctions.org from locked-down to limited mode, letting users edit wikitext pages and some | |||
| Resolved | DMartin-WMF | T341748 Wikifunctions metrics: Track inventory of functions, implementations, tests | |||
| Resolved | DMartin-WMF | T341724 WikiLambda metrics: Add wikilambda_zobject_function_join query to sqoop | |||
| Resolved | DMartin-WMF | T341728 WikiLambda metrics: Create wikilambda_zobject_function_join table in Hive | |||
| Resolved | DMartin-WMF | T341725 WikiLambda metrics: Add wikilambda_zobject_labels query to sqoop | |||
| Resolved | DMartin-WMF | T341729 WikiLambda metrics: Create wikilambda_zobject_labels table in Hive | |||
| Resolved | DMartin-WMF | T342199 WikiLambda metrics: Create puppet scripting for Wikifunctions tables |
@DMartin-WMF
I confirmed I could query both of these sqoop'd tables with hive and with presto in superset. They are found under the following table names: wmf_raw.wikilambda_zobject_labels and wmf_raw.wikilambda_zobject_labels. All data currently appears to be logging as expected.
Some example queries and results below for reference. Data reflects daily snapshot recorded on '07 August 2023' Note: These queries are written based on the documentation in the instrumentation spec. Let me know if the results seem unexpected or any adjustments are needed.
Number of functions created
180
--Count distinct values of wlzl_zobject_zid, where wlzl_type = 'Z8' SELECT COUNT (DISTINCT wlzl_zobject_zid) as n_functions_created FROM wmf_raw.wikilambda_zobject_labels WHERE snapshot = 'latest' AND wlzl_type = 'Z8'
Number of implementations created
222
Number of tests created
294
--Count values of wlzf_ref_zid, where where wlzf_type = 'Z14' (implementation) or wlzf_type = 'Z20' (test) SELECT wlzf_type, COUNT (DISTINCT wlzf_ref_zid) FROM wmf_raw.wikilambda_zobject_function_join WHERE snapshot = 'latest' GROUP BY wlzf_type