These should read from the EventGate stream `/analytics/mediawiki/wmde_page_summary` and output to a newly-created analytics table.
- [] Create a new Airflow job following a template.
- [] Write an Airflow sensor which can detect that the month's scraper run has completed.
- [] Create the new analytics table.
- [] Recreate the "[[ https://gitlab.com/wmde/technical-wishes/scrape-wiki-html-dump/-/blob/main/metrics.md#wiki-summary | wiki summary ]]" metrics that were removed in [[ https://gitlab.com/wmde/technical-wishes/scrape-wiki-html-dump/-/commit/8ba951e6644835d11161d4200ce06bd153e71a21 | this patch ]].
== Resources
- https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow
- https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide
- https://airflow.apache.org/docs/