User Details
- User Since
- Sep 7 2023, 12:13 AM (161 w, 4 d)
- Availability
- Available
- LDAP User
- Ahoelzl
- MediaWiki User
- AHoelzl-WMF [ Global Accounts ]
Fri, Oct 2
@SVG-image-maker there are no code dependencies anymore. Read-only mode is pending.
cc @amastilovic
Wed, Sep 30
Tue, Sep 29
Not needed atm. Microbatching might be the path forward.
Example: problem can occurs when running dbt compile under sudo -u analytics and then running jobs as user.
Mon, Sep 28
Discussed in the DE sync meeting. Due to the implementation urgency and challenges with a tags change event stream, we are moving forward as planned, i.e. sqooping dependent tables.
Fri, Sep 25
@nshahquinn-wmf this ticket is only concerned with automation of the searchconsole_wikipedia_org.searchdata_site_impression based site / property aggregations which is one of the reported heartbeat metrics.
Can you move your proposal to also report on the url impressions to a separate ticket? Let's discuss priority in the metrics group. Thanks!
Thu, Sep 24
Wed, Sep 23
Pinging @HShaikh on wether this is WME maintained.
Pinging @HShaikh on wether this is WME maintained.
Happening as part of DE1.3.10
@KReid-WMF FYI re Matomo deprecation
Tue, Sep 22
The currently manually updated table is gcp_gsc_export.sitedata_daily_aggregate.
This has been implemented a while ago, correct?
I see the Airflow DAG: https://airflow-platform-eng.wikimedia.org/dags/pageview_wme_transfer/grid
We basically ended up shipping our own dbt / Airflow integration and are happy with it.