User Details
User Details
- User Since
- Sep 7 2023, 12:13 AM (117 w, 3 d)
- Availability
- Available
- LDAP User
- Ahoelzl
- MediaWiki User
- AHoelzl-WMF [ Global Accounts ]
Fri, Dec 5
Fri, Dec 5
Ahoelzl added a comment to T411774: Requesting a new group allowing shell access to kafka-jumbo servers - with membership for JavierMonton.
Approved. Membership and actions on the Kafka cluster will be tightly coordinated between DE and DPE SRE.
Wed, Dec 3
Wed, Dec 3
Ahoelzl added a comment to T411679: Requesting access to analytics-privatedata-users for astein.
Approved.
Ahoelzl added a comment to T411648: Requesting access to the analytics-platform-eng-admins POSIX group for Sandra Ebele Nwoko.
Approved.
Mon, Dec 1
Mon, Dec 1
Thu, Nov 27
Thu, Nov 27
Ahoelzl added a comment to T405039: Global Editor Metrics - Data Pipeline.
Revised: Daily source dataset decision
Wed, Nov 26
Wed, Nov 26
Ahoelzl moved T408939: Fix iceberg table location in hive metastore from Incoming (new tickets) to Needs Clarification on the Data-Engineering board.
Ahoelzl moved T408819: When wikis cannot be exported due to SiteInfo, don't fail them from Incoming (new tickets) to Next Up on the Data-Engineering board.
Ahoelzl added a comment to T408819: When wikis cannot be exported due to SiteInfo, don't fail them.
How often do we run into this case? Could this be handled by documentation / run book for the person on OpsWeek?
Ahoelzl closed T315196: Get visibility which pages are being heavily edited, plundered, which need patrolling as Declined.
3 years old ticket. Please re-open if still needed.
Ahoelzl moved T408177: [EPIC] Deprecate and remove mw.eventLog.id from Incoming (new tickets) to Tag with Radar on the Data-Engineering board.
Ahoelzl updated subscribers of T408719: Stop adding user-agent details to http.request_header.user-agent directly via EventLogging.
@JVanderhoop-WMF can you help us understand DE impact?
Ahoelzl moved T408179: Remove mw.eventLog.id from Incoming (new tickets) to Tag with Radar on the Data-Engineering board.
Ahoelzl moved T410531: Drop rc_type from recentchanges in wmf production from Incoming (new tickets) to Needs Clarification on the Data-Engineering board.
Ahoelzl updated subscribers of T410531: Drop rc_type from recentchanges in wmf production.
@JAllemandou is this relevant for Data Engineering?
Ahoelzl lowered the priority of T409874: Thanos / Prometheus metrics names with uppercase characters not accessible from Superset SQL Lab or Presto CLI from Medium to Low.
Priority: low. We are not aware of any critical dependencies on that.
Ahoelzl moved T405865: [Spike] Comparitive game stats from Incoming (new tickets) to Backlog on the Data-Engineering board.
Ahoelzl added a comment to T410972: Requesting access to cassandra-staging-devs group for amastilovic.
Thanks for the ping. Approved.
Tue, Nov 25
Tue, Nov 25
Ahoelzl added a comment to T410962: Provision Global Editor Metrics tables & endpoints.
The more I look at this top k endpoint, the more I think I may have misunderstood what was intended. I reckon the endpoint should accept a start and end timestamp, and return all of the aggregations included (like the other). I'll update it to reflect that.
Thu, Nov 20
Thu, Nov 20
Ahoelzl edited projects for T406764: Provide a dbt-core development environment and production setup in the data-platform, added: Data-Engineering-Roadmap; removed Data-Engineering.
Ahoelzl moved T391580: DPE Data Engineering Phabricator Improvements from Next to Backlog on the Data-Engineering-Roadmap board.
Ahoelzl moved T409577: Analyze JA3N data and generate JA3N-UA table from Backlog to Q2 FY25-26 on the Data-Engineering-Roadmap board.
Ahoelzl edited projects for T406764: Provide a dbt-core development environment and production setup in the data-platform, added: Data-Engineering; removed Data-Engineering (Q2 FY25/26 October 1st - December 31th).
Moving this to Data Engineering Roadmap board
Wed, Nov 19
Wed, Nov 19
Ahoelzl edited projects for T410017: Provide a Spark production access for dbt with Airflow, added: OKR-Work; removed Essential-Work.
Ahoelzl added a comment to T380856: Reduce `refine_to_hive_hourly` airflow task number.
@Antoine_Quhen is this related to the high number of requests to the Hive metastore?
Ahoelzl updated subscribers of T410528: Add monitoring / alerting on the number of MySQL queries done by Hive.
Ahoelzl moved T410557: Make blunderbuss synchronize artifacts for the test-cluster from Incoming (new tickets) to Next Up on the Data-Engineering board.
Ahoelzl added a comment to T406525: mediawiki_history_reduced.check_mediawiki_history_reduced error ratio hit.
@amastilovic is this blocking any Global Editor Metrics work, specifically the daily updates going forward?
Ahoelzl added a comment to T406634: Set up a working, usable dbt installation on stat boxes.
@BTullis with https://phabricator.wikimedia.org/T406766 being completed, what is the additional work here? Thanks!
Ahoelzl updated the task description for T406634: Set up a working, usable dbt installation on stat boxes.
Ahoelzl updated the task description for T406634: Set up a working, usable dbt installation on stat boxes.
Tue, Nov 18
Tue, Nov 18
Ahoelzl renamed T410017: Provide a Spark production access for dbt with Airflow from [Spike] Test spark thrift-server for dbt with Airflow to Provide a Spark thrift-server for dbt with Airflow.
Ahoelzl renamed T406764: Provide a dbt-core development environment and production setup in the data-platform from Provide dbt-core and appropriate adapters in the data-platform environment to Provide a dbt-core development environment and production setup in the data-platform.
Ahoelzl renamed T406764: Provide a dbt-core development environment and production setup in the data-platform from Explore the use of dbt-core and appropriate adapters in the data-platform environment to Provide dbt-core and appropriate adapters in the data-platform environment.
Ahoelzl moved T406765: Create a new gitlab repository for use with dbt from Next Up to Done on the Data-Engineering (Q2 FY25/26 October 1st - December 31th) board.
We converged on https://gitlab.wikimedia.org/repos/data-engineering/dbt-jobs
Ahoelzl added a comment to T410017: Provide a Spark production access for dbt with Airflow.
For the initial automation / scheduled execution a single instance using the analytics user will suffice. We currently have one dbt jobs repository.
Ahoelzl raised the priority of T410017: Provide a Spark production access for dbt with Airflow from Medium to High.
Ahoelzl closed T400360: Fix Hive event.development_network_probe table, a subtask of T398596: Consider using the alternate chain of Google Trust Services certificates, as Resolved.
Ahoelzl closed T406263: mediawiki_history_reduced - add page_id and user_central_id fields as Resolved.
Ahoelzl closed T408404: Vet JA3N data in webrequest and pageview_actor, a subtask of T407893: Technical work for SDS1.3.7 Incorporate Edge Signal, as Resolved.
Ahoelzl closed T408687: Create example dbt models using Iceberg, a subtask of T406764: Provide a dbt-core development environment and production setup in the data-platform, as Resolved.
Ahoelzl closed T406636: Create a dbt Docker container, a subtask of T406764: Provide a dbt-core development environment and production setup in the data-platform, as Resolved.
Ahoelzl closed T407239: SDS 1.3.2 Implementation, a subtask of T407235: SDS 1.3.2 [EPIC] Automated alerting for changes in automated traffic behavior, as Resolved.
Ahoelzl closed T407649: Compare the exported content between File Export and DumpV1, a subtask of T384382: Production-level file export (aka dump) of MW Content in XML, as Resolved.
Ahoelzl closed T409099: Iceberg Merge strategies with dbt, a subtask of T406764: Provide a dbt-core development environment and production setup in the data-platform, as Resolved.
Thu, Nov 13
Thu, Nov 13
Wed, Nov 12
Wed, Nov 12
Ahoelzl edited projects for T405865: [Spike] Comparitive game stats, added: Data-Engineering; removed Data-Engineering (Q2 FY25/26 October 1st - December 31th).