fdans (Francisco Dans)
Disabled

Projects

Data-Engineering
Group
Data-Engineering-Icebox
Group

User Details

User Since: Dec 12 2016, 8:49 PM (289 w, 5 d)
Roles: Disabled
LDAP User: Unknown
MediaWiki User: FDans (WMF) [ Global Accounts ]

This account has been disabled.

Recent Activity
View All

Aug 19 2021

• fdans moved T283596: Change routing to accept a list of wikis in URL from Ready to Deploy to Done on the Analytics-Kanban board.

Aug 19 2021, 6:23 PM · Analytics-Wikistats, Analytics

• fdans moved T283624: Change state to store project as an array from Ready to Deploy to Done on the Analytics-Kanban board.

Aug 19 2021, 6:23 PM · Analytics-Wikistats, Analytics

• fdans moved T289279: Add check to make sure deny-list countries aren't being passed through AQS from Next Up to Ready to Deploy on the Analytics-Kanban board.

Aug 19 2021, 6:23 PM · Privacy, Privacy Engineering, SecTeam-Processed, Data-Engineering, Analytics-Kanban, Security

• fdans created T289279: Add check to make sure deny-list countries aren't being passed through AQS.

Aug 19 2021, 5:11 PM · Privacy, Privacy Engineering, SecTeam-Processed, Data-Engineering, Analytics-Kanban, Security

Aug 16 2021

• fdans moved T251777: Creation of canonical pageview dumps for users to download from In Progress to Paused on the Analytics-Kanban board.

Aug 16 2021, 10:19 PM · Product-Analytics

Aug 2 2021

• fdans closed T287661: Translations not getting imported into Wikistats as Resolved.

@Sabeloga this is really valuable feedback! I've opened two tasks with the bugs you've mentioned. They are two super simple issues, but it's better to track them separately from the original query to keep archives happy.

Aug 2 2021, 9:17 PM · I18n, Analytics, Analytics-Wikistats

• fdans triaged T287910: Fixed time range names are forced to capitalized regardless of locale in sidebar as Medium priority.

Aug 2 2021, 9:13 PM · Analytics-Wikistats, I18n, Analytics

• fdans created T287910: Fixed time range names are forced to capitalized regardless of locale in sidebar.

Aug 2 2021, 9:13 PM · Analytics-Wikistats, I18n, Analytics

• fdans created T287908: Metrics tooltip in detail page is not localized.

Aug 2 2021, 9:08 PM · Analytics-Wikistats, Analytics

• fdans merged task T287565: Monthly Wikimedia pageviews dumps cann't be decompressed into T287684: wikistats: montly pageview dumps are not bz2 files.

Aug 2 2021, 2:49 PM · Analytics, Dumps-Generation

• fdans merged T287565: Monthly Wikimedia pageviews dumps cann't be decompressed into T287684: wikistats: montly pageview dumps are not bz2 files.

Aug 2 2021, 2:49 PM · Data-Engineering, Analytics, Analytics-Wikistats

Jul 30 2021

• fdans triaged T287684: wikistats: montly pageview dumps are not bz2 files as High priority.

My apologies for this. The intended format is bz2, not parquet. Clearly a miss of mine when configuring the job, looking into options to regenerate/convert in the least disruptive way possible.

Jul 30 2021, 2:14 PM · Data-Engineering, Analytics, Analytics-Wikistats

Jul 29 2021

• fdans closed T287661: Translations not getting imported into Wikistats as Resolved.

Hi @Sabeloga, my apologies: until today there were some issues related to the deployment of Wikistats that prevented the release of new languages. I haven't had the bandwidth to deal with those until today but I'm happy to confirm that the latest deploy is out and you should be able to see Swedish in the language list.

Jul 29 2021, 6:55 PM · I18n, Analytics, Analytics-Wikistats

• fdans claimed T287684: wikistats: montly pageview dumps are not bz2 files.

Jul 29 2021, 5:49 PM · Data-Engineering, Analytics, Analytics-Wikistats

• fdans claimed T287661: Translations not getting imported into Wikistats.

Jul 29 2021, 5:49 PM · I18n, Analytics, Analytics-Wikistats

• fdans claimed T287565: Monthly Wikimedia pageviews dumps cann't be decompressed.

Jul 29 2021, 5:49 PM · Analytics, Dumps-Generation

• fdans moved T283596: Change routing to accept a list of wikis in URL from In Code Review to Ready to Deploy on the Analytics-Kanban board.

Jul 29 2021, 4:16 PM · Analytics-Wikistats, Analytics

• fdans moved T283624: Change state to store project as an array from In Code Review to Ready to Deploy on the Analytics-Kanban board.

Jul 29 2021, 4:16 PM · Analytics-Wikistats, Analytics

Jul 13 2021

• fdans moved T283254: Wikistats should allow more than one project from Next Up to In Code Review on the Analytics-Kanban board.

Jul 13 2021, 4:05 PM · Analytics-Wikistats, Analytics

Jun 21 2021

• fdans moved T285050: Expand Wikiselector to allow more than one wiki from Next Up to In Code Review on the Analytics-Kanban board.

Jun 21 2021, 3:53 PM · Analytics-Wikistats, Patch-For-Review, Analytics

Jun 16 2021

• fdans added a comment to T285050: Expand Wikiselector to allow more than one wiki.

Proposed design:

Jun 16 2021, 1:14 PM · Analytics-Wikistats, Patch-For-Review, Analytics

• fdans created T285050: Expand Wikiselector to allow more than one wiki.

Jun 16 2021, 1:14 PM · Analytics-Wikistats, Patch-For-Review, Analytics

Jun 14 2021

• fdans moved T283624: Change state to store project as an array from In Progress to In Code Review on the Analytics-Kanban board.

Jun 14 2021, 11:53 AM · Analytics-Wikistats, Analytics

• fdans moved T265732: Create monthly job for canonical pageviews from Ready to Deploy to Paused on the Analytics-Kanban board.

Jun 14 2021, 11:53 AM · Analytics-Kanban, Analytics

Jun 1 2021

• fdans moved T283624: Change state to store project as an array from Next Up to In Progress on the Analytics-Kanban board.

Jun 1 2021, 4:05 PM · Analytics-Wikistats, Analytics

• fdans moved T283596: Change routing to accept a list of wikis in URL from Next Up to In Code Review on the Analytics-Kanban board.

Jun 1 2021, 4:05 PM · Analytics-Wikistats, Analytics

May 25 2021

• fdans created T283624: Change state to store project as an array.

May 25 2021, 7:09 PM · Analytics-Wikistats, Analytics

• fdans created T283596: Change routing to accept a list of wikis in URL.

May 25 2021, 2:52 PM · Analytics-Wikistats, Analytics

• fdans created T283593: Add ignore success flags option to pageview monthly dumps.

May 25 2021, 2:40 PM · Data-Engineering

May 20 2021

JAllemandou awarded T283254: Wikistats should allow more than one project a Love token.

May 20 2021, 5:18 PM · Analytics-Wikistats, Analytics

• fdans created T283254: Wikistats should allow more than one project.

May 20 2021, 3:59 PM · Analytics-Wikistats, Analytics

• fdans created T283251: Add ability to compare wikis.

May 20 2021, 3:47 PM · Analytics-Wikistats, Epic, Analytics

• fdans closed T247064: Remove Topic Explorer from Wikistats as Declined.

May 20 2021, 3:38 PM · Analytics

• fdans closed T247106: Question box in wikistats, instrument usage with piwik, a subtask of T247064: Remove Topic Explorer from Wikistats, as Resolved.

May 20 2021, 3:38 PM · Analytics

• fdans closed T247106: Question box in wikistats, instrument usage with piwik as Resolved.

May 20 2021, 3:38 PM · Analytics

May 3 2021

• fdans closed T281668: Fix sqoop script to use timestamp limits in `--boundary-query` queries as Resolved.

May 3 2021, 3:56 PM · Analytics-Kanban, Analytics

• fdans triaged T281617: Wikistats shows 0 views for April when data isn't available yet as High priority.

May 3 2021, 3:55 PM · Analytics-Wikistats, Analytics

• fdans triaged T281605: Stop Refining mediawiki_job events in Hive as High priority.

May 3 2021, 3:52 PM · Analytics-Kanban, Analytics

• fdans moved T281483: mediawiki/page/properties-change schema should use map type for added and removed page properties from Incoming to Event Platform on the Analytics board.

May 3 2021, 3:51 PM · Data-Engineering, Event-Platform, Analytics

• fdans moved T280844: Too many views to Skathi (moon) on enwiki from Incoming to Data Quality on the Analytics board.

May 3 2021, 3:42 PM · Data-Engineering-Radar, Analytics, Product-Analytics, Pageviews-Anomaly

• fdans assigned T280784: Aggregate table not working after superset upgrade to • razzi.

May 3 2021, 3:41 PM · Analytics-Kanban, Analytics, Product-Analytics

• fdans moved T280905: Analytics coordinator failover improvements from Incoming to Operational Excellence on the Analytics board.

May 3 2021, 3:38 PM · Data-Engineering

• fdans triaged T280293: Delete UpperCased eventlogging legacy directories in /wmf/data/event 90 days from 2021-04-15 (after 2021-07-14) as High priority.

May 3 2021, 3:37 PM · Analytics-Kanban, Analytics

• fdans moved T280262: Decommission analytics-tool1001 and all the CDH leftovers from Incoming to Operational Excellence on the Analytics board.

May 3 2021, 3:36 PM · Analytics-Kanban, Patch-For-Review, Analytics

• fdans triaged T280175: Fix default ownership and permissions for Hive managed databases in /user/hive/warehouse as High priority.

May 3 2021, 3:34 PM · Product-Analytics, Analytics-Kanban, Analytics

• fdans added a project to T280017: Deploy schema repos to analytics cluster and use local uris for analytics jobs: Analytics-Kanban.

May 3 2021, 3:32 PM · Event-Platform, Analytics

• fdans edited projects for T275148: Prepare User group methods for hard deprecation, added: Analytics-Radar; removed Analytics.

May 3 2021, 3:31 PM · MW-1.37-notes (1.37.0-wmf.17; 2021-08-02), Technical-Debt (Deprecation process), MW-1.36-notes (1.36.0-wmf.37; 2021-03-30), Platform Team Workboards (MW Expedition)

Apr 29 2021

• fdans closed T276906: Configure the HDFS Namenodes to use the log4j rolling gzip appender as Resolved.

Apr 29 2021, 2:56 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters

• fdans closed T277729: Add better monitoring for Analytics UIs as Resolved.

Apr 29 2021, 2:56 PM · Analytics-Kanban, Patch-For-Review, Analytics

• fdans closed T278982: npm install gives Verification failed while extracting mediawiki-storage@https://github.com/wikimedia/analytics-mediawiki-storage/archive/master.tar.gz as Resolved.

Apr 29 2021, 2:56 PM · Analytics-Kanban, Analytics-Dashiki, Analytics

• fdans closed T255973: Balance Kafka topic partitions on Kafka Jumbo to take advantage of the new brokers as Resolved.

Apr 29 2021, 2:56 PM · Analytics-Kanban, Analytics-Clusters

• fdans closed T278421: Upgrade furud/flerovium to Debian Buster, a subtask of T231067: Install Debian Buster on Hadoop, as Resolved.

Apr 29 2021, 2:56 PM · Analytics-Clusters

• fdans closed T278421: Upgrade furud/flerovium to Debian Buster as Resolved.

Apr 29 2021, 2:56 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters

• fdans closed T278424: Upgrade the Hadoop coordinators to Debian Buster, a subtask of T231067: Install Debian Buster on Hadoop, as Resolved.

Apr 29 2021, 2:56 PM · Analytics-Clusters

• fdans closed T278424: Upgrade the Hadoop coordinators to Debian Buster as Resolved.

Apr 29 2021, 2:56 PM · Analytics-Kanban, Patch-For-Review, Analytics-Clusters

• fdans closed T278551: Duplicate wikitext entries for a bunch of wikis in 2021-02 snapshot as Resolved.

Apr 29 2021, 2:56 PM · Analytics-Kanban, Analytics

• fdans closed T280813: Rename event_sanitized partition directories to lowercase, a subtask of T273789: Sanitize and ingest all event tables into the event_sanitized database, as Resolved.

Apr 29 2021, 2:56 PM · Patch-For-Review, Analytics-Kanban, Event-Platform, Analytics

• fdans closed T280813: Rename event_sanitized partition directories to lowercase as Resolved.

Apr 29 2021, 2:55 PM · Analytics-Kanban, Event-Platform, Analytics

Apr 26 2021

• fdans triaged T281144: [event sanitization] Add a "mask" functionality to purge string fields as Low priority.

Apr 26 2021, 4:09 PM · Analytics

• fdans triaged T280997: [Reportupdater] Support category of jobs that cannot be backfilled as Low priority.

Apr 26 2021, 4:06 PM · Analytics

• fdans closed T280823: [reportupdater] add --no-graphite flag as Resolved.

Apr 26 2021, 4:03 PM · Analytics

• fdans triaged T280549: Consolidate labs / production sqoop lists to a single list as High priority.

Apr 26 2021, 4:03 PM · Analytics-Kanban, Analytics

• fdans triaged T280268: Use inclusive language in code for private analytics infrastructure as High priority.

Apr 26 2021, 4:01 PM · Data-Engineering

• fdans triaged T279567: Review request: New datasets for WMCZ published under analytics.wikimedia.org as Medium priority.

Apr 26 2021, 3:58 PM · Data-Engineering, WMCZ-Stats

• fdans lowered the priority of T280678: Crunch and delete many old dumps logs from High to Medium.

Apr 26 2021, 3:49 PM · Data-Engineering

Apr 19 2021

• fdans assigned T280107: Generate dump of scored-revisions from 2018-2020 for Wikis except English Wikipedia to JAllemandou.

Apr 19 2021, 4:37 PM · artificial-intelligence, editquality-modeling, ORES, Machine-Learning-Team

• fdans triaged T280029: Easy dimensional data visualization as Medium priority.

Apr 19 2021, 4:35 PM · Data-Engineering

• fdans triaged T280565: Improve pageview automated traffic detection heuristics as Medium priority.

Apr 19 2021, 4:22 PM · Data-Engineering

• fdans triaged T280011: Top read repeats as Medium priority.

Apr 19 2021, 4:21 PM · Data-Engineering, Product-Analytics

• fdans added a subtask for T280565: Improve pageview automated traffic detection heuristics: T280011: Top read repeats.

Apr 19 2021, 4:21 PM · Data-Engineering

• fdans added a parent task for T280011: Top read repeats: T280565: Improve pageview automated traffic detection heuristics.

Apr 19 2021, 4:21 PM · Data-Engineering, Product-Analytics

• fdans triaged T279952: event.WikipediaPortal referer modification as Medium priority.

Apr 19 2021, 4:15 PM · Data-Engineering, Privacy Engineering, FR-Tech-Analytics

• fdans triaged T279841: Improve Sonar job for analytics-refinery-source as Low priority.

@awight do you feel like taking this one?

Apr 19 2021, 4:06 PM · Analytics

• fdans triaged T278982: npm install gives Verification failed while extracting mediawiki-storage@https://github.com/wikimedia/analytics-mediawiki-storage/archive/master.tar.gz as High priority.

Apr 19 2021, 3:57 PM · Analytics-Kanban, Analytics-Dashiki, Analytics

• fdans moved T280367: Mysql partition on an-coord1001 sudden change in growth rate since Apr 14th from Incoming to Operational Excellence on the Analytics board.

Apr 19 2021, 3:55 PM · Analytics

• fdans moved T279738: Superset annotation text overlaps illegibly from Incoming to Data Exploration Tools on the Analytics board.

Apr 19 2021, 3:54 PM · Superset, Data-Engineering

• fdans placed T280538: Capture rev_is_revert event data in a stream different than mediawiki.revision-create up for grabs.

Apr 19 2021, 3:53 PM · Data-Engineering, Privacy Engineering, Privacy, Event-Platform, Product-Analytics, Analytics

• fdans moved T280385: Apache Beam go prototype code for DP evaluation from Incoming to Security Maturity and Data Privacy on the Analytics board.

Apr 19 2021, 3:47 PM · Data-Engineering, Research, Privacy Engineering, Privacy, Data-release

• fdans edited projects for T280311: Temp files left around in wikistats_1/ ?, added: Analytics-Radar; removed Analytics.

Apr 19 2021, 3:44 PM · Analytics-Radar, Dumps-Generation

• fdans added a comment to T280311: Temp files left around in wikistats_1/ ?.

@ArielGlenn thank you for noticing, please delete!

Apr 19 2021, 3:44 PM · Analytics-Radar, Dumps-Generation

Apr 15 2021

• fdans triaged T279564: New Wikivoyages are only partially included in Stats as High priority.

Apr 15 2021, 5:27 PM · Analytics-Kanban, Analytics, Analytics-Wikistats

• fdans triaged T279440: Data drifts between superset_production on an-coord1001 and db1108 as High priority.

Apr 15 2021, 5:26 PM · Analytics

• fdans triaged T279382: VirtualPageView should use EventLogging api to send virtual page view events as High priority.

Apr 15 2021, 5:23 PM · MW-1.37-notes (1.37.0-wmf.4; 2021-05-04), Readers-Web-Backlog (Kanbanana-FY-2020-21), Product-Data-Infrastructure, Analytics, Event-Platform, Better Use Of Data

• fdans assigned T279382: VirtualPageView should use EventLogging api to send virtual page view events to mforns.

Apr 15 2021, 5:23 PM · MW-1.37-notes (1.37.0-wmf.4; 2021-05-04), Readers-Web-Backlog (Kanbanana-FY-2020-21), Product-Data-Infrastructure, Analytics, Event-Platform, Better Use Of Data

• fdans added projects to T279328: Replace usages of Linker::link() and Linker::linkKnown() in extension EventLogging: Event-Platform, Product-Data-Infrastructure.

Apr 15 2021, 5:20 PM · Platform Team Workboards (External Code Reviews), Product-Data-Infrastructure, Event-Platform, MediaWiki-extensions-EventLogging, Technical-Debt, Analytics

• fdans moved T278701: Store AQS schema and grants in git from Incoming to Operational Excellence on the Analytics board.

Apr 15 2021, 5:17 PM · Analytics-Kanban, Cassandra, Analytics

• fdans added a project to T278701: Store AQS schema and grants in git: Analytics-Kanban.

Apr 15 2021, 5:17 PM · Analytics-Kanban, Cassandra, Analytics

• fdans edited projects for T278665: wmde-toolkit-analyzer-build.service fails on stat1007, added: Analytics-Radar; removed Analytics.

Apr 15 2021, 5:16 PM · Analytics-Radar, WMDE-Analytics-Engineering

• fdans moved T278551: Duplicate wikitext entries for a bunch of wikis in 2021-02 snapshot from Incoming to Data Quality on the Analytics board.

Apr 15 2021, 5:14 PM · Analytics-Kanban, Analytics

• fdans triaged T278467: Use Hive/Spark timestamps in Refined event data as Low priority.

Apr 15 2021, 5:13 PM · Data-Engineering, Research, Product-Analytics

• fdans assigned T278416: Mention QRank in “Analytics Datasets” to Ottomata.

Apr 15 2021, 5:10 PM · Analytics-Kanban, Dumps-Generation, Analytics

• fdans edited projects for T280152: Mitigate breaking changes from the new Wiki Replicas architecture, added: Analytics-Radar; removed Analytics.

Apr 15 2021, 5:05 PM · Analytics-Radar, cloud-services-team (Kanban), Data-Services

• fdans raised the priority of T230915: Import of MediaWiki tables into the Data Lakes mangles usernames from Medium to High.

Apr 15 2021, 5:04 PM · Analytics-Kanban, Analytics-Data-Quality, Analytics

• fdans moved T280155: Dual loading from Hive into old and new AQS clusters from Incoming to Operational Excellence on the Analytics board.

Apr 15 2021, 5:01 PM · Analytics-Kanban, Cassandra, Analytics

• fdans moved T279380: Add Traffic's notion of "from public cloud" to Analytics webrequest data from Incoming to Datasets on the Analytics board.

Apr 15 2021, 5:00 PM · Analytics-Kanban, SRE, Analytics, Traffic

• fdans moved T279089: Create or identify an appropriate Gerrit group for +2 rights on schemas/event/secondary from Incoming to Event Platform on the Analytics board.

Apr 15 2021, 4:57 PM · Event-Platform, Product-Data-Infrastructure, Product-Analytics, Better Use Of Data, Analytics, Gerrit-Privilege-Requests

• fdans assigned T279429: Audit analytics firewall filters to • razzi.

Apr 15 2021, 4:57 PM · Infrastructure-Foundations, SRE, Analytics, netops

Apr 8 2021

• fdans closed T212451: Create Spark code to compare DateTimes with partition columns as Resolved.

Apr 8 2021, 4:25 PM · Analytics-Kanban, Analytics

• fdans closed T277536: Webrequest.isWMFDomain should return true for .wmflabs.org domains., a subtask of T271163: TranslationRecommendation* Schemas Event Platform Migration, as Resolved.

Apr 8 2021, 4:25 PM · Data-Engineering, Research, Analytics, Event-Platform

• fdans closed T272390: Upgrade to Superset 1.0, a subtask of T211706: Superset Updates , as Resolved.

Apr 8 2021, 4:25 PM · Superset, Tracking-Neverending, Better Use Of Data, Analytics-Kanban, Product-Analytics