Page MenuHomePhabricator

fdans (Francisco Dans)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Dec 12 2016, 8:49 PM (220 w, 6 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
FDans (WMF) [ Global Accounts ]

Recent Activity

Mon, Mar 1

fdans edited projects for T274808: Evaluate the need to generate and maintain zookeeper backups, added: Analytics-Clusters; removed Analytics.
Mon, Mar 1, 5:45 PM · Analytics-Clusters, Data-Persistence-Backup
fdans renamed T274775: Document our level of support of pyspark-based jobs from Devise a production way for pyspark jobs to Document our level of support of pyspark-based jobs.
Mon, Mar 1, 5:45 PM · Analytics
fdans triaged T274775: Document our level of support of pyspark-based jobs as Medium priority.

Even though pyspark is supported, we'll continue to only have spark-scala jobs working in the repos we own. This will be documented.

Mon, Mar 1, 5:44 PM · Analytics
fdans triaged T274605: Top read is showing one page that had fake traffic in zhwiki as High priority.

@JAllemandou to contact them as a first step

Mon, Mar 1, 5:33 PM · Wikimedia Taiwan, Analytics, Chinese-Sites, Pageviews-Anomaly, Product-Infrastructure-Team-Backlog
fdans added a comment to T274490: Fix Analytics workflow for #Analytics-EventLogging tasks.

Hi @Aklapper deleting the tag is ok to us!

Mon, Mar 1, 5:26 PM · PM, Analytics
fdans triaged T274376: Make RefineFailuresChecker checker jobs use the same parameters as Refine jobs as Medium priority.
Mon, Mar 1, 5:25 PM · Analytics
fdans triaged T274298: Make camus (or gobblin) jobs run in `essential` or `production` queue as Medium priority.
Mon, Mar 1, 5:20 PM · Analytics
fdans edited projects for T274262: Rebuild all blubber build docker images running on kubernetes, added: Analytics-Radar; removed Analytics.
Mon, Mar 1, 5:18 PM · Analytics-Radar, Recommendation-API, Event-Platform, Wikidata-Termbox, Wikifeeds, Page Content Service, Cassandra, Product-Infrastructure-Team-Backlog, Proton, ContentTranslation, Patch-For-Review, serviceops, Prod-Kubernetes
fdans added a comment to T274126: Automate the deployment procedure of Wikistats 2 to Production.

let's move this to use the deployment pipeline as described here:

Mon, Mar 1, 5:15 PM · Analytics
fdans claimed T274126: Automate the deployment procedure of Wikistats 2 to Production.
Mon, Mar 1, 5:11 PM · Analytics
fdans triaged T273901: Automate event stream ingestion into HDFS for streams that don't use EventGate as Medium priority.
Mon, Mar 1, 5:05 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Event-Platform, Analytics, Wikidata-Query-Service
fdans triaged T273854: Automate regular WDQS query parsing and data-extraction as High priority.
Mon, Mar 1, 5:03 PM · Wikidata-Query-Service, Wikidata, Analytics
fdans closed T273711: Upgrade the Analytics Hadoop cluster to Apache Bigtop as Resolved.
Mon, Mar 1, 4:57 PM · Patch-For-Review, Analytics
fdans closed T273711: Upgrade the Analytics Hadoop cluster to Apache Bigtop, a subtask of T203693: Update to CDH 6 or other up-to-date Hadoop distribution, as Resolved.
Mon, Mar 1, 4:57 PM · User-Elukey, Analytics-Clusters
fdans edited projects for T273702: Modify Kafka max replica lag alert to only alert if increasing, added: Analytics-Clusters; removed Analytics.
Mon, Mar 1, 4:56 PM · Analytics-Clusters, Analytics-Kanban, observability
fdans triaged T273642: Add analytics-presto.eqiad.wmnet CNAME for Presto coordinator failover as Medium priority.
Mon, Mar 1, 4:55 PM · Analytics-Clusters
fdans edited projects for T273642: Add analytics-presto.eqiad.wmnet CNAME for Presto coordinator failover, added: Analytics-Clusters; removed Analytics.
Mon, Mar 1, 4:55 PM · Analytics-Clusters
fdans added a project to T273789: Sanitize and ingest all event tables into the event_sanitized database: Analytics-Kanban.
Mon, Mar 1, 4:53 PM · Analytics-Kanban, Event-Platform, Analytics
fdans assigned T273789: Sanitize and ingest all event tables into the event_sanitized database to Ottomata.
Mon, Mar 1, 4:53 PM · Analytics-Kanban, Event-Platform, Analytics
fdans moved T273789: Sanitize and ingest all event tables into the event_sanitized database from Incoming to Smart Tools for Better Data on the Analytics board.
Mon, Mar 1, 4:51 PM · Analytics-Kanban, Event-Platform, Analytics
fdans edited projects for T273064: Setup Analytics team in VO/splunk oncall, added: Analytics-Clusters; removed Analytics.
Mon, Mar 1, 4:48 PM · Analytics-Clusters, User-fgiunchedi, observability
fdans edited projects for T274795: Decommisison the Hadoop backup cluster and add the worker nodes to the main Hadoop cluster , added: Analytics-Clusters; removed Analytics.
Mon, Mar 1, 4:45 PM · Patch-For-Review, Analytics-Clusters
fdans closed T274384: Repackage spark without hadoop, use provided hadoop jars, a subtask of T274322: Clean up issues with jobs after Hadoop Upgrade, as Resolved.
Mon, Mar 1, 4:44 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans closed T274384: Repackage spark without hadoop, use provided hadoop jars as Resolved.
Mon, Mar 1, 4:44 PM · Analytics-Kanban, Patch-For-Review, Analytics
fdans closed T273629: HDFS Namenode: use a separate port for Block Reports and Zookeeper failover as Resolved.
Mon, Mar 1, 4:44 PM · Analytics-Kanban, Analytics
fdans edited projects for T275896: Review ROCm deployment procedures and current packages, added: Machine-Learning-Team, Analytics-Radar; removed Analytics.
Mon, Mar 1, 4:42 PM · Analytics-Radar, Machine-Learning-Team, SRE
fdans edited projects for T275694: Draft of full process for instrumentation using new client libraries, added: Analytics-Radar; removed Analytics.
Mon, Mar 1, 4:35 PM · Analytics-Radar, Product-Analytics (Kanban), Event-Platform, Product-Data-Infrastructure
fdans closed T274345: Move the puppet codebase from cdh to bigtop, a subtask of T273711: Upgrade the Analytics Hadoop cluster to Apache Bigtop, as Resolved.
Mon, Mar 1, 4:29 PM · Patch-For-Review, Analytics
fdans closed T274345: Move the puppet codebase from cdh to bigtop as Resolved.
Mon, Mar 1, 4:29 PM · Analytics-Kanban, Analytics

Tue, Feb 9

fdans added a comment to T273741: Investigate unusual media traffic pattern for AsterNovi-belgii-flower-1mb.jpg on Commons.

@ssingh said it yesterday on chat but this is such stellar data detective work. Congrats on finding the culprit!!

Tue, Feb 9, 5:24 PM · Patch-For-Review, Commons, Traffic, SRE

Mon, Feb 8

fdans added a comment to T273741: Investigate unusual media traffic pattern for AsterNovi-belgii-flower-1mb.jpg on Commons.

As was suggested on Twitter, this surge coincides almost perfectly with the ban of TikTok, as well as other 223 Chinese apps, in India

Mon, Feb 8, 11:29 PM · Patch-For-Review, Commons, Traffic, SRE
fdans added a comment to T273741: Investigate unusual media traffic pattern for AsterNovi-belgii-flower-1mb.jpg on Commons.

Hm! It is included in the imagenet URL list, I think. Could we be looking at some CV training pipeline that's not caching properly?

http://image-net.org/api/text/imagenet.synset.geturls?wnid=n11934807

Mon, Feb 8, 11:18 PM · Patch-For-Review, Commons, Traffic, SRE
fdans created T274207: [bug] Mediaviews won't save the agent type selection in the url.
Mon, Feb 8, 10:18 PM · Tool-Pageviews
fdans closed T238001: Archive docs for old Wikistats and update links to Wikistats 2 as Resolved.

This is a pretty old task. At this point there's probably a few documents with ambiguous references to Wikistats, but we can correct them as they come. Closing.

Mon, Feb 8, 9:09 PM · Analytics
fdans closed T238001: Archive docs for old Wikistats and update links to Wikistats 2, a subtask of T237752: Make stats.wikimedia.org point to wikistats2 by default , as Resolved.
Mon, Feb 8, 9:09 PM · Analytics-Kanban, Analytics
fdans triaged T273818: Build a process to check permissions when changing datasets from non-PII to PII as Medium priority.
Mon, Feb 8, 5:18 PM · Analytics
fdans edited projects for T273924: Provide a list of 100 most popular articles of Russian and English Wikipedias in terms of page views from Ukraine, added: Analytics-Radar; removed Analytics.
Mon, Feb 8, 5:13 PM · Analytics-Radar, Product-Analytics
fdans edited projects for T273826: Growth: remove Homepage and Help Panel schemas from the schema whitelist, added: Analytics-Radar; removed Analytics.
Mon, Feb 8, 4:57 PM · Product-Analytics (Kanban), Analytics-Radar, Growth-Team (Current Sprint)
fdans moved T273815: Growth: End wider data purge window from Incoming to Security Maturity and Data Privacy on the Analytics board.
Mon, Feb 8, 4:56 PM · Growth-Scaling, Product-Analytics, Analytics, Growth-Team
fdans moved T273821: Growth: delete data older than 90 days from Datasets to Security Maturity and Data Privacy on the Analytics board.
Mon, Feb 8, 4:56 PM · Analytics-Kanban, Growth-Scaling, Product-Analytics, Analytics, Growth-Team
fdans moved T273821: Growth: delete data older than 90 days from Incoming to Datasets on the Analytics board.
Mon, Feb 8, 4:56 PM · Analytics-Kanban, Growth-Scaling, Product-Analytics, Analytics, Growth-Team
fdans added a comment to T273821: Growth: delete data older than 90 days .

Hi @mpopov is there anything needed from us for this task and the parent?

Mon, Feb 8, 4:55 PM · Analytics-Kanban, Growth-Scaling, Product-Analytics, Analytics, Growth-Team
fdans moved T273789: Sanitize and ingest all event tables into the event_sanitized database from Incoming to Event Platform on the Analytics board.
Mon, Feb 8, 4:53 PM · Analytics-Kanban, Event-Platform, Analytics
fdans moved T273712: Check home/HDFS data of Bernd Sitzmann from Incoming to Ops Week on the Analytics board.
Mon, Feb 8, 4:50 PM · Analytics
fdans triaged T273374: Uncaught TypeError: navigator.sendBeacon is not a function as High priority.
Mon, Feb 8, 4:48 PM · Patch-For-Review, Analytics-Kanban, Analytics, Analytics-EventLogging
fdans closed T273329: Groom Incoming for Security Tasks as Resolved.
Mon, Feb 8, 4:46 PM · Analytics
fdans moved T273685: Turnilo "Display Druid query" gives "general error" from Incoming to Data Exploration Tools on the Analytics board.
Mon, Feb 8, 4:44 PM · Analytics
fdans closed T273677: Wikistats Bug: Bulgarian Language... as Invalid.

Hi, Bulgarian is only translated 19% of the way. If you want Bulgarian to be available as a selectable language, you can contribute to the translation work in TranslateWiki!

Mon, Feb 8, 4:39 PM · Analytics, Analytics-Wikistats

Feb 1 2021

fdans edited projects for T273412: rsyslog segfault on an-test-presto1001, added: Analytics-Clusters; removed Analytics.
Feb 1 2021, 5:18 PM · Analytics-Clusters, SRE
fdans triaged T273470: Bug: Active Editors showing July numbers as High priority.
Feb 1 2021, 5:17 PM · Analytics-Kanban, Analytics
fdans claimed T273470: Bug: Active Editors showing July numbers.
Feb 1 2021, 5:13 PM · Analytics-Kanban, Analytics
fdans triaged T273404: AQS tests that expect error responses pass even if the response succeeds as High priority.
Feb 1 2021, 5:06 PM · Analytics-Kanban, Analytics
fdans moved T273404: AQS tests that expect error responses pass even if the response succeeds from Incoming to Analytics Query Service on the Analytics board.
Feb 1 2021, 5:06 PM · Analytics-Kanban, Analytics
fdans assigned T273374: Uncaught TypeError: navigator.sendBeacon is not a function to Milimetric.
Feb 1 2021, 5:03 PM · Patch-For-Review, Analytics-Kanban, Analytics, Analytics-EventLogging
fdans edited projects for T273310: Reduce partition granularity of hive tables, added: Analytics-Radar; removed Analytics.
Feb 1 2021, 4:59 PM · Analytics-Radar, User-bd808
fdans moved T273293: Define acceptable usage of the `meta` object in event schemas from Incoming to Event Platform on the Analytics board.
Feb 1 2021, 4:58 PM · Product-Data-Infrastructure, Analytics, Better Use Of Data
fdans assigned T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage to mforns.
Feb 1 2021, 4:58 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics
fdans moved T273235: [Metrics Platform] Define stream configuration syntax relevant to v1 release from Incoming to Event Platform on the Analytics board.
Feb 1 2021, 4:55 PM · Better Use Of Data, Product-Analytics, Analytics, Product-Data-Infrastructure
fdans moved T273219: KaiOS / Inuka Event Platform client from Incoming to Event Platform on the Analytics board.
Feb 1 2021, 4:53 PM · Better Use Of Data, KaiOS-Wikipedia-app, Inuka-Team, Product-Analytics, Product-Data-Infrastructure, Analytics-Kanban, Analytics, Analytics-EventLogging, Event-Platform
fdans triaged T273216: Druid loading of navigationtiming gets stuck as Unbreak Now! priority.
Feb 1 2021, 4:52 PM · Analytics
fdans triaged T273215: Filter out <lang>.wikidata requests from pageview definition as Medium priority.

Ping @ema why do you think we are getting these requests? Shouldn't they be filtered upstream?

Feb 1 2021, 4:50 PM · Analytics
fdans moved T272982: Add kzeta to analytics-privatedata-users from Incoming to Operational Excellence on the Analytics board.
Feb 1 2021, 4:47 PM · SRE, SRE-Access-Requests, Analytics

Jan 28 2021

fdans moved T272926: Upgrade UA Parser to 1.5.1+ from Incoming to Data Quality on the Analytics board.
Jan 28 2021, 6:07 PM · Analytics-Kanban, Analytics
fdans triaged T273116: Create Oozie job for session length as High priority.
Jan 28 2021, 6:07 PM · Analytics-Kanban, Better Use Of Data, Analytics
fdans assigned T273069: Rematerialize all event schemas with enforceNumericBounds to Ottomata.
Jan 28 2021, 6:06 PM · Analytics-Kanban, Event-Platform, Analytics
fdans edited projects for T273034: Degraded RAID on an-worker1099, added: Analytics-Radar; removed Analytics.
Jan 28 2021, 6:01 PM · Analytics-Radar, SRE, ops-eqiad
fdans assigned T273004: Presto should warn or prevent users from querying without Hive partition predicates to razzi.
Jan 28 2021, 6:00 PM · Patch-For-Review, Analytics
fdans added a project to T272982: Add kzeta to analytics-privatedata-users: SRE-Access-Requests.
Jan 28 2021, 5:58 PM · SRE, SRE-Access-Requests, Analytics
fdans triaged T272973: Generalize the current Airflow puppet/scap code to deploy a dedicated Analytics instance as High priority.
Jan 28 2021, 5:57 PM · Analytics-Kanban, Analytics
fdans triaged T272961: Move wikidata RDF triples files/table to the wmf namespace in hdfs and hive as Medium priority.
Jan 28 2021, 5:53 PM · Wikidata-Query-Service, Wikidata, Analytics
fdans assigned T272926: Upgrade UA Parser to 1.5.1+ to Milimetric.
Jan 28 2021, 5:50 PM · Analytics-Kanban, Analytics
fdans triaged T218063: To provide performer array in RC stream as Medium priority.
Jan 28 2021, 5:44 PM · Services, Analytics, EventStreams
fdans closed T164993: archiva artifact links point to 127.0.0.1 as Resolved.
Jan 28 2021, 5:40 PM · Analytics, SRE
fdans assigned T272313: Newpytyer python spark kernels to Ottomata.
Jan 28 2021, 5:39 PM · Patch-For-Review, Analytics
fdans triaged T272714: EventGate should use recent service-runner (^2.8.1) with Prometheus support as Medium priority.
Jan 28 2021, 5:38 PM · Analytics, Services, Event-Platform
fdans closed T272741: Superset presto error: Failed to list directory: hdfs://analytics-hadoop/wmf/data/event/... as Resolved.
Jan 28 2021, 5:37 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans moved T272741: Superset presto error: Failed to list directory: hdfs://analytics-hadoop/wmf/data/event/... from Incoming to Smart Tools for Better Data on the Analytics board.
Jan 28 2021, 5:37 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans moved T272714: EventGate should use recent service-runner (^2.8.1) with Prometheus support from Incoming to Event Platform on the Analytics board.
Jan 28 2021, 5:36 PM · Analytics, Services, Event-Platform
fdans moved T273086: Downloading from Archiva.wikimedia.org seems slower than Maven Central from Incoming to Operational Excellence on the Analytics board.
Jan 28 2021, 5:35 PM · Analytics, Traffic, SRE
fdans edited projects for T273026: Errors for ifup@ens5.service after rebooting Ganeti VMs, added: Analytics-Radar; removed Analytics.
Jan 28 2021, 5:34 PM · Analytics-Radar, SRE

Jan 25 2021

fdans closed T268801: Deprecate the 'researchers' posix group as Resolved.
Jan 25 2021, 7:02 PM · Patch-For-Review, Analytics-Clusters, Analytics-Kanban
fdans closed T256677: Refine should add field to indicate if event is from wikimedia domain instead of filtering as Resolved.
Jan 25 2021, 7:01 PM · Patch-For-Review, Analytics-Kanban, Event-Platform, Analytics
fdans closed T268801: Deprecate the 'researchers' posix group, a subtask of T240437: Analytics Ops Technical Debt, as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban, Analytics
fdans closed T188859: Wikistats 2.0: Add statistics for the geographical origin of the contributors as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban, Analytics, Analytics-Wikistats
fdans closed T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, Kafka Connect HDFS, etc., a subtask of T214430: Modern Event Platform: Stream Connectors, as Resolved.
Jan 25 2021, 7:01 PM · Analytics, Goal, Services (watching), Analytics-EventLogging, Event-Platform
fdans closed T188859: Wikistats 2.0: Add statistics for the geographical origin of the contributors, a subtask of T130256: Wikistats 2.0., as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban, Analytics-Wikistats
fdans closed T237774: Address refinery-source security vulnerabilities as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban, Analytics
fdans closed T238400: Evaluate possible replacements for Camus: Gobblin, Marmaray, Kafka Connect HDFS, etc. as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban, Analytics
fdans closed T254332: Add more dimensions in the netflow/pmacct/Druid pipeline as Resolved.
Jan 25 2021, 7:01 PM · Patch-For-Review, Analytics-Kanban, Analytics, netops, SRE
fdans closed T249984: Document missing project types in pagecount dumps, a subtask of T192474: Migrate pagecounts-ez generation to hadoop, as Resolved.
Jan 25 2021, 7:01 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans closed T259202: Instrumentation development environment on EventGate server, a subtask of T185233: Modern Event Platform, as Resolved.
Jan 25 2021, 7:01 PM · Platform Team Workboards (Initiatives), Platform Team Initiatives (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, Event-Platform, Analytics-Kanban
fdans closed T254332: Add more dimensions in the netflow/pmacct/Druid pipeline, a subtask of T257554: Neflow data pipeline, as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban
fdans closed T249984: Document missing project types in pagecount dumps as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban, Analytics, Dumps-Generation
fdans closed T259202: Instrumentation development environment on EventGate server as Resolved.
Jan 25 2021, 7:01 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), Analytics-Kanban, Patch-For-Review, Analytics, Event-Platform
fdans closed T257692: Add data quality alarm for mobile-app data as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban, Analytics, Product-Analytics
fdans closed T257692: Add data quality alarm for mobile-app data , a subtask of T256508: API pageview counts for 'Mobile app' are incorrect since switch to mobile-html , as Resolved.
Jan 25 2021, 7:01 PM · Epic, Product-Analytics
fdans closed T266058: Make node-rdkafka an optional dependency of EventGate, a subtask of T259202: Instrumentation development environment on EventGate server, as Resolved.
Jan 25 2021, 7:01 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), Analytics-Kanban, Patch-For-Review, Analytics, Event-Platform
fdans closed T266058: Make node-rdkafka an optional dependency of EventGate as Resolved.
Jan 25 2021, 7:01 PM · Patch-For-Review, Analytics-Kanban, Analytics, Event-Platform
fdans closed T266573: eventgate-analytics-external occasionally seems to fail lookups of dynamic stream config from MW EventStreamConfig API as Resolved.
Jan 25 2021, 7:01 PM · Patch-For-Review, Event-Platform, Analytics-Kanban, Analytics
fdans closed T267356: [Data quality stats] Add dsaez to receive traffic anomaly alarms, a subtask of T267355: Traffic anomaly alarms, as Resolved.
Jan 25 2021, 7:01 PM · Analytics-Kanban, Analytics