Page MenuHomePhabricator

fdans (Francisco Dans)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Dec 12 2016, 8:49 PM (140 w, 6 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
FDans (WMF) [ Global Accounts ]

Recent Activity

Thu, Aug 22

fdans moved T230772: Piwik JS isn't cached from Incoming to Operational Excellence on the Analytics board.
Thu, Aug 22, 5:29 PM · Traffic, Operations, Performance-Team, Analytics-Wikistats, Analytics
fdans reassigned T230772: Piwik JS isn't cached from elukey to Nuria.
Thu, Aug 22, 5:29 PM · Traffic, Operations, Performance-Team, Analytics-Wikistats, Analytics
fdans reassigned T230772: Piwik JS isn't cached from Nuria to elukey.
Thu, Aug 22, 5:27 PM · Traffic, Operations, Performance-Team, Analytics-Wikistats, Analytics
fdans moved T230642: Publish aggregated reading time dataset from Incoming to Radar on the Analytics board.
Thu, Aug 22, 5:26 PM · Analytics, Reading Depth
fdans moved T230741: Apply hive2-server fix to command line from Incoming to Ops Week on the Analytics board.
Thu, Aug 22, 5:25 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans assigned T230742: Ensure Wikitech page about custom jupyter notebooks exists and is up to date to JAllemandou.
Thu, Aug 22, 5:20 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans triaged T230742: Ensure Wikitech page about custom jupyter notebooks exists and is up to date as Normal priority.
Thu, Aug 22, 5:20 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans moved T230742: Ensure Wikitech page about custom jupyter notebooks exists and is up to date from Operational Excellence to Ops Week on the Analytics board.
Thu, Aug 22, 5:19 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans moved T230742: Ensure Wikitech page about custom jupyter notebooks exists and is up to date from Incoming to Operational Excellence on the Analytics board.
Thu, Aug 22, 5:19 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans edited projects for T230743: Create a repository and user for Product Analytics Oozie jobs?, added: Release-Engineering-Team; removed Analytics.

Tagging Release Engineering to create the repo.

Thu, Aug 22, 5:16 PM · Release-Engineering-Team, Product-Analytics
fdans triaged T230915: Import of MediaWiki tables into the Data Lakes mangles usernames as Normal priority.
Thu, Aug 22, 5:12 PM · Analytics-Data-Quality, Analytics
fdans moved T230915: Import of MediaWiki tables into the Data Lakes mangles usernames from Incoming to Data Quality on the Analytics board.
Thu, Aug 22, 5:12 PM · Analytics-Data-Quality, Analytics
fdans moved T230963: Turnilo: Remove count metric for edit_hourly data cube from Incoming to Ops Week on the Analytics board.
Thu, Aug 22, 5:11 PM · Analytics
fdans added a comment to T230963: Turnilo: Remove count metric for edit_hourly data cube.

Let's try to remove this changing Turnilo's configuration.

Thu, Aug 22, 5:11 PM · Analytics
fdans triaged T231002: Refactor quenename into HQL hive2 action oozie jobs as High priority.
Thu, Aug 22, 5:07 PM · Patch-For-Review, Analytics
fdans moved T231002: Refactor quenename into HQL hive2 action oozie jobs from Radar to Operational Excellence on the Analytics board.
Thu, Aug 22, 5:07 PM · Patch-For-Review, Analytics
fdans moved T231002: Refactor quenename into HQL hive2 action oozie jobs from Incoming to Radar on the Analytics board.
Thu, Aug 22, 5:06 PM · Patch-For-Review, Analytics
fdans triaged T231017: Geoeditors_private deletion scripts scheduled day conflicts with retention period as High priority.
Thu, Aug 22, 5:04 PM · Analytics
fdans moved T231017: Geoeditors_private deletion scripts scheduled day conflicts with retention period from Incoming to Ops Week on the Analytics board.
Thu, Aug 22, 5:04 PM · Analytics
fdans triaged T231021: Decommission analytics-tool1002 (old turnilo vm) as High priority.
Thu, Aug 22, 5:04 PM · vm-requests, Operations, Analytics
fdans moved T231021: Decommission analytics-tool1002 (old turnilo vm) from Incoming to Operational Excellence on the Analytics board.
Thu, Aug 22, 5:04 PM · vm-requests, Operations, Analytics
fdans triaged T231030: Change name and format of partition column in mediarequest table as High priority.
Thu, Aug 22, 5:03 PM · Analytics-Kanban, StructuredDataOnCommons, Analytics, Tool-Pageviews
fdans moved T231030: Change name and format of partition column in mediarequest table from Incoming to Analytics Query Service on the Analytics board.
Thu, Aug 22, 5:03 PM · Analytics-Kanban, StructuredDataOnCommons, Analytics, Tool-Pageviews
fdans added a comment to T222739: Move reportupdater queries from limn-* repositories to reportupdater-queries.

@Nuria just the removal of repositories, but since there's tasks open for each of them, I think we can mark this one as done?

Thu, Aug 22, 2:40 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans added a project to T228982: Deletion of limn-edit-data repository: Cleanup.
Thu, Aug 22, 2:39 PM · Cleanup, Editing-team, Analytics

Tue, Aug 20

fdans claimed T230514: Wikistats: month on dashboard changes on any redraw.
Tue, Aug 20, 10:29 AM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T230514: Wikistats: month on dashboard changes on any redraw from Done to In Code Review on the Analytics-Kanban board.
Tue, Aug 20, 10:29 AM · Patch-For-Review, Analytics-Kanban, Analytics

Tue, Aug 13

fdans merged task T225910: Add and backfill agent-type in mediacounts hive dataset into T229817: Create new mediarequests table.
Tue, Aug 13, 7:57 AM · Analytics-Kanban
fdans merged T225910: Add and backfill agent-type in mediacounts hive dataset into T229817: Create new mediarequests table.
Tue, Aug 13, 7:57 AM · Analytics-Kanban, StructuredDataOnCommons, Analytics, Tool-Pageviews
fdans moved T230312: Add literal transcoding to media file properties UDF from Next Up to Ready to Deploy on the Analytics-Kanban board.
Tue, Aug 13, 6:31 AM · Patch-For-Review, Analytics-Kanban, StructuredDataOnCommons, Analytics, Tool-Pageviews

Mon, Aug 12

fdans triaged T230312: Add literal transcoding to media file properties UDF as High priority.
Mon, Aug 12, 3:23 PM · Patch-For-Review, Analytics-Kanban, StructuredDataOnCommons, Analytics, Tool-Pageviews
fdans moved T230312: Add literal transcoding to media file properties UDF from Incoming to Analytics Query Service on the Analytics board.
Mon, Aug 12, 3:23 PM · Patch-For-Review, Analytics-Kanban, StructuredDataOnCommons, Analytics, Tool-Pageviews
fdans created T230312: Add literal transcoding to media file properties UDF .
Mon, Aug 12, 8:32 AM · Patch-For-Review, Analytics-Kanban, StructuredDataOnCommons, Analytics, Tool-Pageviews
fdans added a comment to T228982: Deletion of limn-edit-data repository.

@Neil_P._Quinn_WMF anything else you think should be saved here?

Mon, Aug 12, 5:51 AM · Cleanup, Editing-team, Analytics
fdans added a project to T228981: Deletion of limn-flow-data repository: Cleanup.

@EBernhardson thanks! Adding cleanup project tag since it's safe to proceed.

Mon, Aug 12, 5:48 AM · Cleanup, Analytics

Mon, Aug 5

fdans created T229817: Create new mediarequests table.
Mon, Aug 5, 1:35 PM · Analytics-Kanban, StructuredDataOnCommons, Analytics, Tool-Pageviews
fdans added a comment to T228975: Deletion of limn-language-data repository.

@Amire80 ping on this, as we are planning on starting to clean up repos this week.

Mon, Aug 5, 8:18 AM · Analytics

Mon, Jul 29

fdans moved T229111: Delete eventgate-ci repository from gerrit from Incoming to Radar on the Analytics board.
Mon, Jul 29, 3:35 PM · Release-Engineering-Team-TODO, Release-Engineering-Team (Development services), Repository-Admins, Gerrit, Analytics, EventBus
fdans moved T229042: Reading_depth: remove eventlogging instrumentation from Incoming to Radar on the Analytics board.
Mon, Jul 29, 3:35 PM · Readers-Web-Backlog (Readers-Web-Kanbanana-2019-20-Q1), Reading Depth, Product-Analytics, Analytics
fdans added a comment to T229042: Reading_depth: remove eventlogging instrumentation.

@Groceryheist storage is not the problem for us, but the amount of events that are coming through. This affect performance for the rest of EL users. We have no problem with it if this data is going to be used at some point soon, otherwise we can disable it and maybe enable it back in the future.

Mon, Jul 29, 3:33 PM · Readers-Web-Backlog (Readers-Web-Kanbanana-2019-20-Q1), Reading Depth, Product-Analytics, Analytics
fdans moved T229068: App requests classified as pageviews that probably should not be so from Incoming to Radar on the Analytics board.
Mon, Jul 29, 3:30 PM · Wikipedia-Android-App-Backlog (Android-app-release-v2.7.29x-N-Nanaimo-Bar), Android-app-Bugs, Analytics
fdans moved T229143: Access to HUE for Mayakpwiki from Operational Excellence to Ops Week on the Analytics board.
Mon, Jul 29, 3:29 PM · Operations, Analytics
fdans triaged T229143: Access to HUE for Mayakpwiki as High priority.
Mon, Jul 29, 3:29 PM · Operations, Analytics
fdans moved T229143: Access to HUE for Mayakpwiki from Incoming to Operational Excellence on the Analytics board.
Mon, Jul 29, 3:29 PM · Operations, Analytics
fdans added a comment to T229143: Access to HUE for Mayakpwiki.

@Mayakp.wiki just a comment on hue. It might not be the best tool for querying the data lake. We (as in the analytics team) prefer using either hive/beeline directly or jupyter notebooks.

Mon, Jul 29, 3:28 PM · Operations, Analytics
fdans moved T229233: DCausse: can't log into Superset from Incoming to Ops Week on the Analytics board.
Mon, Jul 29, 3:23 PM · Analytics
fdans assigned T229233: DCausse: can't log into Superset to Nuria.
Mon, Jul 29, 3:23 PM · Analytics
fdans added a comment to T226514: Map doesn't redraw when returning from table view.

I don't know why I put this in Wikistats Production but it most def should be in beta. Pretty urgent bug.

Mon, Jul 29, 1:51 PM · Analytics-Kanban, Analytics

Jul 25 2019

fdans moved T228768: Decommission dbproxy1004 and dbproxy1009 from Operational Excellence to Radar on the Analytics board.
Jul 25 2019, 4:48 PM · ops-eqiad, decommission, Operations, Analytics-EventLogging, Analytics
fdans moved T228768: Decommission dbproxy1004 and dbproxy1009 from Incoming to Operational Excellence on the Analytics board.
Jul 25 2019, 4:48 PM · ops-eqiad, decommission, Operations, Analytics-EventLogging, Analytics
fdans moved T229003: Roll restart all openjdk-8 jvms in Analytics from Incoming to Operational Excellence on the Analytics board.
Jul 25 2019, 4:47 PM · Analytics-Kanban, Analytics
fdans triaged T228747: Review all the oozie coordinators/bundles in Refinery to add alerting when missing as High priority.
Jul 25 2019, 4:47 PM · Analytics-Kanban, Analytics, Wikimedia-Portals
fdans moved T228747: Review all the oozie coordinators/bundles in Refinery to add alerting when missing from Incoming to Operational Excellence on the Analytics board.
Jul 25 2019, 4:47 PM · Analytics-Kanban, Analytics, Wikimedia-Portals
fdans triaged T228883: mediawiki-history-wikitext-coord job fails every month as Normal priority.
Jul 25 2019, 4:46 PM · Analytics
fdans moved T228883: mediawiki-history-wikitext-coord job fails every month from Incoming to Modern Event Platform on the Analytics board.
Jul 25 2019, 4:46 PM · Analytics
fdans closed T228931: wikistats editor graphs broken as Resolved.
Jul 25 2019, 4:45 PM · Analytics-Kanban, Analytics
fdans moved T215655: Generate edit totals by country by month/year from Blocked to Geowiki on the Analytics board.
Jul 25 2019, 4:45 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T215655: Generate edit totals by country by month/year from Geowiki to Blocked on the Analytics board.
Jul 25 2019, 4:45 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans claimed T228937: Add agent type split to wikistats pageviews .
Jul 25 2019, 4:44 PM · Analytics-Kanban, Analytics
fdans triaged T228937: Add agent type split to wikistats pageviews as High priority.
Jul 25 2019, 4:43 PM · Analytics-Kanban, Analytics
fdans moved T228937: Add agent type split to wikistats pageviews from Incoming to Wikistats Beta on the Analytics board.
Jul 25 2019, 4:43 PM · Analytics-Kanban, Analytics
fdans triaged T228975: Deletion of limn-language-data repository as High priority.
Jul 25 2019, 4:43 PM · Analytics
fdans triaged T228979: Deletion of limn-ee-data repository as High priority.
Jul 25 2019, 4:43 PM · Analytics
fdans triaged T228981: Deletion of limn-flow-data repository as High priority.
Jul 25 2019, 4:43 PM · Cleanup, Analytics
fdans triaged T228982: Deletion of limn-edit-data repository as High priority.
Jul 25 2019, 4:43 PM · Cleanup, Editing-team, Analytics
fdans moved T228975: Deletion of limn-language-data repository from Incoming to Operational Excellence on the Analytics board.
Jul 25 2019, 4:42 PM · Analytics
fdans moved T228979: Deletion of limn-ee-data repository from Incoming to Operational Excellence on the Analytics board.
Jul 25 2019, 4:42 PM · Analytics
fdans moved T228981: Deletion of limn-flow-data repository from Incoming to Operational Excellence on the Analytics board.
Jul 25 2019, 4:42 PM · Cleanup, Analytics
fdans moved T228982: Deletion of limn-edit-data repository from Incoming to Operational Excellence on the Analytics board.
Jul 25 2019, 4:42 PM · Cleanup, Editing-team, Analytics
fdans created T228982: Deletion of limn-edit-data repository.
Jul 25 2019, 10:41 AM · Cleanup, Editing-team, Analytics
fdans created T228981: Deletion of limn-flow-data repository.
Jul 25 2019, 10:38 AM · Cleanup, Analytics
fdans created T228979: Deletion of limn-ee-data repository.
Jul 25 2019, 10:32 AM · Analytics
fdans created T228975: Deletion of limn-language-data repository.
Jul 25 2019, 10:23 AM · Analytics
fdans added a comment to T228931: wikistats editor graphs broken.

Thank you for fixing this @Nuria

Jul 25 2019, 10:07 AM · Analytics-Kanban, Analytics

Jul 22 2019

fdans moved T226109: Write incident report for jobs not being executed on 1.34.0-wmf.10 from Incoming to Radar on the Analytics board.
Jul 22 2019, 4:06 PM · Core Platform Team Workboards (Clinic Duty Team), Analytics, EventBus, Operations, WMF-JobQueue, MassMessage
fdans moved T228533: Fix geoip updaters for new MaxMind hashed keys by 2019-08-15 from Incoming to Radar on the Analytics board.
Jul 22 2019, 4:05 PM · Analytics, Traffic, Operations
fdans moved T227496: Access to WikimediaFoundation.org analytics for Deb from Operational Excellence to Ops Week on the Analytics board.
Jul 22 2019, 4:05 PM · Operations, LDAP-Access-Requests, wikimediafoundation.org, Analytics
fdans moved T228620: Frequent/Long GC old gen collections for HDFS namenodes on an-master100[1,2] from Incoming to Operational Excellence on the Analytics board.
Jul 22 2019, 4:05 PM · Analytics-Kanban, Analytics
fdans triaged T227496: Access to WikimediaFoundation.org analytics for Deb as High priority.
Jul 22 2019, 4:05 PM · Operations, LDAP-Access-Requests, wikimediafoundation.org, Analytics
fdans assigned T227496: Access to WikimediaFoundation.org analytics for Deb to Nuria.
Jul 22 2019, 4:04 PM · Operations, LDAP-Access-Requests, wikimediafoundation.org, Analytics
fdans moved T227496: Access to WikimediaFoundation.org analytics for Deb from Incoming to Operational Excellence on the Analytics board.
Jul 22 2019, 4:04 PM · Operations, LDAP-Access-Requests, wikimediafoundation.org, Analytics
fdans triaged T228522: Better error message for refine monitor so it takes into account that backfilling might be happening as High priority.
Jul 22 2019, 4:03 PM · Analytics-Kanban, Analytics
fdans moved T228522: Better error message for refine monitor so it takes into account that backfilling might be happening from Incoming to Operational Excellence on the Analytics board.
Jul 22 2019, 4:03 PM · Analytics-Kanban, Analytics
fdans moved T228557: third party domain data is getting refined from Operational Excellence to Data Quality on the Analytics board.
Jul 22 2019, 4:01 PM · Analytics-Kanban, Analytics
fdans triaged T228557: third party domain data is getting refined as High priority.
Jul 22 2019, 4:01 PM · Analytics-Kanban, Analytics
fdans moved T228557: third party domain data is getting refined from Incoming to Operational Excellence on the Analytics board.
Jul 22 2019, 4:01 PM · Analytics-Kanban, Analytics
fdans added a comment to T210313: Statistics for views of individual Wikimedia images.

@MusikAnimal @Doc_James @Tgr the following are the endpoints we're planning to roll out from the webrequest-based data we have currently:

Jul 22 2019, 2:24 PM · Multimedia, Analytics, Tool-Pageviews

Jul 17 2019

fdans added a comment to T228151: The mediacounts dataset doesn't have a project dimension.

@Tgr agreed, we can definitely get the project from the referer, but the main value of this dataset is its historical aspect. We can't backfill project using referer further than the last 90 days (as it is purged with webrequest), so the period between 2014 and three months ago would still be without a project dimension.

Jul 17 2019, 7:19 AM · Analytics, Tool-Pageviews

Jul 16 2019

fdans renamed T225910: Add and backfill agent-type in mediacounts hive dataset from Add access-site and access-type to mediacounts job to Add and backfill agent-type in mediacounts hive dataset.
Jul 16 2019, 11:27 AM · Analytics-Kanban
fdans removed a subtask for T207208: Add mediacounts data to AQS and, from there, Restbase: T225911: Add new mediatypes to media classification refinery code.
Jul 16 2019, 11:23 AM · Services (watching), Analytics
fdans removed a parent task for T225911: Add new mediatypes to media classification refinery code: T207208: Add mediacounts data to AQS and, from there, Restbase.
Jul 16 2019, 11:23 AM · Analytics-Kanban, Analytics
fdans removed a subtask for T210313: Statistics for views of individual Wikimedia images: T228149: Load media requests data into cassandra (or druid?).
Jul 16 2019, 11:23 AM · Multimedia, Analytics, Tool-Pageviews
fdans removed a parent task for T228149: Load media requests data into cassandra (or druid?): T210313: Statistics for views of individual Wikimedia images.
Jul 16 2019, 11:23 AM · Analytics, Tool-Pageviews
fdans added a parent task for T228149: Load media requests data into cassandra (or druid?): T207208: Add mediacounts data to AQS and, from there, Restbase.
Jul 16 2019, 11:22 AM · Analytics, Tool-Pageviews
fdans added a subtask for T207208: Add mediacounts data to AQS and, from there, Restbase: T228149: Load media requests data into cassandra (or druid?).
Jul 16 2019, 11:22 AM · Services (watching), Analytics
fdans added a parent task for T225911: Add new mediatypes to media classification refinery code: T228149: Load media requests data into cassandra (or druid?).
Jul 16 2019, 11:22 AM · Analytics-Kanban, Analytics
fdans added a subtask for T228149: Load media requests data into cassandra (or druid?): T225911: Add new mediatypes to media classification refinery code.
Jul 16 2019, 11:22 AM · Analytics, Tool-Pageviews
fdans added a comment to T225910: Add and backfill agent-type in mediacounts hive dataset.

As discussed, since access site data doesn't include mobile web requests, it doesn't add value to include this field in the dataset, so we'll only be including agent type.

Jul 16 2019, 11:21 AM · Analytics-Kanban
fdans added a parent task for T225910: Add and backfill agent-type in mediacounts hive dataset: T228149: Load media requests data into cassandra (or druid?).
Jul 16 2019, 11:19 AM · Analytics-Kanban
fdans added a subtask for T228149: Load media requests data into cassandra (or druid?): T225910: Add and backfill agent-type in mediacounts hive dataset.
Jul 16 2019, 11:19 AM · Analytics, Tool-Pageviews