fdans (Francisco Dans)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Dec 12 2016, 8:49 PM (104 w, 23 h)
Availability
Available
LDAP User
Unknown
MediaWiki User
FDans (WMF) [ Global Accounts ]

Recent Activity

Today

Nemo_bis awarded T205665: Make wikistats UI family aware: you should be able to select a family in drop down menu and request available metrics for it a Doubloon token.
Tue, Dec 11, 2:24 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats, Analytics

Yesterday

fdans moved T209929: Decommission old Hadoop worker nodes and add newer ones from Incoming to Operational Excellence on the Analytics board.
Mon, Dec 10, 5:09 PM · Patch-For-Review, User-Elukey, Analytics-Kanban, Analytics
fdans closed T210465: Refinery Spark HiveExtensions schema merge should support merging of arrays with struct elements as Resolved.
Mon, Dec 10, 5:08 PM · Analytics-Kanban, Services (done), Patch-For-Review, Analytics
fdans moved T211095: Grant fdans permissions to deploy AQS in prod, and accessing the aqs hosts from Operational Excellence to Radar on the Analytics board.
Mon, Dec 10, 5:08 PM · Patch-For-Review, Operations, SRE-Access-Requests, Analytics
fdans moved T211095: Grant fdans permissions to deploy AQS in prod, and accessing the aqs hosts from Incoming to Operational Excellence on the Analytics board.
Mon, Dec 10, 5:07 PM · Patch-For-Review, Operations, SRE-Access-Requests, Analytics
fdans moved T211247: Modern Event Platform: Stream Intake Service: Implementation: Deployment Pipeline from Incoming to Modern Event Platform on the Analytics board.
Mon, Dec 10, 5:07 PM · Core Platform Team Backlog (Watching / External), Services (watching), Analytics-EventLogging, EventBus, Analytics
fdans raised the priority of T211330: cron job rsyncing dumps webserver logs to stat1005 is broken from Normal to High.
Mon, Dec 10, 5:06 PM · Analytics-Kanban, Patch-For-Review, Analytics, Datasets-General-or-Unknown
fdans moved T211330: cron job rsyncing dumps webserver logs to stat1005 is broken from Incoming to Operational Excellence on the Analytics board.
Mon, Dec 10, 5:06 PM · Analytics-Kanban, Patch-For-Review, Analytics, Datasets-General-or-Unknown
fdans moved T211359: POC More efficient Bot filtering on pageview data from Incoming to Bots on the Analytics board.
Mon, Dec 10, 5:06 PM · Analytics-Kanban, Research, Analytics
fdans assigned T211359: POC More efficient Bot filtering on pageview data to Nuria.
Mon, Dec 10, 5:05 PM · Analytics-Kanban, Research, Analytics
fdans triaged T211036: Give access to Superset to Pau as Normal priority.
Mon, Dec 10, 5:02 PM · Analytics
fdans added a comment to T211036: Give access to Superset to Pau.

@Pginer-WMF can you check whether you have access now? https://superset.wikimedia.org/

Mon, Dec 10, 5:01 PM · Analytics
fdans renamed T211036: Give access to Superset to Pau from Give access to Turnilo to Pau to Give access to Superset to Pau.
Mon, Dec 10, 5:00 PM · Analytics
fdans updated subscribers of T211069: Decide whether we will include raw features.
Mon, Dec 10, 4:58 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
fdans moved T211069: Decide whether we will include raw features from Incoming to Radar on the Analytics board.
Mon, Dec 10, 4:57 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
fdans added a comment to T211069: Decide whether we will include raw features.

Sounds ok to us!

Mon, Dec 10, 4:55 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
fdans triaged T211077: Investigate referrer class change on Chrome Mobile from September 13, 2018 as Normal priority.
Mon, Dec 10, 4:53 PM · Analytics, Product-Analytics
fdans assigned T211077: Investigate referrer class change on Chrome Mobile from September 13, 2018 to Nuria.
Mon, Dec 10, 4:52 PM · Analytics, Product-Analytics
fdans triaged T211173: "Edit" equivalent of pageviews daily available to use in Turnilo and Superset as High priority.
Mon, Dec 10, 4:52 PM · Analytics
fdans added a comment to T211173: "Edit" equivalent of pageviews daily available to use in Turnilo and Superset.

We'll be working on this on Q3 2019. This is easier to achieve if you don't need article title.

Mon, Dec 10, 4:52 PM · Analytics
fdans merged T211535: Comments missing in mediawiki_history table into T209031: Not able to scoop comment table in labs for mediawiki reconstruction process.
Mon, Dec 10, 4:47 PM · Core Platform Team Backlog (Watching / External), Analytics-Kanban, DBA, Data-Services, Analytics
fdans merged task T211535: Comments missing in mediawiki_history table into T209031: Not able to scoop comment table in labs for mediawiki reconstruction process.
Mon, Dec 10, 4:46 PM · Analytics
fdans triaged T211605: Upgrade Superset to 0.28.1 as High priority.
Mon, Dec 10, 4:43 PM · Analytics-Kanban, Analytics
fdans added a project to T211609: Create Office Hours for Team Analytics: Analytics-Kanban.
Mon, Dec 10, 4:42 PM · Analytics-Kanban, Analytics
fdans created T211605: Upgrade Superset to 0.28.1.
Mon, Dec 10, 3:41 PM · Analytics-Kanban, Analytics
fdans added a comment to T210687: Bug: can't make a YoY time series chart in Superset.

After digging a lil bit, I'm pretty sure this issue was fixed with this change:

Mon, Dec 10, 3:05 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans moved T205665: Make wikistats UI family aware: you should be able to select a family in drop down menu and request available metrics for it from In Progress to In Code Review on the Analytics-Kanban board.
Mon, Dec 10, 2:43 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats, Analytics
fdans moved T210422: Link to User Contribution page in wikistats UI rather than user page from Next Up to In Code Review on the Analytics-Kanban board.
Mon, Dec 10, 2:41 PM · Analytics-Kanban, Analytics
fdans moved T210687: Bug: can't make a YoY time series chart in Superset from Next Up to In Progress on the Analytics-Kanban board.
Mon, Dec 10, 2:41 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans moved T210424: Wikistats2 UX bug: table option should not be available in table graph selected from Next Up to In Code Review on the Analytics-Kanban board.
Mon, Dec 10, 2:41 PM · Patch-For-Review, Analytics-Kanban, Analytics

Tue, Dec 4

fdans created T211095: Grant fdans permissions to deploy AQS in prod, and accessing the aqs hosts.
Tue, Dec 4, 11:33 AM · Patch-For-Review, Operations, SRE-Access-Requests, Analytics

Mon, Dec 3

fdans moved T209969: Tracking blocks: Log direction actions from Incoming to Radar on the Analytics board.
Mon, Dec 3, 5:59 PM · Anti-Harassment, Analytics
fdans moved T210106: Provide a reusable getEditCountBucket function for analytics purposes from Incoming to Radar on the Analytics board.
Mon, Dec 3, 5:59 PM · Patch-For-Review, Analytics, Front-end-Standards-Group, Analytics-EventLogging, MediaWiki-extensions-WikimediaEvents, Readers-Web-Backlog
fdans moved T210667: Can exfat be used in WMF production? from Incoming to Radar on the Analytics board.
Mon, Dec 3, 5:58 PM · Security-Team, Analytics, Software-Licensing, WMF-Legal, Operations
fdans moved T210902: Piwik access for Isaac Johnson and Chelsy Xie from Incoming to Operational Excellence on the Analytics board.
Mon, Dec 3, 5:58 PM · Analytics, New-Readers
fdans added a comment to T210902: Piwik access for Isaac Johnson and Chelsy Xie.

If you have access to Turnilo you have access to piwik. Let us know otherwise.

Mon, Dec 3, 5:58 PM · Analytics, New-Readers
fdans closed T210902: Piwik access for Isaac Johnson and Chelsy Xie as Resolved.
Mon, Dec 3, 5:57 PM · Analytics, New-Readers
fdans closed T210902: Piwik access for Isaac Johnson and Chelsy Xie, a subtask of T210813: Analysis of short term impact of Mexico campaign to site and landing page traffic, as Resolved.
Mon, Dec 3, 5:57 PM · Product-Analytics, New-Readers
fdans lowered the priority of T210271: Migrate analytics/refinery/source release jobs to Docker from High to Normal.
Mon, Dec 3, 5:56 PM · Continuous-Integration-Infrastructure (Slipway), Analytics
fdans raised the priority of T210271: Migrate analytics/refinery/source release jobs to Docker from Normal to High.
Mon, Dec 3, 5:56 PM · Continuous-Integration-Infrastructure (Slipway), Analytics
fdans removed a project from T210271: Migrate analytics/refinery/source release jobs to Docker: Analytics-Cluster.
Mon, Dec 3, 5:56 PM · Continuous-Integration-Infrastructure (Slipway), Analytics
fdans moved T208361: Make schemas use required $schema property with absolute path (not absolute URL) to the schema from Incoming to Modern Event Platform on the Analytics board.
Mon, Dec 3, 5:55 PM · Analytics, Core Platform Team Backlog (Later), Services (later), Analytics-EventLogging, EventBus
fdans moved T193641: track number of editors from other Wikimedia projects who also edit on Wikidata over time from Incoming to Operational Excellence on the Analytics board.
Mon, Dec 3, 5:54 PM · Analytics-Kanban, Analytics, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, Wikidata
fdans assigned T193641: track number of editors from other Wikimedia projects who also edit on Wikidata over time to JAllemandou.
Mon, Dec 3, 5:54 PM · Analytics-Kanban, Analytics, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, Wikidata
fdans added a comment to T204965: Create report for "articles with most contributors" in Wikistats2.

We'll be creating a new top metric that will rank pages by the number of contributors instead of the number of edits.

Mon, Dec 3, 5:49 PM · Patch-For-Review, Analytics-Wikistats, Analytics-Kanban, Analytics
fdans moved T204965: Create report for "articles with most contributors" in Wikistats2 from Incoming to Wikistats Beta on the Analytics board.
Mon, Dec 3, 5:41 PM · Patch-For-Review, Analytics-Wikistats, Analytics-Kanban, Analytics
fdans moved T210693: Create materialized views on Wiki Replica hosts for better query performance from Incoming to Operational Excellence on the Analytics board.
Mon, Dec 3, 5:40 PM · Patch-For-Review, User-Banyek, Core Platform Team Backlog (Watching / External), Analytics-Kanban, DBA, Data-Services, Analytics
fdans raised the priority of T211000: Failure while refining webrequest upload 2018-12-01-14 from High to Unbreak Now!.
Mon, Dec 3, 5:38 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T211000: Failure while refining webrequest upload 2018-12-01-14 from Incoming to Operational Excellence on the Analytics board.
Mon, Dec 3, 5:38 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T210478: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] from Incoming to Radar on the Analytics board.
Mon, Dec 3, 5:37 PM · User-Banyek, Analytics-Kanban, DBA, Analytics
fdans moved T210522: Refactor Sqoop, join actor and comment from analytics replicas from Incoming to Smart Tools for Better Data on the Analytics board.
Mon, Dec 3, 5:36 PM · Analytics-Kanban, Analytics
fdans moved T210541: Update sqoop to work with the new schema from Incoming to Smart Tools for Better Data on the Analytics board.
Mon, Dec 3, 5:36 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T210542: Update datasets definitions and oozie jobs for dual-sqoop of comments and actors from Incoming to Smart Tools for Better Data on the Analytics board.
Mon, Dec 3, 5:36 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T210543: Update refinery-source jobs to join labsdb with actor and comment from Incoming to Smart Tools for Better Data on the Analytics board.
Mon, Dec 3, 5:36 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans triaged T147346: Please delete ChangesListFilters events from before 2016-09-22 as Low priority.
Mon, Dec 3, 5:35 PM · Analytics, Analytics-EventLogging
fdans added a comment to T147346: Please delete ChangesListFilters events from before 2016-09-22.

If you want to remove event data for a particular time range, the data needs to be removed manually from hive and mysql. If what we want is for this data to be purged 90 days after its collection, the fields need to be removed from this whitelist:

Mon, Dec 3, 5:35 PM · Analytics, Analytics-EventLogging
fdans moved T210484: Only serve debug HTTP headers when x-wikimedia-debug is present from Incoming to Radar on the Analytics board.
Mon, Dec 3, 5:30 PM · Operations, Analytics, Traffic, Performance-Team
fdans added a comment to T210484: Only serve debug HTTP headers when x-wikimedia-debug is present.

Analytics needs x-analytics in every request, not only in debugging ones but we don't need to include it in the response headers. We don't know if downstream that header is needed.

Mon, Dec 3, 5:30 PM · Operations, Analytics, Traffic, Performance-Team
fdans triaged T210570: Dashiki should filter out empty newlines as Normal priority.
Mon, Dec 3, 5:21 PM · Patch-For-Review, Analytics, Analytics-Kanban, Analytics-Dashiki
fdans moved T210687: Bug: can't make a YoY time series chart in Superset from Incoming to Radar on the Analytics board.
Mon, Dec 3, 5:20 PM · Analytics-Kanban, Product-Analytics, Analytics
fdans moved T210702: Verify that EventStreams work with WikiBase MediaInfo from Incoming to Radar on the Analytics board.
Mon, Dec 3, 5:18 PM · Analytics, Wikimedia-Stream, SDC General
fdans assigned T210759: Refine Monitor should be a systemd timer such if process cannot start we get notified to mforns.
Mon, Dec 3, 5:16 PM · Analytics
fdans triaged T210759: Refine Monitor should be a systemd timer such if process cannot start we get notified as High priority.
Mon, Dec 3, 5:16 PM · Analytics
fdans moved T210844: Generate article recommendations in Hadoop for use in production from Incoming to Radar on the Analytics board.
Mon, Dec 3, 5:15 PM · Research, Analytics
fdans triaged T211030: Use virtual image views to filter mediacounts as Normal priority.
Mon, Dec 3, 5:13 PM · Analytics
fdans updated subscribers of T205458: Remove sessionId, pageId pairs from whitelist .

@HaeB quick ping on this so that it doesn't get buried :)

Mon, Dec 3, 12:16 PM · Analytics-Kanban, Analytics
fdans moved T209822: Add new wikis to analytics from Next Up to In Code Review on the Analytics-Kanban board.
Mon, Dec 3, 12:15 PM · Patch-For-Review, Analytics-Kanban, Analytics

Thu, Nov 29

fdans moved T167539: Final steps to expose project family unique devices data from In Progress to In Code Review on the Analytics-Kanban board.
Thu, Nov 29, 5:02 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T209711: Set up CI system on AQS from In Progress to In Code Review on the Analytics-Kanban board.
Thu, Nov 29, 5:02 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T164201: AQS unique devices api should report offset/underestimate separately from In Progress to In Code Review on the Analytics-Kanban board.
Thu, Nov 29, 5:02 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans updated subscribers of T209711: Set up CI system on AQS.

Helloo @hashar do you think you can hook aqs to Jenkins for CI? We just need to run npm test.

Thu, Nov 29, 5:00 PM · Patch-For-Review, Analytics-Kanban, Analytics

Mon, Nov 26

fdans added a subtask for T210306: Feedback on Wikistats 2 new edits pages: T210425: Wikistats2 metric: top edited pages by number of editors .
Mon, Nov 26, 5:59 PM · Analytics, Internet-Archive, Analytics-Wikistats
fdans added a parent task for T210425: Wikistats2 metric: top edited pages by number of editors : T210306: Feedback on Wikistats 2 new edits pages.
Mon, Nov 26, 5:59 PM · Analytics
fdans added a subtask for T210306: Feedback on Wikistats 2 new edits pages: T210424: Wikistats2 UX bug: table option should not be available in table graph selected.
Mon, Nov 26, 5:51 PM · Analytics, Internet-Archive, Analytics-Wikistats
fdans added a parent task for T210424: Wikistats2 UX bug: table option should not be available in table graph selected: T210306: Feedback on Wikistats 2 new edits pages.
Mon, Nov 26, 5:51 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans added a subtask for T210306: Feedback on Wikistats 2 new edits pages: T210423: Wikistats2 metric: top article creators.
Mon, Nov 26, 5:48 PM · Analytics, Internet-Archive, Analytics-Wikistats
fdans added a parent task for T210423: Wikistats2 metric: top article creators: T210306: Feedback on Wikistats 2 new edits pages.
Mon, Nov 26, 5:48 PM · Analytics
fdans added a subtask for T210306: Feedback on Wikistats 2 new edits pages: T210422: Link to User Contribution page in wikistats UI rather than user page.
Mon, Nov 26, 5:46 PM · Analytics, Internet-Archive, Analytics-Wikistats
fdans added a parent task for T210422: Link to User Contribution page in wikistats UI rather than user page: T210306: Feedback on Wikistats 2 new edits pages.
Mon, Nov 26, 5:46 PM · Analytics-Kanban, Analytics

Mon, Nov 19

fdans removed a project from T168103: heirloom-mailx fails trying to send out email from SWAP notebook: Analytics-Kanban.
Mon, Nov 19, 5:47 PM · Analytics-SWAP, Analytics
fdans moved T209179: Update log_namespace, page_namespace from bigint to int from Next Up to In Code Review on the Analytics-Kanban board.
Mon, Nov 19, 5:42 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans raised the priority of T209404: Check abnormal pageviews for some pages on itwiki from Low to Normal.
Mon, Nov 19, 5:41 PM · Analytics, Tool-Pageviews, MediaWiki-General-or-Unknown
fdans triaged T209404: Check abnormal pageviews for some pages on itwiki as Low priority.
Mon, Nov 19, 5:41 PM · Analytics, Tool-Pageviews, MediaWiki-General-or-Unknown
fdans removed a project from T209404: Check abnormal pageviews for some pages on itwiki: Analytics-Kanban.
Mon, Nov 19, 5:41 PM · Analytics, Tool-Pageviews, MediaWiki-General-or-Unknown
fdans added a project to T209404: Check abnormal pageviews for some pages on itwiki: Analytics.
Mon, Nov 19, 5:40 PM · Analytics, Tool-Pageviews, MediaWiki-General-or-Unknown
fdans added a comment to T209404: Check abnormal pageviews for some pages on itwiki.

We see this pattern of traffic often and it usually comes from bots. We'll investigate this further as part of our bot ID efforts.

Mon, Nov 19, 5:40 PM · Analytics, Tool-Pageviews, MediaWiki-General-or-Unknown
fdans moved T164201: AQS unique devices api should report offset/underestimate separately from Next Up to In Progress on the Analytics-Kanban board.
Mon, Nov 19, 5:37 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans claimed T164201: AQS unique devices api should report offset/underestimate separately .
Mon, Nov 19, 5:37 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T209711: Set up CI system on AQS from Next Up to In Progress on the Analytics-Kanban board.
Mon, Nov 19, 5:36 PM · Patch-For-Review, Analytics-Kanban, Analytics
fdans moved T188041: Generate pagecounts-ez data back to 2008 from Next Up to Paused on the Analytics-Kanban board.
Mon, Nov 19, 5:36 PM · Analytics-Kanban, Analytics
fdans moved T209808: Upgrade Matomo to 3.6.1 or 3.7.0 from Incoming to Operational Excellence on the Analytics board.
Mon, Nov 19, 5:28 PM · Analytics-Kanban, Analytics
fdans added a comment to T206883: mediawiki_history datasets have null user_text for IP edits.

We won't be making any changes in mediawiki history in the near term since we're redefining the way we sqoop data.

Mon, Nov 19, 5:28 PM · Product-Analytics, Analytics-Data-Quality, Analytics
fdans moved T206883: mediawiki_history datasets have null user_text for IP edits from Incoming to Blocked on the Analytics board.
Mon, Nov 19, 5:26 PM · Product-Analytics, Analytics-Data-Quality, Analytics
fdans moved T209620: rack/setup/install dbstore100[3-5].eqiad.wmnet from Incoming to Operational Excellence on the Analytics board.
Mon, Nov 19, 5:21 PM · User-Elukey, Analytics, Operations
fdans lowered the priority of T209635: Update EventLogging kafkacat examples to use jumbo from High to Normal.
Mon, Nov 19, 5:21 PM · Analytics-Kanban, Analytics
fdans triaged T209536: Hive query fails with local join as High priority.
Mon, Nov 19, 5:19 PM · Patch-For-Review, Product-Analytics, Analytics-Kanban, Analytics
fdans moved T209611: [Epic] Make ORES scores available in Hadoop and as a dump from Geowiki to Radar on the Analytics board.
Mon, Nov 19, 5:19 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
fdans raised the priority of T209611: [Epic] Make ORES scores available in Hadoop and as a dump from Normal to Needs Triage.
Mon, Nov 19, 5:19 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
fdans triaged T209611: [Epic] Make ORES scores available in Hadoop and as a dump as Normal priority.
Mon, Nov 19, 5:19 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
fdans lowered the priority of T209655: Copy Wikidata dumps to HDFs from Normal to Low.
Mon, Nov 19, 5:18 PM · Wikidata, Research, Analytics