Page MenuHomePhabricator

[investigation] Template usage metrics for BreakingNews iteration and signal quality (timebox ~ 10 day(s))
Closed, ResolvedPublic21 Estimated Story Points

Description

As we develop the feature we must understand the parts of the whole and iterate on those parts.

The BreakingNews signal has an important dependency on templates. How and when templates are used by editors on new articles affects the latency and accuracy (both KPIs) of the results our signal will produce. In order to more correctly understand how changes in the usage of templates can affect results, we must analyze (and potentially create) data on their usage.

This ticket may demand collaboration with product analytics.

Open Questions

Each parent question below is rephrased as a child question to add clarification. Here, templates means the template that are included in the BN POC —

  • How many articles per day take each or more than one of the templates we use?
    • Per template, on how many discreet articles do they appear per day?
    • What are those articles?
  • How many new articles per day take each or more than one of the templates we use?
    • Per template, on how many new discreet articles do they appear per day?
    • What are those articles?
  • How much average time (in minutes) has elapsed between the creation of a new article and the adding of the template?
    • How long does it take each template to be added to an article?
  • How much average time (in minutes) has elapsed between the template being adding and being removed?
    • How long does a template spend on an article?

Useful links

Acceptance Criteria

  • Francisco to add a sample spreadsheet after working with someone from Engineering
  • What data needs to be collected to answer the questions above?
  • How are we going to store that data and make it available for BI tool?
  • TO BE EXPLORED WITH TEAM -- dashboard/spreadsheet/database]
xdatadatadatadatadatadata
data
data
data

TO DO

DONE

  • Francisco & Prabhat to talk with Prod Analytics to see what is needed
    • What do we log this data already?
    • Where is it?
    • Can we create what does not exist?

Event Timeline

HShaikh renamed this task from [STUB] Investigation: Template usage metrics for BreakingNews iteration and signal quality to Investigation: Template usage metrics for BreakingNews iteration and signal quality.Mar 1 2023, 2:40 PM
HShaikh triaged this task as Medium priority.
HShaikh updated the task description. (Show Details)
HShaikh updated the task description. (Show Details)
Protsack.stephan renamed this task from Investigation: Template usage metrics for BreakingNews iteration and signal quality to [investigation] Template usage metrics for BreakingNews iteration and signal quality.Mar 9 2023, 10:29 AM
HShaikh renamed this task from [investigation] Template usage metrics for BreakingNews iteration and signal quality to [investigation] Template usage metrics for BreakingNews iteration and signal quality (timebox ~ day(s)) .Mar 9 2023, 2:26 PM
FNavas-foundation renamed this task from [investigation] Template usage metrics for BreakingNews iteration and signal quality (timebox ~ day(s)) to [investigation] Template usage metrics for BreakingNews iteration and signal quality.Mar 9 2023, 2:26 PM
HShaikh renamed this task from [investigation] Template usage metrics for BreakingNews iteration and signal quality to [investigation] Template usage metrics for BreakingNews iteration and signal quality (timebox ~ day(s)) .Mar 9 2023, 2:29 PM
FNavas-foundation renamed this task from [investigation] Template usage metrics for BreakingNews iteration and signal quality (timebox ~ day(s)) to [investigation] Template usage metrics for BreakingNews iteration and signal quality.Mar 9 2023, 2:30 PM
FNavas-foundation updated the task description. (Show Details)
HShaikh renamed this task from [investigation] Template usage metrics for BreakingNews iteration and signal quality to [investigation] Template usage metrics for BreakingNews iteration and signal quality (timebox ~ 10 day(s)) .Mar 9 2023, 2:59 PM
Felixejofre reassigned this task from Tim.abdullin to prabhat.
Felixejofre set the point value for this task to 21.
Felixejofre added a subscriber: Tim.abdullin.