As we develop the feature we must understand the parts of the whole and iterate on those parts.
The BreakingNews signal has an important dependency on templates. How and when templates are used by editors on new articles affects the latency and accuracy (both KPIs) of the results our signal will produce. In order to more correctly understand how changes in the usage of templates can affect results, we must analyze (and potentially create) data on their usage.
This ticket may demand collaboration with product analytics.
Open Questions
Each parent question below is rephrased as a child question to add clarification. Here, templates means the template that are included in the BN POC —
- How many articles per day take each or more than one of the templates we use?
- Per template, on how many discreet articles do they appear per day?
- What are those articles?
- How many new articles per day take each or more than one of the templates we use?
- Per template, on how many new discreet articles do they appear per day?
- What are those articles?
- How much average time (in minutes) has elapsed between the creation of a new article and the adding of the template?
- How long does it take each template to be added to an article?
- How much average time (in minutes) has elapsed between the template being adding and being removed?
- How long does a template spend on an article?
Useful links
- This tool shows only current uses of a template
- This tool keeps data of template usage for a month
- Possibility to use data from dumps via: quarry
- What links here
- Edit type PoC that can help but needs to be productionised and worked with Isaac
Acceptance Criteria
- Francisco to add a sample spreadsheet after working with someone from Engineering
- What data needs to be collected to answer the questions above?
- How are we going to store that data and make it available for BI tool?
- TO BE EXPLORED WITH TEAM -- dashboard/spreadsheet/database]
x | data | data | data | data | data | data | ||||||
data | ||||||||||||
data | ||||||||||||
data | ||||||||||||
TO DO
DONE
- Francisco & Prabhat to talk with Prod Analytics to see what is needed
- What do we log this data already?
- Where is it?
- Can we create what does not exist?