@Niharika Do let us know if you want the data from templatewizard to appear on druid (so it will available for fast access from superset) , we just need to enable a cron to do importing of data.
Sun, May 19
Also, ping @Harej so he sees my last comment, Analytics will be working on better image stats next year and we will have an API endpoint for image viewed similar to the one that now exists for pageviewAPi
@Ian_Furst the foundation does not have any data on video plays at this time, Analytics will be revamping mediacounts in the upcoming year and that will give us more precise image stats, video play data however it is not instrumented at all.
Sat, May 18
Fri, May 17
Idea looks fine but I do not think it I do not think it will be wise to change naming at this stage.
I think we also need to take into account reports that reda data from mediawiki_* tables, that is, data coming now from eventbus events. Some important dashboards are on top of this data, like the ones done for page creations for ACTRIAL in enwiki.
I think for the end user (QA and devs) having files per schema is a lot easier
I think kafkatee will be more solid than our current mysql in beta which hands up frequently. We would just need to make sure to update our logpuller so disk does not get full and files do not live long, we probably do not need more than a week worth of files if at all.
Thu, May 16
How about https://www.npmjs.com/package/kafka-sse? or Even just making the mysql path optional in puppet?
MediaWikiPingback is definitely used , let's verify that FlowReplies is also used.
Wed, May 15
Events_sanitized will be filled by sanitization process running in the next couple days (sanitization is run twice, the second time 45 days after data was ingested)
Data is on event database now:
Please @MNeisler and @Neil_P._Quinn_WMF take a look at docs and update as needed: https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Edits/Edit_hourly
Tue, May 14
The "rectangular" spikes on graph are the backfill processes: https://grafana.wikimedia.org/d/000000505/eventlogging?orgId=1&from=1557702014918&to=1557874514918&var-datasource=eqiad%20prometheus%2Fops&var-topic=All
Ok, you must have some permits missing, will check tomorrow if you are in the right ldap-nda authorized group.
While we have an outage for superset for EU time tomorrow, it should work now. Can you open an incognito tag and try to log in again?
Please try again, we have a patch upstream that shoudl resolve this issue, in the meantime I have added you as a user manually.
Fixed with 2019-04 snapshot, closing. Thanks for reporting.