Page MenuHomePhabricator

Bug: Cassandra Unique Devices not loading Wikifunctions mobile data
Open, Needs TriagePublic

Description

We noticed this playing with data: https://stats.wikimedia.org/#/wikifunctions.org/reading/unique-devices/normal|line|2-year|(access-site)~mobile-site|monthly

Mobile site data for Wikifunctions is not available, but it's available for other projects. And it's there in Druid: https://w.wiki/Ahw5. Since Wikistats uses Cassandra for the mobile data, I figure the problem must be in the way we handle domains as part of the load code:

https://gerrit.wikimedia.org/r/plugins/gitiles/analytics/refinery/+/refs/heads/master/hql/cassandra/monthly/load_cassandra_unique_devices_monthly.hql#41

And indeed we just load the domain with no manipulation in the druid load:

https://gerrit.wikimedia.org/r/plugins/gitiles/analytics/refinery/+/refs/heads/master/hql/druid_load/generate_druid_unique_devices_per_domain_monthly.hql#31

So this all makes sense, but there's some kind of bug.