Page MenuHomePhabricator

Investigate banner event logging problems
Closed, ResolvedPublic2 Estimated Story Points

Description

Using event logging from banners might not work correctly. Events seem to be logged at a very low rate, if at all. We dropped the enum definition for banner action in the schema (see schema diff) to fix mobile banner expansion tracking, but this seems to have worsened the situation.

For desktop-de-18, we introduced a mini banner. Logging expansion and close events of that produced some data. Manually testing with a banner that sets the logging rate to 100% seems to also be working.

Logged events of Schema:WMDEBannerEvents in 2019 grouped by banner action and schema revision

banneractionRev. 18437830Rev. 19608660
application-of-funds-shown10374442752
banner-closed570256
mobile-mini-banner-expanded190
mini-banner-closed¹040087
mini-banner-expanded¹0135

¹) data collected only during desktop-de-18

The number of logged events including viewport size data differs from the logged events of closed banners, while it should actually be the same.

0: jdbc:hive2://an-coord1001.eqiad.wmnet:1000> select count(*) from wmdebannersizeissue where event.bannerName like "vtc%" and year = 2019;
_c0
511989
1 row selected (112.252 seconds)
0: jdbc:hive2://an-coord1001.eqiad.wmnet:1000> select count(*) from wmdebannerevents where event.bannerAction = "banner-closed" and year = 2019;
_c0
57031
1 row selected (78.22 seconds)

Acceptance Criteria

  • All events are manually triggered in banners while the Logstash is being monitored for possible errors that keep events from actually being logged.
  • We know what events are affected and what errors are produced when triggering the event.

Notes
Examples of banners from last year:

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
kai.nissen renamed this task from Investigate banner event logging to Investigate banner event logging problems.Jan 24 2020, 7:10 PM
kai.nissen moved this task from Backlog to Ready for estimation on the WMDE-Fundraising-Tech board.
kai.nissen set the point value for this task to 3.

The following events can be triggered in the fundraising banners:

  • clicking the close button (also logs the viewport dimensions)
  • clicking the close button of the "mini banner" for mobile devices
  • submitting the form (also logs the viewport dimensions)
  • preventing the display of the banner due to a "banner size issue" (also logs the viewport dimensions)
  • expanding the banner for mobile devices
  • clicking the link "Wohin geht meine Spenden?"

All viewport dimensions events are sent through the wmdebannersizeissue schema.

This includes events when the banner isn't shown due to size and events that happen on every page load. This means that the wmdebannersizeissue gets pinged on every banner load (depending on ratio) which is probably the reason there are so many of them compared to the close events.

I guess, you are referring to

The number of logged events including viewport size data differs from the logged events of closed banners, while it should actually be the same.

We (mis)use the banner size issue event schema for logging viewport sizes when closing the banner. The banner name is prefixed by "vtc-" in these cases. The query above is filtered by this prefix (where event.bannerName like "vtc%"). As far as I remember, the viewport sizes are logged with a rate of 1 (100%), if a close button click event is triggered. That means, that the numbers returned by the query should be the same.

Today I fired each event in each banner so the hive tables should have them soon.

Here are the events that are missing in the new banners:

  • Mobile and Tablet banners: clicking the link "Wohin geht meine Spenden?"
  • All Banners: submitting the form (also logs the viewport dimensions)
AbbanWMDE moved this task from Doing to Review on the WMDE-FUN-Sprint-2020-06-22 board.
AbbanWMDE subscribed.
kai.nissen changed the point value for this task from 3 to 2.