In the control condition (popupEnabled = 0), the Popups schema frequently generates a dwelledButAbandoned event together with a link opening event during the same link interaction, even though these should be mutually exclusive. These extraneous events happen often enough to affect data analysis, but don't seem to occur in the test condition. (Concretely: here we had about 1.07 events per interaction in the control group but close to 1 in the test group. And in a sample of 100 such events that were logged during the same link interaction as another one, in every case it turned out to be a dwelledButAbandoned event together with a link opening event - sometimes before, sometimes after; see data below.)
For the data analysis in T139319, it would be helpful if, even before fixing and deploying this, we could confirm the conjecture that it's the dwelledButAbandoned events that are spurious and the link open events that are real - i.e. that a link was clicked in each case. That would enable us to remove the spurious events retroactively and still arrive at valid conclusions.
Data:
SELECT dupetokenlist.event_linkInteractionToken AS token, event_action AS action, event_totalInteractionTime AS totalInteractionTime FROM (SELECT event_linkInteractionToken, COUNT(*) AS copies FROM log.Popups_15597282 WHERE wiki ='huwiki' AND event_isAnon = 1 AND event_popupEnabled = 0 AND timestamp LIKE '20160703%' AND event_linkInteractionToken IS NOT NULL GROUP BY event_linkInteractionToken HAVING copies>1) AS dupetokenlist JOIN (SELECT * FROM log.Popups_15597282 WHERE wiki ='huwiki' AND event_isAnon = 1 AND event_popupEnabled = 0 AND timestamp LIKE '20160703%' AND event_linkInteractionToken IS NOT NULL) AS allevents ON dupetokenlist.event_linkInteractionToken = allevents.event_linkInteractionToken ORDER BY token, totalInteractionTime LIMIT 100; +-------------------------------+---------------------+----------------------+ | token | action | totalInteractionTime | +-------------------------------+---------------------+----------------------+ | 0002b8eb971b49241467560002738 | dwelledButAbandoned | 344 | | 0002b8eb971b49241467560002738 | opened in same tab | 106081 | | 0011597228b58a8d1467567900673 | opened in new tab | 1327 | | 0011597228b58a8d1467567900673 | dwelledButAbandoned | 1741 | | 0027ff2084b0e8161467584455898 | opened in same tab | 122 | | 0027ff2084b0e8161467584455898 | dwelledButAbandoned | 1060 | | 0040b84139bbddd71467530011861 | opened in new tab | 172 | | 0040b84139bbddd71467530011861 | dwelledButAbandoned | 727 | | 00528ab4d5dc19071467580971197 | opened in same tab | 727 | | 00528ab4d5dc19071467580971197 | dwelledButAbandoned | 970 | | 005454fff10686c51467563014296 | opened in same tab | 580 | | 005454fff10686c51467563014296 | dwelledButAbandoned | 962 | | 00760eb22f0ac9ef1467535068375 | opened in new tab | 2724 | | 00760eb22f0ac9ef1467535068375 | dwelledButAbandoned | 2894 | | 00a31b38f1b220271467510064741 | opened in same tab | 198 | | 00a31b38f1b220271467510064741 | dwelledButAbandoned | 277 | | 00a753fe56c87a9f1467541889086 | dwelledButAbandoned | 4168 | | 00a753fe56c87a9f1467541889086 | opened in same tab | 8745 | | 00af45051944dc4b1467534006492 | opened in same tab | 139 | | 00af45051944dc4b1467534006492 | dwelledButAbandoned | 343 | | 00cae0cba58a96711467576069062 | opened in same tab | 951 | | 00cae0cba58a96711467576069062 | dwelledButAbandoned | 1185 | | 00d0bac32641eff91467542732890 | opened in same tab | 250 | | 00d0bac32641eff91467542732890 | dwelledButAbandoned | 406 | | 0109531b05d4d83b1467533661677 | opened in same tab | 140 | | 0109531b05d4d83b1467533661677 | dwelledButAbandoned | 361 | | 012fbfaaa2f85a1d1467538703297 | opened in same tab | 382 | | 012fbfaaa2f85a1d1467538703297 | dwelledButAbandoned | 450 | | 0135d18ce3a7114f1467577154736 | opened in new tab | 556 | | 0135d18ce3a7114f1467577154736 | dwelledButAbandoned | 610 | | 0138680825976b7f1467559316335 | opened in same tab | 248 | | 0138680825976b7f1467559316335 | dwelledButAbandoned | 514 | | 013c5e93312e0c331467574179384 | opened in new tab | 1618 | | 013c5e93312e0c331467574179384 | dwelledButAbandoned | 1737 | | 013e93403e6a8dbe1467575034829 | opened in new tab | 800 | | 013e93403e6a8dbe1467575034829 | dwelledButAbandoned | 1340 | | 01550f5737b7b1c91467553566415 | opened in same tab | 115 | | 01550f5737b7b1c91467553566415 | dwelledButAbandoned | 689 | | 017c2b7c63756f5f1467550194078 | opened in same tab | 408 | | 017c2b7c63756f5f1467550194078 | dwelledButAbandoned | 527 | | 019d29dd35da59011467546257994 | opened in same tab | 619 | | 019d29dd35da59011467546257994 | dwelledButAbandoned | 889 | | 01a5b5bffc403db21467549871016 | opened in same tab | 687 | | 01a5b5bffc403db21467549871016 | dwelledButAbandoned | 921 | | 01a73b2b7e28342d1467568433642 | opened in same tab | 694 | | 01a73b2b7e28342d1467568433642 | dwelledButAbandoned | 761 | | 01b505b7f2187a061467567338499 | opened in same tab | 565 | | 01b505b7f2187a061467567338499 | dwelledButAbandoned | 664 | | 01edde8aaa0ca0f11467560007248 | opened in same tab | 565 | | 01edde8aaa0ca0f11467560007248 | dwelledButAbandoned | 682 | | 01fcfe56349e4fa71467650754289 | opened in same tab | 1048 | | 01fcfe56349e4fa71467650754289 | dwelledButAbandoned | 1136 | | 020a3855995cf0bf1467575343903 | opened in same tab | 233 | | 020a3855995cf0bf1467575343903 | dwelledButAbandoned | 413 | | 0216c83efe9546011467542510248 | dwelledButAbandoned | 683 | | 0216c83efe9546011467542510248 | opened in same tab | 3695 | | 021cee055c6b61051467576786137 | opened in same tab | 570 | | 021cee055c6b61051467576786137 | dwelledButAbandoned | 670 | | 023229da9b7d7bc41467531325233 | opened in same tab | 180 | | 023229da9b7d7bc41467531325233 | dwelledButAbandoned | 1879 | | 0244af01cf37f5101467554243558 | opened in same tab | 202 | | 0244af01cf37f5101467554243558 | dwelledButAbandoned | 2814 | | 025aacb2d4a262511467537720859 | opened in same tab | 766 | | 025aacb2d4a262511467537720859 | dwelledButAbandoned | 875 | | 0270e1bdb54dd9b71467567712467 | opened in same tab | 2666 | | 0270e1bdb54dd9b71467567712467 | dwelledButAbandoned | 2755 | | 027b9bb8a2cfffd21467555050046 | opened in same tab | 450 | | 027b9bb8a2cfffd21467555050046 | dwelledButAbandoned | 543 | | 027cbde7009f175a1467586782123 | opened in same tab | 363 | | 027cbde7009f175a1467586782123 | dwelledButAbandoned | 442 | | 028391cd153975771467559878812 | opened in same tab | 1062 | | 028391cd153975771467559878812 | dwelledButAbandoned | 3375 | | 028ef558c7453beb1467538876733 | opened in same tab | 220 | | 028ef558c7453beb1467538876733 | dwelledButAbandoned | 446 | | 028f9ce9a4c9a1351467571656427 | opened in same tab | 493 | | 028f9ce9a4c9a1351467571656427 | dwelledButAbandoned | 567 | | 028fe8dd6e8d182c1467545233372 | dwelledButAbandoned | 408 | | 028fe8dd6e8d182c1467545233372 | opened in same tab | 83772 | | 0290ffa09c81721e1467575212222 | opened in new tab | 492 | | 0290ffa09c81721e1467575212222 | dwelledButAbandoned | 616 | | 0294a2bb73740b281467546388668 | dwelledButAbandoned | 890 | | 0294a2bb73740b281467546388668 | opened in same tab | 5484 | | 029f3017e369428a1467528485216 | opened in same tab | 151 | | 029f3017e369428a1467528485216 | dwelledButAbandoned | 271 | | 02a161306221385f1467537690210 | opened in same tab | 370 | | 02a161306221385f1467537690210 | dwelledButAbandoned | 618 | | 02b91fa5010c2c421467571199143 | dwelledButAbandoned | 927 | | 02b91fa5010c2c421467571199143 | opened in same tab | 6009 | | 02bac351552bae5d1467532745330 | opened in same tab | 664 | | 02bac351552bae5d1467532745330 | dwelledButAbandoned | 923 | | 02c1ea9592c5ec7d1467539077765 | opened in same tab | 219 | | 02c1ea9592c5ec7d1467539077765 | dwelledButAbandoned | 2360 | | 02c84258744987721467565005518 | opened in same tab | 767 | | 02c84258744987721467565005518 | dwelledButAbandoned | 1056 | | 02cc8d06e412ed4e1467524093472 | opened in same tab | 162 | | 02cc8d06e412ed4e1467524093472 | dwelledButAbandoned | 551 | | 02cecda98c42b9d81467568110869 | opened in same tab | 1842 | | 02cecda98c42b9d81467568110869 | dwelledButAbandoned | 1937 | | 02dc10baf14feeb51467537863976 | opened in same tab | 829 | | 02dc10baf14feeb51467537863976 | dwelledButAbandoned | 1203 | +-------------------------------+---------------------+----------------------+ 100 rows in set (36.10 sec)