Thanks! I already tried to fix another similar issue for kafkatee+oxygen in T132322, mentioning it since I might be the root cause :)

elukey@oxygen:~$ sudo invoke-rc.d kafkatee reload
elukey@oxygen:~$ echo $?
102

 102    Subsystem error.  Init script (or policy layer) subsystem malfunction. Also, forced init script execution due to --try-anyway or --force failed.

elukey@oxygen:~$ sudo service kafkatee reload
elukey@oxygen:~$ echo $?
0

So /etc/logrotate.d/kafkatee uses invoke-rc.d kafkatee reload and returns 102, meanwhile /etc/logrotate.d/kafkatee-webrequests uses service kafkatee reload and returns 0.

I agree with Riccardo, we'd probably need to merge the two rotate scripts. The kafkatee is shipped with a logrotate script, so we'd need to remove it from there and only let puppet do the work:

elukey@oxygen:~$ dpkg -S /etc/logrotate.d/kafkatee
kafkatee: /etc/logrotate.d/kafkatee

Myself from the past created T145490

Change 354223 had a related patch set uploaded (by Elukey; owner: Elukey):
[analytics/kafkatee@master] Remove logrotate and syslog configuration

https://gerrit.wikimedia.org/r/354223

Mentioned in SAL (#wikimedia-operations) [2017-05-18T13:14:19Z] <elukey> reloaded kafkatee to test T151748

Change 354223 merged by Elukey:
[analytics/kafkatee@master] Remove logrotate and syslog configuration

https://gerrit.wikimedia.org/r/354223

Mentioned in SAL (#wikimedia-operations) [2017-06-30T09:54:21Z] <elukey> uploaded kafkatee 0.1.6-1 to reprepro - T151748

Change 362382 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet/kafkatee@master] Replace 'invoke-rc.d' with 'service' in logrotate config

https://gerrit.wikimedia.org/r/362382

Change 362382 merged by Elukey:
[operations/puppet/kafkatee@master] Replace 'invoke-rc.d' with 'service' in logrotate config

https://gerrit.wikimedia.org/r/362382

Let's wait the regular weekly rotates to happen before calling this a win :)