Username: goransm (shell username), GoranSMilovanovic (Wikitech)
Full name: Goran S. Milovanović
Hi,
I need access to mwlog1001.eqiad.wmnet.
Motivation:
Best,
Goran S. Milovanovic, PhD
Data Analyst, WMDE
@GoranSMilovanovic What do you exactly need access to? And could you have your manager to sign off on this request?
Thank you
@Addshore What exactly do I need access to - could you please provide an answer to this question since I still haven't seen the inside of this server? Thanks.
@Tobi_WMDE_SW Tobi, could you please sign off this request as requested? Thanks a lot.
@ayounsi Access is needed to mediawiki logs created by code added to the WikimediaEvents extension.
The log file is cunningly called WMDE.log and this log gets added and removed periodically https://gerrit.wikimedia.org/r/#/c/362380/ https://gerrit.wikimedia.org/r/#/c/368701/
@Addshore Thanks Adam.
@ayounsi My immediate manager in WMDE Software Engineering, @Tobi_WMDE_SW, is on vacation. Hopefully, he will see this at some point and get in touch.
Change 372165 had a related patch set uploaded (by Ayounsi; owner: Ayounsi):
[operations/puppet@production] Add goransm to the mw-log-readers group
@Addshore if the data is not sensitive we could set up a rsync job in statistics::rsync::mediawiki and get the logs periodically on stat1005, would it be ok?
One benefit of simply reading the logs on the mwlog server is that if we ever have new logs / logs with a different name that need to be looked at we don't have to create a new RSYNC.
Sure, but one benefit of only rsyncing what's necessary is that we don't expose all the logs on mwlogs1001 :)
Change 372540 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] statistics::rsync::mediawiki: rsync wmde specific logs
Change 372540 merged by Elukey:
[operations/puppet@production] statistics::rsync::mediawiki: rsync wmde specific logs
Done!
elukey@stat1005:/srv/log/mw-log/archive/wmde$ ls -l total 700 -rw-r--r-- 1 stats stats 296 Jul 10 15:28 WMDE.log-20170711.gz -rw-r--r-- 1 stats stats 100446 Jul 12 08:14 WMDE.log-20170712.gz -rw-r--r-- 1 stats stats 92395 Jul 13 08:16 WMDE.log-20170713.gz -rw-r--r-- 1 stats stats 76275 Jul 14 08:20 WMDE.log-20170714.gz -rw-r--r-- 1 stats stats 80235 Jul 15 08:26 WMDE.log-20170715.gz -rw-r--r-- 1 stats stats 67184 Jul 16 08:21 WMDE.log-20170716.gz -rw-r--r-- 1 stats stats 81739 Jul 17 08:21 WMDE.log-20170717.gz -rw-r--r-- 1 stats stats 86279 Jul 18 08:21 WMDE.log-20170718.gz -rw-r--r-- 1 stats stats 60818 Jul 19 08:18 WMDE.log-20170719.gz -rw-r--r-- 1 stats stats 1214 Jul 20 08:02 WMDE.log-20170720.gz -rw-r--r-- 1 stats stats 720 Jul 21 07:35 WMDE.log-20170721.gz -rw-r--r-- 1 stats stats 360 Jul 22 04:33 WMDE.log-20170722.gz -rw-r--r-- 1 stats stats 451 Jul 23 08:04 WMDE.log-20170723.gz -rw-r--r-- 1 stats stats 557 Jul 24 07:36 WMDE.log-20170724.gz -rw-r--r-- 1 stats stats 488 Jul 25 07:08 WMDE.log-20170725.gz -rw-r--r-- 1 stats stats 360 Jul 26 07:00 WMDE.log-20170726.gz -rw-r--r-- 1 stats stats 362 Jul 27 06:57 WMDE.log-20170727.gz -rw-r--r-- 1 stats stats 362 Jul 28 08:07 WMDE.log-20170728.gz -rw-r--r-- 1 stats stats 227 Jul 28 22:06 WMDE.log-20170729.gz -rw-r--r-- 1 stats stats 233 Jul 30 07:22 WMDE.log-20170730.gz -rw-r--r-- 1 stats stats 355 Jul 30 23:09 WMDE.log-20170731.gz -rw-r--r-- 1 stats stats 286 Jul 31 11:15 WMDE.log-20170801.gz
@Addshore confirmed over IRC that the logs are not containing super sensitive data (also spot checked and everything looks good).