T256018 drew attention to the fact that we're only keeping two weeks' worth of access logs. This is fine, but to give us a better view of usage over time, it'd be good to install AWStats on wsexport.wmflabs.org. This shouldn't have any privacy implications (IP addresses are already stripped from the logs), and is similar to what we did for XTools a couple of years ago.
Description
Related Objects
- Mentioned In
- T264122: Wikisource Ebooks: investigate if we can prevent automated downloads (to improve reliability) [8H]
T265431: Wikisource Ebooks: Can we determine the percentage of automated vs. human downloads of books on Wikisource?
T256018: Wikisource Ebooks: Collect Data on Current Ebook Exports [8 hours] - Mentioned Here
- T256018: Wikisource Ebooks: Collect Data on Current Ebook Exports [8 hours]
Event Timeline
Doing this now because we talked in the engineering meeting today about how it'll be useful to have before the switch to Symfony (later this week).
Installed, configured, and available now at https://wsexport.wmflabs.org/awstats . I've also documented it all on Wikitech.
Will leave this in-dev for a day or two while I keep an eye on it.
I think 2 points.
Another thing I was wondering about: We're not backing up these stats anywhere (the stats in the datbase on the other we're dumping to the filesystem nightly). Do we want to, or is it okay to one day lose all the historical data? (I suspect it's fine to live dangerously, that's normal for Toolforge.)
@Samwilson Thanks!
As for the question of backing up, @dmaza, @MusikAnimal, & @HMonroy, any input/thoughts?
As for the question of backing up, dmaza, MusikAnimal, & HMonroy, any input/thoughts?
I don't think it's critical since we probably won't be relying on this data far beyond the near future, but if it's simple to do, go for it. Where are awstats stored currently? I assume the data would need to be backed up onto a different machine to be worthwhile.
This has been installed and is viewable at https://wsexport.wmflabs.org/awstats. I'm marking this as Done.