I was able to get the 2019 data downloaded on a Toolforge server (connecting via dev.toolforge.org), which I figured would make things skip along better, but the toolforge user has still ground to a halt on the 2020 data.

@JAllemandou thanks for clarifying! I will go without the 2018 data :)

Hi @JAllemandou, thanks so much for doing this. Inspecting the 2021 data, format looks great (and coverage looks good too, with 17M revs in Jan-Mar 2021 and only ~4K multi-requested revs, which sounds right to me). Two concerns:

Thanks @JAllemandou! I don't seem to have permission to access the newly-created file dumps. Please let me know if I missed some documentation for authing against analytics.wikimedia.org! I have access to other files in the one-off folder, so this may only be affecting these ORES dump files.

Thanks to @elukey for chatting with me in the IRC and prompting me to provide additional info. @Halfak may be able to provide more targeted info about the HDFS table, but I can tell you what data we need.