Thank you @bd808 this clarifies a lot. I'm glad to hear not everybody can become root. Perhaps we should remove the recommendation to run celery as root from the docs (see: https://wikitech.wikimedia.org/wiki/Help:Toolforge#Celery), because it doesn't seem to make sense. I'll be happy to make some changes once we know how Celery can be run.

Thank you for taking the time to look into this. I've tried to apply the short term fix by making my venv paths shorter, but I'm still running into problems. I've moved the 0.5.1 directory to the root of the tool. So it now sits at /data/project/algo-news/0.5.1.

Thanks a lot @Jdlrobson. I'll try to parse from there what I need.

This no longer works. See: https://en.wikipedia.org/w/api.php?action=query&prop=references&titles=Albert%20Einstein
I'm wondering if this is a regression or that is was disabled on purpose. I would like to access the list of references from the API.

Thank you for clarifying. I was under the assumption that one file would have one license and editors use the different blocks only for visual reasons. It sounds like a great idea to wait for CommonsData before making more changes. I think it would be good to merge this in the mean time as many file pages split the NonFree information over multiple templates. Let me know if I could help and otherwise I'll just see the merge notification somewhere in the future I presume.

If you agree with this approach I could make a patch, but bare with me as it would be my first.

If you would reverse the $sortedLicenses array and then array_reduce that with array_merge you would end up with one license that:

• Has keys set by the most important license if they are present in that license
• Any keys not in the most important license being set by other licenses, where more important licenses prevail over less important licenses

If I understand correctly this patch fixes one issue, but the licenses returned by selectLicense would still differ from page to page depending on the order in which the editor adds the templates. That looks like a nest of bugs to me. Shouldn't selectLicense merge all licenses into one object and return that in order to always return as much data as possible?