Notes for future reference:

Could T250767 be related @Tgr ?

@Lokal_Profil @JeanFred any news on this? Haven't done this in a while and the documentation at https://commons.wikimedia.org/wiki/Commons:Monuments_database/Harvesting looks outdated. Implication is that you two are currently the only people who are able to add sources.

I'm just going to close this one as invalid because of lack of information and nothing happening for several years. Feel free to add more information and open it again.

Also discussed at https://commons.wikimedia.org/wiki/Commons_talk:Depicts#Replacing_a_class_with_a_specific_instance . Cleaned up the code. Done for now.

Works, see https://commons.wikimedia.org/w/index.php?title=File:Delfzijl,_Nederlands_Hervormde_Kerk_1422.jpg&diff=prev&oldid=418156340 and code at https://github.com/multichill/toollabs/blob/master/bot/commons/depicts_instance.py

In T244341#6096946, @dcausse wrote:

@Multichill the discussion seems to have stalled. Thanks to Peter the pros and cons have been well summarized now. I also understand that part of the misunderstanding of this change was the lack of clarity on the motivations as to why we require a breaking change like that. I hope it had been addressed in the linked discussion.
Do you have additional comments to make here? Thanks!

Yes, ran into this too on Wikidata this week. The stripping could happen on the front end javascript or in the backend API. Not sure where other clean up is currently happening. AFAIK this only applies to string datatypes so I'll update the task a bit.

This needs community consensus before moving forward.

In T249688#6055456, @Lucas_Werkmeister_WMDE wrote:

CCing @Multichill, who deleted the property in question. Even if the error is handled better in WikibaseMediaInfo in the future, I figure the property deletion process should have included a haswbstatement search on Commons, not only checking that it wasn’t used anymore on Wikidata.

This got deployed, see https://www.wikidata.org/w/index.php?title=Wikidata:SPARQL_query_service/Federation_report&curid=54292822&diff=1156571419&oldid=1151192877 Thanks!

This got deployed, see https://www.wikidata.org/w/index.php?title=Wikidata:SPARQL_query_service/Federation_report&curid=54292822&diff=1156571419&oldid=1151192877 Thanks!

How is this resolved exactly? The provided script marks all local images, not only the fair use ones, but also the free ones.

BGP is quite a slow protocol, you might want to tweak some timers or combine it with BFD.
If BGP is giving you too much hassle, you might want to consider switching to OSPF. On the Juniper side you should be able to run it in a separate routing-instance to keep it away from your main OSPF process.

With vxlan it's also very easy to stretch lans between multiple data centers of a layer3 network. Can be quite useful in some cases.
Make sure you bump the mtu to 9000+ on all the underlay networks.

I cleaned up all these cases and asked @hoo to update https://www.wikidata.org/wiki/Wikidata:True_duplicates . Judging from the last edit times of these items this is an old issue that just hasn't been cleaned up yet. Marking this one as resolved because I think we have nothing left to do here.

https://w.wiki/LST indicates that 70 of these are Rijksmonumenten. I'll work my way through them. Let's see what's left after that.

The inconsistent database strikes again! T50260 was closed as a duplicate (pun intended) and links to T44325 . The items show up on https://www.wikidata.org/wiki/Wikidata:True_duplicates and are not duplicates and should not be merged.

Old hackathon project, not really valid anymore. Just needs some regular editing to clear these out.

Can someone fix https://www.wikidata.org/wiki/User_talk:PokestarFan / https://www.wikidata.org/w/index.php?title=User_talk:PokestarFan/Structured_Discussions_Archive_1&action=edit&redlink=1 ? Thanks.

In T221921#5977857, @Gehel wrote:

Thank you all for your patience!

I might pick this up if nobody else beats me to it (go ahead). I actually have been using this a lot in my bots and it works quite well.

In T221921#5973204, @Abit wrote:

Not providing the promised SPARQL endpoint for Structured data on Commons is effectively pulling the plug on the whole project.

We will still build a tool to get out Commons data, one that lets you navigate the ontology tree and have similar output formats.  Fixing WDQS before it busts is higher priority, so that is what the Search Platform team is working on right now.  In addition, the Commons Query Service is currently blocked because we don't want to build a new query service until we know what the solution for the old one is.

In T221921#5960210, @Gehel wrote:

Some of the use cases described here are already supported by search (wbstatement keywords, etc...). We are not going to work on a new SPARQL endpoint before we have a scaling strategy for the current WDQS. It looks like the remaining use cases described here might be better served not by a SPARQL endpoint, but by a more specific service.

In T246901#5964613, @Jdforrester-WMF wrote:

Sorry, I was unclear. This isn't a problem with any given rich 3D format, it's a problem with the nature of things. For WP:BEANS reasons I won't go into depth about the potential abuse vectors, but certainly things we touched on were around problematic imagery or content, especially forms that are stenographically "hidden" or textures painted onto the inside of a surface so they're invisible on casual inspection.

Right now, a Commons sysop can glance at new image uploads as they come in and determine in a fraction of a second if it's problematic (e.g. copyvios or CSIA or other issues); for videos, they have to watch at least some of it; for 3D models, they'd need to interact with it to examine it from lots of different viewpoints/etc. It's just a different scale in terms of work.

I can't find it right now, but I recall having a list of requirements for new file formats to be support. Top of my head:

1. Has to be a free format (no patents or other problems)
2. We need to be able to render it somehow
3. We need to be able to do a sanity check on the file (to prevent malicious content)

I ran into the same problem at https://commons.wikimedia.org/w/index.php?title=File:Nieuwe_Kerk_in_Haarlem.jpg&action=history

I would say property level.

Done in 2016 and never closed?

I don't think many oppose, only a few loud mouths.

Maybe not show it in the case of depicts because it might confuse users? I can't imagine a use case where I want to say depicts -> somevalue/novalue.

In T245349#5888188, @Jarekt wrote:

Multichill, I think this might be duplicate of T237991.

I think you're right, but that bug hasn't even been touched by the SDC team. @Ramsey-WMF @Keegan who is supposed to manage these boards? It's a bit pointless of us filing bugs for the SDC team if nobody is noticing it.

Null edit triggers update, but looks like a purge also does that. At least that is a less intensive operation. As a workaround we can just mass purge suspected files.

This is one of those bugs where you should just lookup the relevant chapter in a book like http://barbie.uta.edu/~jli/Resources/MapReduce&Hadoop/Distributed%20Systems%20Principles%20and%20Paradigms.pdf and look at the possible solutions.

F31552245 is a nice mock up.

I agree, let's continue in the other task about that part.

Wanted to test this, but looks like 1.35.0-wmf.18 got rolled back everywhere 2 days ago.

In T239474#5845117, @matthiasmullie wrote:

Where units can be searched:

@jcrespo maybe you can point this in the right direction?

In T242157#5789026, @Urbanecm wrote:

Bot usernames are (mostly) connected with exactly one operator. As said in previous comment, I'm happy to contact the bot owners on your behalf, I'm also happy to give them your contact info if you want me to do so, so they can contact you directly with question. That would be totally okay. I'm not going to release the data unless approved by Legal. I can contact them, but approval can take weeks to months :-).

Maxlag is just a configuration setting in Pywikibot and default is 5, there is no "code to fix". Every once in a while I might set it to a different value while testing so I'm not wasting my time. Generally it's just set to 5.

In T221774#5814473, @Pintoch wrote:

I don't know - I stopped working on this task and T240369 since T240374 was declined. I don't think I can contribute to solving this problem in the current state of affairs, sorry!

@matthiasmullie what am I doing wrong at /w/api.php?action=wbeditentity&format=json&id=M51867633&token=123445678903dd2%2B%5C&data=%7B%22claims%22%3A%5B%7B%22mainsnak%22%3A%7B%22snaktype%22%3A%22value%22%2C%22property%22%3A%22P7787%22%2C%22datavalue%22%3A%7B%22value%22%3A%20%7B%22amount%22%20%3A%20%22%2B67%22%2C%20%22unit%22%20%3A%20%22http%3A%2F%2Fwww.wikidata.org%2Fentity%2FQ28390%22%7D%2C%22type%22%3A%22quantity%22%7D%7D%2C%22type%22%3A%22statement%22%2C%22rank%22%3A%22normal%22%7D%5D%7D ?

Any news on this? We just created https://www.wikidata.org/wiki/Property:P7787 to indicate the heading the photographer was looking when taking the image. The unit would be degree (http://www.wikidata.org/entity/Q28390). Currently can't use that, just without a unit, see for example https://commons.wikimedia.org/w/index.php?title=File:%D0%A1h%C3%A2teau_d%27Amboise_4.jpg&diff=prev&oldid=387384011

In T231981#5752521, @Ramsey-WMF wrote:

Tested on production (double checked on mobile) with length property. Works as expected. Still need to add unit support (which will be done via T231981 )

I did a SPARL injection by adding |grouping_property=P131/wdt:P131 https://www.wikidata.org/wiki/User:Multichill/Windmill_sandbox

Just added this to a bunch of properties using a complex constraint: https://www.wikidata.org/w/index.php?sort=relevance&search=%22key+language%22&title=Special:Search&profile=advanced&fulltext=1&advancedSearch-current=%7B%7D&ns121=1 . Normal constraint would be nicer.

@Urbanecm thanks for looking into this. Appreciated. Not sure if bot usernames are a privacy issue, I think not because these are role accounts. I recall in the past we had a list of top bots using an old version so we could contact the operator. Maybe double check with the legal privacy guru's?

My entry to database tables is usually https://www.mediawiki.org/wiki/Category:MediaWiki_database_tables . We should probably just make placeholder pages for now that point you to the right page on doc.wikimedia.org?

Break info at https://commons.wikimedia.org/wiki/Module_talk:Wikidata_label#Lua_error_in_Module:Wikidata_label_at_line_24:_attempt_to_call_method_'getSitelink'_(a_nil_value).

I might set maxlag to something different than 5 every once in a while.

In T239474#5728837, @egardner wrote:

Here's a question – where do the units come from? Are we using a hard-coded list, or somehow fetching a list of appropriate units based on the property? Units will also be property-specific (a "length" property will have different units from a "weight" property).

How does Wikidata handle this?

In T239172#5716924, @PDrouin-WMF wrote:

I did some design exploration on how we could support no value/unknown values, but it radically changes how statements editing will work on Commons. We discussed it as a team and have decided that for now, we will:

1. display no value/unknown values if added
2. make these values deletable in edit mode

Support can be more robust in the future when the community data model is more fleshed out.

--> see added mocks to the description

In T222321#5710031, @EBernhardson wrote:

In summary, it seems we need to merge the patch[1] for the /entity/ endpoint, and this should be resolved?

[1] https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/526757/

@Ecritures looks like you accidentally closed the task without copying the results here. I did so. You might want to format it.

In T239172#5694190, @Cparle wrote:

@Multichill is it important that we allow users to add "no value" values when they're editing, or do you think it'd be sufficient to simply display "no value" values that have been added some other way?

Thanks for creating this one @egardner . This is already used quite a lot to model authorship of a file. Would be nice for the interface to actually show something soon.

In T239163#5691328, @egardner wrote:

In T239163#5691308, @Multichill wrote:

Where do you plan to store the constraints? Currently the constraints are on Wikidata on the properties.

I assume we'd test for constraint violation when a new value for a given property is submitted by using the appropriate API action, and wouldn't keep track of the constraints ourselves. We'd just check against what was defined on Wikidata.

Where do you plan to store the constraints? Currently the constraints are on Wikidata on the properties.

Done, did a couple of files that worked well. Ran into an unexpected problem: They included the photos of boxes that not actually contain the taxon (the box does contain the taxon, the image doesn't). See for example https://commons.wikimedia.org/wiki/File:Naturalis_Biodiversity_Center_-_RMNH.MOL.186584_1_-_Erronea_cylindrica_(Von_Born,_1778)_-_Cypraeidae_-_Mollusc_shell.jpeg . This is a bit of a blocker.

https://etherpad.wikimedia.org/p/depictor_techstorm