Explore approaches for virtual reality integration with Wikimedia projects
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	Mike_Peel
	Tue, Apr 30, 8:37 PM

Description

How and where can VR and Wikimedia projects meet? This project would explore options for VR integration and browsing. Starting points might include:

The thoughts around Apple Vision at https://diff.wikimedia.org/2024/03/29/the-wikipedia-app-meets-spatial-computing/ (but covering all platforms)
Horizons Workrooms
Spatial
Open source vs. closed source approaches
3D media on Commons
VR meeting venues (online/hybrid)

Mentioned In: T365208: Invistigate options for VR integration and browsing
Mentioned Here: T246901: Support full colour 3D models on Wikimedia projects
P4896 Pageviews Analysis error report: TypeError: $(...)[0].getContext is not a function

Trying to figure out ways of linking to existing 3D content on Commons. For example, there is https://commons.wikimedia.org/wiki/File:Parthenon.stl - a 3D model of the Parthenon. It's possible to view it in 3D on Commons, if you click the '3D' button top-left, then you end up at https://commons.wikimedia.org/wiki/File:Parthenon.stl#/media/File:Parthenon.stl . Testing on Wikipedia though, you get https://en.wikipedia.org/wiki/User:Mike_Peel/Sandbox2 - clicking 3D takes you to commons, and you have to click again on 3D to actually view it in 3D... The 3D models are linked to in Wikidata items, though, using Property:P4896 - so there is a way of finding them from a Wikipedia article fairly directly. They are also in the Wikidata Infobox on Commons.

So limitations seem to be:

User interface is counterintuitive, you have to open it in mediaviewer to get 3D, not just clicking on the image and moving it around
Only greyscale is supported? - T246901 is from 2020
If you were browsing the page on a headset, how would you find the 3D model and be able to explode it outside of a browser window?

https://developer.apple.com/augmented-reality/quick-look/ exists - not quite VR, but AR. Could work for MediaWiki? Possibly needs USDZ (for apple) and GLTF (for Android/Quest) versions of the 3D models?

useful links:

@Mike_Peel: Thanks for participating in the Hackathon! We hope you had a great time.

If this task was being worked on and resolved at the Hackathon: Please change the task status to resolved via the Add Action... → Change Status dropdown, and make sure that this task has a link to the public codebase.
If this task is still valid and should stay open: Please add another active project tag to this task, so others can find this task (as likely nobody in the future will look back at the Hackathon workboard when trying to find something they are interested in).
In case there is nothing else to do for this task, or nobody plans to work on this task anymore: Please set the task status to declined.

Thank you,
Phabricator housekeeping service