Page MenuHomePhabricator

Provide a regular JSON dump of all objects in Wikifunctions
Open, MediumPublicFeature

Description

We should provide a regular JSON dump of all objects in Wikifunctions.

This will be something similar to Wikidata JSON dump:

[
{"type":"lexeme","id":"L314","lemmas":{"ca":... ,"modified":"2019-11-29T13:45:06Z"},
...
]

Note: no spaces should separate keys and values (e.g. '"id":"L314"' above instead of '"id" : "L314"')
Note: each object should be one line

Event Timeline

Note: Currently the internal representation of ZObject contains a large number of unnecessary spaces and newlines (see https://www.wikifunctions.org/w/api.php?action=query&format=json&prop=revisions&titles=Z10000&formatversion=2&rvprop=content). This may be stored in a more compat way.

Bugreporter renamed this task from JSON dump of all object to JSON dump of all objects.Aug 5 2023, 2:05 PM

Is this a bug report? Is this a feature request? (I guess I lack a verb in the task title.)

DVrandecic renamed this task from JSON dump of all objects to Provide a regular JSON dump of all objects in Wikifunctions.Aug 8 2023, 8:01 PM
DVrandecic updated the task description. (Show Details)
DVrandecic subscribed.

I have slightly rewritten the task in the way I understood it. OP, please fix it if I got it wrong, thanks.

Aklapper changed the subtype of this task from "Task" to "Feature Request".Sep 4 2023, 9:25 AM
Milimetric subscribed.

When you all would like to start this work, let's talk. We would love to move this kind of dump to an Airflow pipeline for ease of maintenance.