Page MenuHomePhabricator

Consider a serialization that supports random access for storage in the DB for Wikidata
Open, LowestPublic

Description

Instead of JSON consider a serialization that supports random access and possibly can even be used for in memory representation for storage in the DB. This would make the work for deferred deserialization even less.

Something like BJSON, Protocol Buffers or EXI, where you can know the length of something without searching.

Event Timeline

JanZerebecki renamed this task from consider an serialization that supports random access for storage in the DB to consider n serialization that supports random access for storage in the DB.
JanZerebecki renamed this task from consider n serialization that supports random access for storage in the DB to consider a serialization that supports random access for storage in the DB.
JanZerebecki raised the priority of this task from to High.
JanZerebecki updated the task description. (Show Details)
JanZerebecki updated the task description. (Show Details)
JanZerebecki set Security to None.
JanZerebecki updated the task description. (Show Details)
hoo added a subscriber: hoo.Dec 27 2015, 10:34 AM
Addshore lowered the priority of this task from High to Normal.Oct 31 2018, 5:55 PM
Addshore added a project: Operations.

This would still be great, but it is not high prio.

Tagging Operations given the discussions we have a 2018 Tech Conf about storage types.

Addshore renamed this task from consider a serialization that supports random access for storage in the DB to Consider a serialization that supports random access for storage in the DB for Wikidata.Oct 31 2018, 5:55 PM
Addshore lowered the priority of this task from Normal to Lowest.
Addshore moved this task from incoming to needs discussion or investigation on the Wikidata board.