Page MenuHomePhabricator
Create Task
Maniphest T109962

increase index value size in Cassandra (32bit->64bit)
Closed, ResolvedPublic
Actions

Description

Our Cassandra schema is using int data type for the tile indexes. The 31bit (+signed) int limits us to zoom15 (4^15 is a 30bit value)

We could either store all indexes as 64bit ints, or we could have two tables - 32bit for zoom<=15, and 64bit for >15.

Do we want to save one more byte here and go with two tables? Guestimating about 70m tiles, so 70MB more of pure data, plus whatever's extra?

Event Timeline

Yurik created this task.Aug 22 2015, 11:51 PM
Yurik raised the priority of this task from to Needs Triage.
Yurik updated the task description. (Show Details)
Yurik added a project: Maps-Sprint.
Yurik added subscribers: Yurik, MaxSem, • GWicke.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 22 2015, 11:51 PM
• GWicke added a comment.Aug 24 2015, 5:19 PM

Honestly, I would keep things simple & just go for 64-bit ints. There are bigger performance wins / losses to be had with compression, for example. For PNGs, it might be most efficient to disable compression, or choose the very lightest-weight compression available. See http://docs.datastax.com/en/cassandra/2.1/cassandra/operations/ops_when_compress_c.html

• Tfinc moved this task from Backlog to To-do on the Maps-Sprint board.Aug 25 2015, 9:53 PM
• Tfinc moved this task from To-do to Backlog on the Maps-Sprint board.Sep 1 2015, 8:47 PM
• Tfinc moved this task from Backlog to In progress on the Maps-Sprint board.Sep 15 2015, 9:33 PM
Yurik closed this task as Resolved.Sep 22 2015, 2:37 AM
Yurik claimed this task.
• Tfinc moved this task from In progress to Done on the Maps-Sprint board.Oct 6 2015, 9:02 PM
Yurik added a project: Maps.Nov 7 2015, 7:34 AM
Restricted Application added a project: Discovery-ARCHIVED. · View Herald TranscriptNov 7 2015, 7:34 AM
Restricted Application added a subscriber: StudiesWorld. · View Herald Transcript
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL