A installation of Postgresql with PostGIS and hstore would be nice to work with Wikipedia-coordinates there.
I assume the amount of data will be relatively small compared with the data we will have later from OpenStreetMap on an other Server.
Version: unspecified
Severity: normal
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Duplicate | Yurik | T27139 Integrate OpenStreetMap data within Wikimedia projects | |||
| Open | Feature | None | T64257 OpenHistoricalMap & Wikimaps | ||
| Declined | None | T35856 Wikipedia Android App 2.0 release (tracking) | |||
| Resolved | akosiaris | T35980 Wikimedia-hosted OpenStreetMap (OSM) / mapnik tileservers wanted for mobile usage | |||
| Invalid | None | T62831 Prepare dedicated hardware for tileserver | |||
| Resolved | bd808 | T60788 Toolserver migration to Tools (tracking) | |||
| Resolved | bd808 | T60791 Missing Toolserver features in Tools (tracking) | |||
| Resolved | Yurik | T60797 [DO NOT USE] [tracking] OSM on Labs [superseded by #Maps] | |||
| Resolved | coren | T50896 Please install Postgresql on Tool-labs | |||
| Resolved | akosiaris | T62819 Set up a tileserver for OSM in Labs | |||
| Resolved | akosiaris | T62461 Replicate OSM to a database server accessible by Labs users |
We are currently working on setting up a Mysql DB on physical servers for Labs'
use; given that there are also nice things that can be done with a working
pgsql in general (testing mw against it comes to mind), I think this should be
provided as a general service.
The current mysql DB plan calls for a master/slave setup, it'd be easy to set
up a postgres server on those same servers as well -- switching roles so that
performance is distributed.
Nice things possible with psql would be:
*Have PostGIS to play with Wikipedia-coordinates or other geospatial data as mention before.
*pgsql has a nice key-values store (hstore)
*pgsql starts to support JSON[1]. This is perhaps a really nice way to make data from WikiDATA accessible.
[1]http://www.postgresql.org/docs/9.3/static/functions-json.html
One tool which is waiting for it is Wikipedia coordinates [1], which is with 6 Mio. entries relatively small but often used. This tool is independent from OSM and was the reason for me to open this ticket, because it seems to be an easy task.
Other tools like WIWOSM, Addtags, ... need off course the full OSM database.
Existing OSM tools can be found here [2] (by using the search function).
If the database in WMF production is now running I hope we can get OSM database in Labs really soon.
Greetings
[1]https://de.wikipedia.org/wiki/Wikipedia:WikiProjekt_Georeferenzierung/Wikipedia-World/en
[2]https://www.mediawiki.org/wiki/Wikimedia_Labs/Tool_Labs/List_of_Toolserver_Tools
Is there an schedule for it? I read something about Postgresql-server for Labs in the WMF engineering report of November.
The hardware has been set aside for it in eqiad (the datacenter labs is moving to). Since we are moving all of labs, it didn't seem reasonable to set it up for a month and then have to migrate it, so the postgresql instance will be available in the new location (we are gunning for early Feb).
Postgresql might be also needed to keep the toolserver wiki somewhere in Tool Labs (see #60220). Giving high priority for after the migration to equiad.
PostgreSQL master/server databases are good and ready to go
labsdb1004 is the master, labsdb1005 is the slave. Streaming asynchronous replication is setup between them, as configured by the puppet module.
Some minor manual steps to get the architecture fully working will be documented in the puppet module. PostGIS is scheduled to be enabled soon. OSM syncing from planet.osm still needs some work and will be ready ASAP.