Kolossos
User

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Mar 3 2015, 9:54 PM (185 w, 2 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Kolossos [ Global Accounts ]

Recent Activity

Thu, Sep 13

Kolossos closed T201544: My database tables on Postgres -OSM Server are away as Resolved.

Fine it's working. Thanks.

Thu, Sep 13, 7:21 AM · Maps, Cloud-Services

Wed, Sep 12

Kolossos added a comment to T201544: My database tables on Postgres -OSM Server are away.

It works now fine high zoom levels. Thanks.

Wed, Sep 12, 10:13 PM · Maps, Cloud-Services

Sat, Sep 8

Kolossos added a comment to T201544: My database tables on Postgres -OSM Server are away.

Sorry I was longer time AFK.

Sat, Sep 8, 6:19 PM · Maps, Cloud-Services

Wed, Aug 29

Kolossos added a comment to T201544: My database tables on Postgres -OSM Server are away.

@Bstorm: I think "copy" should import the unpacked file:

copy wp_coords_red0 from '/home/wp-world/new_red0';

Than I can start some some other sql-commands to create the other tables *red2,*red3 and *red4

Wed, Aug 29, 11:01 PM · Maps, Cloud-Services

Fri, Aug 24

Kolossos added a comment to T201544: My database tables on Postgres -OSM Server are away.

Luckily I have dumps (primarily as service for external users):
Dumps:
https://tools.wmflabs.org/wp-world/dumps/new_red0.gz
Database_Structure_postGIS:
https://de.wikipedia.org/wiki/Wikipedia_Diskussion:WikiProjekt_Georeferenzierung/Hauptseite/Wikipedia-World/news#Database_Structure_postGIS
Further personal SQL-Commands:
https://tools.wmflabs.org/wp-world/load-dispenser2015-2.php

Fri, Aug 24, 8:52 PM · Maps, Cloud-Services
Kolossos added a comment to T201544: My database tables on Postgres -OSM Server are away.

@Bstorm : Yes the ticket is still a problem. You can self see that under database "gis" that my tables "wp_coords.." are still missing. This is also the error report of my script[1].
If the data was moved to an other database like u_kolossos a hint would be nice and I would need help how to access the other database (see above).

Fri, Aug 24, 6:03 PM · Maps, Cloud-Services

Aug 9 2018

Kolossos updated subscribers of T201544: My database tables on Postgres -OSM Server are away.
Aug 9 2018, 6:35 PM · Maps, Cloud-Services
Kolossos added a comment to T199652: Tool 'wp-world' gives 404s.

On parts of my tool I'm still have a strong interest to maintain it.
But I deactivated the googlemaps proxy as I'm no expert on XSS security https://phabricator.wikimedia.org/T182341 .
The source code of the script is:
https://tools.wmflabs.org/wp-world/googlmaps-proxy.txt
So if somebody would be able to repair it it would be nice.

Aug 9 2018, 6:25 PM · Wikidata, Commons, Tools

Aug 8 2018

Kolossos created T201544: My database tables on Postgres -OSM Server are away.
Aug 8 2018, 7:07 PM · Maps, Cloud-Services

Jun 25 2018

Kolossos added a comment to T184126: Templatetiger-Updating: Lost connection to MySQL server during query.

After starting it with jsub (without autocommit=0) it lose the connection to the database during the LOAD DATA LOCAL.

Jun 25 2018, 8:32 PM · Data-Services, Toolforge

Jun 24 2018

Kolossos added a comment to T184126: Templatetiger-Updating: Lost connection to MySQL server during query.

The line by line execution shows that the LOAD DATA LOCAL line was the point where it breaks.

Jun 24 2018, 5:29 PM · Data-Services, Toolforge

Jun 14 2018

Kolossos added a comment to T184126: Templatetiger-Updating: Lost connection to MySQL server during query.

The import of some GB need some time. This was no problem in the past because I use "/* SLOW_OK */" in the sql-statement[1].

Jun 14 2018, 4:12 PM · Data-Services, Toolforge

Jun 8 2018

Kolossos added a comment to T183954: templatetiger is using 827G of 8T available tools nfs storage.

Hello, it's cleaned up.

Jun 8 2018, 8:16 PM · cloud-services-team, Operations, Cloud-VPS

Mar 25 2018

Kolossos added a comment to T190451: Find out who maintains http://hikebikemap.org/.

I have two points, first the relation between Wikimedia Movement and OSM and second my opinion what we should do with gpsies and apemap as the largest external users.

Mar 25 2018, 10:29 AM · cloud-services-team, Cloud-VPS, Tools
Kolossos closed T190519: query2map uses map tiles from OSM as Resolved.

Changed to wmflabs tiles.

Mar 25 2018, 8:52 AM · Toolforge-standards-committee, Privacy, Tools
Kolossos closed T190519: query2map uses map tiles from OSM, a subtask of T172065: Hunt for Toolforge tools that load resources from third party sites, as Resolved.
Mar 25 2018, 8:52 AM · Toolforge-standards-committee, Tools, Privacy

Jan 11 2018

Kolossos added a comment to T184126: Templatetiger-Updating: Lost connection to MySQL server during query.

It's really seems related to T180380, but there is no solution.

Jan 11 2018, 9:40 PM · Data-Services, Toolforge

Jan 3 2018

Kolossos updated the task description for T184126: Templatetiger-Updating: Lost connection to MySQL server during query.
Jan 3 2018, 11:01 PM · Data-Services, Toolforge
Kolossos updated the task description for T184126: Templatetiger-Updating: Lost connection to MySQL server during query.
Jan 3 2018, 10:58 PM · Data-Services, Toolforge
Kolossos created T184126: Templatetiger-Updating: Lost connection to MySQL server during query.
Jan 3 2018, 10:14 PM · Data-Services, Toolforge

Jan 2 2018

Kolossos added a comment to T183954: templatetiger is using 827G of 8T available tools nfs storage.

Done.

Jan 2 2018, 9:44 PM · cloud-services-team, Operations, Cloud-VPS

May 20 2017

Kolossos added a comment to T136192: templatetiger is using 613G in Tools out of 8T.

Cleaned up to 95 GB.

May 20 2017, 2:55 PM · Toolforge, Cloud-Services

Feb 16 2017

Kolossos added a comment to T136192: templatetiger is using 613G in Tools out of 8T.

@yuvipanda Yes it works fine.

Feb 16 2017, 6:44 PM · Toolforge, Cloud-Services

Feb 15 2017

Kolossos updated subscribers of T136192: templatetiger is using 613G in Tools out of 8T.

@yuvipanda Thank you. Fine.

Feb 15 2017, 8:45 PM · Toolforge, Cloud-Services
Kolossos added a comment to T136192: templatetiger is using 613G in Tools out of 8T.

I update the db to 2017. Everything works fine.
Now the database seems to be deleted/disappear. Anyone any idea?

Feb 15 2017, 8:37 PM · Toolforge, Cloud-Services

Feb 10 2017

Kolossos added a comment to T112948: All map location names should be in the user's language.

I would say the community should decides this question in each language. For me as a German it's e.g. ok to get English labels as fallback, for someone in eastern European projects it's perhaps better to get Russian as fallback.
It's in my eyes impossible to configure this from a central point.
Offcourse each user has different background which languages he can read. Each user have different usecase, e.g. sometimes he want to compare the map with real street signs on the street, so he need the pure name-tags. Sometimes he really need the labels in his own languages.

Feb 10 2017, 12:08 PM · Patch-For-Review, Collaboration-Feature-Rollouts (Collaboration-Maps), Collaboration-Team-Triage (Collab-Team-This-Quarter), Maps (Map-Styles), I18n

Dec 17 2016

Kolossos added a comment to T120767: A powerful, handy TemplateTiger.

I take I look in my old php-code of templatetiger and must say that it's horrible. There are wild string-construction to generate sql-queries. It's simply not to modify anymore.
I think it could need a complete rewrite in something like Python/Pandas and a complete new UI.

Dec 17 2016, 7:25 PM · Community-Wishlist-Survey-2015

Oct 31 2016

Kolossos added a comment to T145284: Allow Wikidata's P402 (OpenStreetMap Relation identifier) to be used in Kartographer.

Please, don't use Property P402 !!!
We show it on WIWOSM [1] project that we don't need it to link from Kartographer to an geometry in OSM.
We can use Wikipedia and Wikidata-Tags in OSM and are so more flexible to suport also points and lines without and relation-id. The relation ID's in OSM are not stable.
so please change Kartograher to support OSM data without P402.

Oct 31 2016, 6:22 PM · Maps (Kartographer), Discovery

Sep 13 2016

Kolossos updated subscribers of T136192: templatetiger is using 613G in Tools out of 8T.

@yuvipanda : Do you know why templatetiger doesn't work and why I can't bring it back by restarting webserver?
I get an "502 Bad Gateway" . Thanks

Sep 13 2016, 7:26 PM · Toolforge, Cloud-Services

Sep 10 2016

Kolossos updated subscribers of T136192: templatetiger is using 613G in Tools out of 8T.

I reduced the volume to the minimum of 150 GB by deleting old files manually.
With the often broken dump files I have no better strategy.

Sep 10 2016, 10:07 PM · Toolforge, Cloud-Services

Jul 29 2016

Kolossos added a comment to T141362: Labels for POI's completely missing on maps.wikimedia.org.

The osm-style have to be reduced to have place and clearance for additional overlays.

Jul 29 2016, 8:08 AM · Maps (Map-Styles)

May 25 2016

Kolossos added a comment to T136192: templatetiger is using 613G in Tools out of 8T.

templatetiger should be after cleanup now at under 140GB on file system.

May 25 2016, 6:03 PM · Toolforge, Cloud-Services
Kolossos added a comment to T136212: Contact tool maintainters using large amounts of disk space.

templatetiger should be after cleanup now at under 140GB.

May 25 2016, 6:02 PM · Goal, Cloud-Services, Toolforge

Feb 17 2016

Kolossos added a comment to T127164: Some databases cannot be backed up/replicated on toolsdb.

I can recreate all data inside templatetiger, in the case of a disaster.

Feb 17 2016, 10:19 PM · Cloud-Services, DBA

Jan 30 2016

Kolossos added a comment to T124822: Find a method for `templatetiger` to sort large files.

@scfc:
To the first point: Yes to maintain a labs project would be to much overhead for me. Normally templatetiger is only a little php script and a database. The trouble with to sort script cames later.

Jan 30 2016, 1:23 PM · Tools, Cloud-Services, Toolforge

Jan 27 2016

Kolossos added a comment to T124822: Find a method for `templatetiger` to sort large files.

I will try now -T /tmp/sort. So the temporal dir should be local tmp .
I code this stuff, often after my regular job. So sometimes I'm fine if things seems to work, also if it's not optimal. Sorry if such things happen.

Jan 27 2016, 10:31 PM · Tools, Cloud-Services, Toolforge
Kolossos added a comment to T124822: Find a method for `templatetiger` to sort large files.

Is it true that "/tmp/" is locally on a server randomly choosen by jstart? So how can I use this files later in the next job to import it to database?

Jan 27 2016, 7:41 PM · Tools, Cloud-Services, Toolforge
Kolossos added a comment to T124822: Find a method for `templatetiger` to sort large files.

Sorry, I read this too late.
I will sort now to "/tmp/sort/" and hope thats ok.

Jan 27 2016, 6:43 PM · Tools, Cloud-Services, Toolforge

Sep 22 2015

Kolossos added a comment to T112948: All map location names should be in the user's language.

This task is also know as multilingual maps:
http://wiki.openstreetmap.org/wiki/Multilingual_maps_Wikipedia_project
Should work in the future with vector tiles.

Sep 22 2015, 6:05 PM · Patch-For-Review, Collaboration-Feature-Rollouts (Collaboration-Maps), Collaboration-Team-Triage (Collab-Team-This-Quarter), Maps (Map-Styles), I18n

Sep 21 2015

Kolossos updated subscribers of T112948: All map location names should be in the user's language.
Sep 21 2015, 9:56 PM · Patch-For-Review, Collaboration-Feature-Rollouts (Collaboration-Maps), Collaboration-Team-Triage (Collab-Team-This-Quarter), Maps (Map-Styles), I18n

Sep 14 2015

Kolossos created T112567: Buffer for Metatiles.
Sep 14 2015, 6:44 PM · Discovery, Maps

Jul 27 2015

Kolossos closed T98790: Grants for my Tools-db missing to insert new lines as Resolved.

Thanks, it seems to work.

Jul 27 2015, 7:15 PM · Cloud-Services, Toolforge

Jul 25 2015

Restricted Application added a project to T98790: Grants for my Tools-db missing to insert new lines: Cloud-Services.

Ping? The problem still exist.

Jul 25 2015, 8:27 PM · Cloud-Services, Toolforge

Jul 3 2015

Kolossos added a comment to T103272: Replacements for a.toolserver.org, b.toolserver.org, c.toolserver.org not available.

No I change only the scripts we have in production inside Wikipedia and Commons.
This doesn't also help maps that base on hikebikemap-tiles or blackwhite-map.

Jul 3 2015, 5:41 AM · Cloud-Services

Jul 2 2015

Kolossos updated subscribers of T103265: Labs: Salvage, then remove volumes on labstores' raid6.
Jul 2 2015, 8:34 PM · Labs-Sprint-105, Labs-Sprint-104, Labs-Sprint-103, Incident-20150617-LabsNFSOutage, Cloud-Services
Kolossos added a comment to T103272: Replacements for a.toolserver.org, b.toolserver.org, c.toolserver.org not available.

I switch the standard tiles to osm.org:
https://tools.wmflabs.org/wiwosm/osm-on-ol/kml-on-ol.php?lang=de&uselang=de&title=Pirna&zoom=11&lat=50.96033&lon=13.94839

Jul 2 2015, 8:26 PM · Cloud-Services

Jun 6 2015

Kolossos updated subscribers of T92963: Fix tool kmlexport.

Hello,
I (Kolossos) and Plenz are only developers for the frontend. We have no access about the backend, also if I asked Para to get access to it.
I believe he code in Python, to query the database about Categories and Subcategories.
So I believe the subcategories are perhaps the performance killer and someone should replace these part of code by using CatGraph or something eise.
Sorry that I'm also very busy in the moment. So perhaps somebody else can help. Perhaps @dschwen has an idea.

Jun 6 2015, 8:32 PM · Software-Licensing, Tools

May 22 2015

Kolossos updated subscribers of T96803: OpenStreetMap on Wikipedia discussion.
May 22 2015, 11:01 AM · Wikimedia-Hackathon-2015

May 18 2015

Kolossos closed T99064: Tool wp-world writes ungodly amounts of logs as Resolved.

Solved.

May 18 2015, 8:53 PM · Toolforge

May 11 2015

Kolossos created T98790: Grants for my Tools-db missing to insert new lines.
May 11 2015, 9:43 PM · Cloud-Services, Toolforge

Mar 19 2015

Kolossos added a comment to T92676: Investigate switching an existing tool (WikiMiniAtlas?) to production tiles.

The idea was to merge Wikiminiatlas and OSM-Gadget[1] to a commons tool that is powered by Leaflet or OpenLayers3.
Now it seems both developers (me and DSchwen) have other things to do. So some support for an update would be nice.
Tiles in WikiminiAtlas have a different projection.

Mar 19 2015, 5:54 PM · Maps

Mar 4 2015

Kolossos added a comment to T57549: [Story] Add a new datatype for geoshapes.

@Kolossos: You're making a very good point about geojson very likely being too big. Do you have recommendations for other ways to store it?

Mar 4 2015, 9:59 PM · Wikidata-Former-Sprint-Board, Patch-For-Review, Story, Need-volunteer, Wikidata, MediaWiki-extensions-WikibaseRepository

Mar 3 2015

Kolossos added a comment to T57549: [Story] Add a new datatype for geoshapes.

I think as big solution we should use OpenStreetMap-Software stack (editor, Database, Rendering and APIs) for our own data. The rules we can change than. A lot of objects like "Interstate5" are already in OpenstreetMap and we have with the project WIWOSM over 400.000 links between these objects and Wikidata. The own OSM-Software should be only for objects that are out of scope from the OpenStreetMap (OSM) project, like fuzzy objects e.g. bird habitats. For historical objects that also out of scope from OSM we are in contact with openhistoricalmap project.

Mar 3 2015, 10:25 PM · Wikidata-Former-Sprint-Board, Patch-For-Review, Story, Need-volunteer, Wikidata, MediaWiki-extensions-WikibaseRepository