Maniphest T208001

[Bug] Monthly waterlines import is crashing
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	MSantos
	Oct 25 2018, 9:43 PM

Description

Steps to Reproduce

Log into maps1001.eqiad.wmnet
Read the log under /var/log/waterlines/import.log-*

Expected Results

Import water polygons with success

Actual Results

$ tail -f /var/log/waterlines/import.log-20181002                                                                  
ERROR:  current transaction is aborted, commands ignored until end of transaction block                                               
ERROR:  current transaction is aborted, commands ignored until end of transaction block                                               
ERROR:  current transaction is aborted, commands ignored until end of transaction block                                               
ERROR:  current transaction is aborted, commands ignored until end of transaction block                                               
ERROR:  current transaction is aborted, commands ignored until end of transaction block                                               
ERROR:  current transaction is aborted, commands ignored until end of transaction block                                               
ERROR:  current transaction is aborted, commands ignored until end of transaction block                                               
ROLLBACK
Mon Oct  1 09:14:52 UTC 2018 - waterlines import completed

Environments Observed

maps1001.eqiad.wmfnet

Additional notes

Script import_waterlines seems to be working only for creation since it ran ok on maps1004 initial import.

Related Objects

Mentioned Here: T205462: Load OSM data into maps1004

Event Timeline

MSantos created this task.Oct 25 2018, 9:43 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 25 2018, 9:43 PM

MSantos triaged this task as High priority.Oct 25 2018, 9:44 PM

MSantos moved this task from Needs triage to Needs investigation on the Product-Infrastructure-Team-Backlog-Deprecated board.

This looks like a clue:

ERROR: Geometry SRID (3857) does not match column SRID (900913) (import.log-20181002, line 18)

Same error on maps2001, btw.

MSantos moved this task from Needs investigation to Upcoming on the Product-Infrastructure-Team-Backlog-Deprecated board.Oct 30 2018, 6:36 PM

Depend on https://github.com/kartotherian/osm-bright.tm2source/pull/67 to be deployed on the Jessie cluster which can't be done right now because of the stretch migration T205462: Load OSM data into maps1004.

MSantos moved this task from Upcoming to Kanban on the Product-Infrastructure-Team-Backlog-Deprecated board.Feb 7 2019, 6:16 PM

MSantos edited projects, added Product-Infrastructure-Team-Backlog-Deprecated (Kanban); removed Product-Infrastructure-Team-Backlog-Deprecated.

This problem is not happening anymore in maps100[1-4] (see log below) with the new stretch environment but codfw cluster is not ready yet. I'm reopening and moving it to the "to deploy" column on the kanban because it is fixed and just need the migration/deployment to finish in codfw.

$ tail -f /var/log/waterlines/import.log-20190202                                                         
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
COMMIT
ANALYZE
Fri Feb  1 09:15:48 UTC 2019 - waterlines import completed

MSantos closed this task as Resolved.Apr 12 2019, 4:33 PM

[Bug] Monthly waterlines import is crashingClosed, ResolvedPublicActions