Page MenuHomePhabricator

Silverpop import processed twice
Closed, InvalidPublic

Description

The Silverpop import job processed twice on 4/4/17 for some reason. The first time looks like the right number of rows were imported, and the second time looks like it was cut short. @awight suggested I report this since FR-Tech is migrating recurring jobs right now.

Here's the report for the first (successful) job:
File Name: DatabaseUpdate-20170403094030.csv

Job ID: 94442721
Job Type: Recurring Contact Source Import @ Tuesday, April 4, 2017 at 10:06:49 AM GMT
Job Status: Complete
Total Rows: 11438762
Total Valid Rows: 11428630
Total Invalid Addresses: 2186
Total Duplicate Addresses: 98
Total Disallowed Addresses: 7900
Total Bad Data: 46

And for the second job:
File Name: DatabaseUpdate-20170404093922.csv

Job ID: 94442797
Job Type: Recurring Contact Source Import @ Tuesday, April 4, 2017 at 10:07:01 AM GMT
Job Status: Complete
Total Rows: 2741412
Total Valid Rows: 2736683
Total Invalid Addresses: 2082
Total Duplicate Addresses: 40
Total Disallowed Addresses: 2602
Total Bad Data: 45

Event Timeline

ggellerman raised the priority of this task from Low to Medium.Apr 4 2017, 9:15 PM
ggellerman moved this task from Triage to Sprint +1 on the Fundraising-Backlog board.

@CCogdill_WMF , I thought this job was just scheduled for once a day. Or is it triggered by our upload? Has Trilogy made any changes to the import lately?

I believe Silverpop will process any new file on the ftp server in the 3am-4am window, so it ran both files. No recent changes have been made the import; the version we're running has been going since 11/21/16.