Page MenuHomePhabricator
Create Task
Maniphest T161635

Storage for banner history data
Closed, DeclinedPublic
Actions

Description

Banner history data for most of the year-end fundraising campaign was extracted from Hive EventLogging tables and is currently stored in a temporary location.

The extracted data is anonymized and approved by legal for retention beyond the 90-day limit.

We'd like to transfer it somewhere that would allow querying... It seems the best option might be to load it back into Hive, if possible, in its own location? Some additional permissions might be needed for this...

We could also consider what mechanism to use to do this on an ongoing basis...

Thanks!!

Related Objects

Event Timeline

• AndyRussG created this task.Mar 28 2017, 5:52 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 28 2017, 5:52 PM
• Nuria subscribed.Mar 28 2017, 5:58 PM

@AndyRussG: can we look at the data to make sure it is safe to retain, the risk normally comes from cross checking datasets and evaluating that risks is something we have to do before we make sure dataset is safe to retain according to our privacy policy. Please be so kind to include us on your communications with legal so we can keep an eye on data coming on the pipeline.

Can you document the contents of original data plus what has been removed/anonymized , we can ping security and establish together whether dataset is safe for long term storage.

• DStrine subscribed.Mar 28 2017, 6:26 PM

@Nuria I just added you to an email about the legal requirements. TLDR: we are allowed to keep the data for now. We need a place to park the data so we can aggregate it. That will allow us to keep it for longer.

Ottomata added a comment.Mar 28 2017, 6:40 PM

FYI, we are planning on improving Hive EventLogging integration next quarter: T153328

• Nuria moved this task from Incoming to Blocked on the Analytics board.Mar 30 2017, 4:00 PM
• DStrine added a comment.Mar 30 2017, 4:11 PM

We are checking some points with legal here: T161656

• ggellerman triaged this task as Medium priority.Apr 4 2017, 9:35 PM
• ggellerman moved this task from Triage to Sprint +1 on the Fundraising-Backlog board.
• DStrine moved this task from Sprint +1 to Q3 2021-2022 on the Fundraising-Backlog board.Oct 24 2017, 5:22 PM
• fdans closed this task as Declined.Jan 4 2018, 5:49 PM
• fdans subscribed.

@DStrine closing this task since there are no new updates. Feel free to reopen and ping us if you get back to it.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits