Page MenuHomePhabricator
Create Task
Maniphest T347690

[Iceberg Migration] Migrate pageview tables to Iceberg
Open, Needs TriagePublic8 Estimated Story Points
Actions

Description

Migrate pageviews tables to Iceberg format.

https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/Pageviews

See this ticket for details of the referrer_daily migration https://phabricator.wikimedia.org/T335305

Success Criteria

  • Pageviews tables are migrated to Iceberg format (Hive tables will remain for now - there will be a separate ticket to deprecate that will require coordination with consumers)

Related Objects
Search...

Event Timeline

• lbowmaker created this task.Sep 29 2023, 12:58 PM
• lbowmaker moved this task from Data Eng Backlog to Apache Iceberg Migration on the Data Engineering and Event Platform Team board.
Ahoelzl renamed this task from Migrate pageview tables to Iceberg to [Iceberg Migration] Migrate pageview tables to Iceberg.Oct 20 2023, 5:04 PM
Ahoelzl moved this task from Apache Iceberg Migration to Sprint 4 on the Data Engineering and Event Platform Team board.Oct 23 2023, 3:15 PM
Ahoelzl edited projects, added: Data Engineering and Event Platform Team (Sprint 4); removed: Data Engineering and Event Platform Team.
Ahoelzl moved this task from Sprint 4 to Apache Iceberg Migration on the Data Engineering and Event Platform Team board.Oct 23 2023, 3:18 PM
Ahoelzl edited projects, added: Data Engineering and Event Platform Team; removed: Data Engineering and Event Platform Team (Sprint 4).
• lbowmaker edited projects, added: Data-Engineering; removed: Data Pipelines.Nov 10 2023, 1:31 PM
• lbowmaker moved this task from Incoming (new tickets) to Apache Iceberg Migration on the Data-Engineering board.Nov 10 2023, 1:32 PM
• lbowmaker removed a project: Data Engineering and Event Platform Team.Nov 10 2023, 1:34 PM
• lbowmaker moved this task from Apache Iceberg Migration to Sprint 6 on the Data-Engineering board.Dec 4 2023, 3:39 PM
• lbowmaker edited projects, added: Data-Engineering (Sprint 6); removed: Data-Engineering.
• lbowmaker edited projects, added: Data-Engineering (Sprint 7); removed: Data-Engineering (Sprint 6).Jan 8 2024, 7:52 PM
• lbowmaker set the point value for this task to 8.Jan 17 2024, 12:55 PM
• lbowmaker edited projects, added: Data-Engineering (Sprint 8); removed: Data-Engineering (Sprint 7).Jan 30 2024, 12:22 PM
• lbowmaker edited projects, added: Data-Engineering (Sprint 9); removed: Data-Engineering (Sprint 8).Feb 16 2024, 4:17 PM
• lbowmaker moved this task from Sprint 9 to Apache Iceberg Migration on the Data-Engineering board.Feb 19 2024, 2:27 PM
• lbowmaker edited projects, added: Data-Engineering; removed: Data-Engineering (Sprint 9).
• lbowmaker moved this task from Apache Iceberg Migration to Sprint 10 on the Data-Engineering board.Feb 19 2024, 3:19 PM
• lbowmaker edited projects, added: Data-Engineering (Sprint 10); removed: Data-Engineering.
• lbowmaker moved this task from Sprint 10 to Estimated (To be planned) on the Data-Engineering board.Feb 19 2024, 3:30 PM
• lbowmaker edited projects, added: Data-Engineering; removed: Data-Engineering (Sprint 10).
• lbowmaker moved this task from Estimated (To be planned) to Q4 2024 April 1st - June 30th on the Data-Engineering board.Apr 1 2024, 12:31 PM
• lbowmaker edited projects, added: Data-Engineering (Q4 2024 April 1st - June 30th); removed: Data-Engineering.
• lbowmaker moved this task from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.Apr 1 2024, 12:42 PM
• lbowmaker edited projects, added: Data-Engineering; removed: Data-Engineering (Q4 2024 April 1st - June 30th).
Ahoelzl moved this task from Estimated (To be planned) to Tag with Icebox on the Data-Engineering board.Jan 17 2025, 11:56 PM
Ahoelzl added a project: Data-Engineering-Icebox.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits