Current state:Status:
- Hadoop rebuilt- Reading new store everywhere, up to Q 6025 million
- SQL rebuilt up to Q 50 million
- Everywhere reading- Writing new store up to Q2586 million
Hadoop based Rebuild number 3
- 31 January, Q 1.8 million
- 4 February Q 9 million
- 7 February Q 14.5 million
- 17 February Q 37.5 million
- 23 February Q 44.5 million
- 27 February Q 50 million
- 2 March Q54 million
- 4 March Q60 million
Post Hadoop, SQL based rebuild number 3:
- Fill in gaps missed due to only rebuilding from a select ID list from hadoop
[x] 0-1 million - Addshore did on 18th Feb, (4 deleted item holes left) - https://phabricator.wikimedia.org/P10447 - and some other holes re appearing T219123#5896364
[x] 0-10 million - Addshore did on 20th Feb (8122 item holes left) - https://phabricator.wikimedia.org/P10469TODOs:
[x] 10-20 million - Addshore did on 25th Feb (1292] SQL rebuilt up to Q 86 million (20 million item holes left) - https://phabricator.wikimedia.org/P10517
[x] 20-30 million - Addshore did on 26th Feb (442k holes) TBA how many are] SQL rebuild Q86 million + (1-2 million items left?)
[x] 30-40 million - Addshore did between 3rd & 4th March] Enable writing for "all" items (when created)
[x] 40-50 million - Addshore did between 3rd & 4th March] Final rebuild / catch up from the last migration to the first new item that wrote to the new store
[] 50-end ??????Finish reading from the new store for everything