Page MenuHomePhabricator

Update grouped-wiki files for sqoop
Open, HighPublic

Description

The files used by sqoop are more than 2 years old, and wiki-size used for their grouping has evolved.
I suggest using this opportunity to move from a wiki-grouping to a mappers-definition format, where the file would contain the number of mappers to use for the given wiki.

  • Get new wiki-sizes (esay using mediawiki-history)
  • Update file based on number of mappers (use current grouping values and mappers as example)
  • Update sqoop script to read mappers instead of group

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 26 2019, 8:54 PM
Milimetric triaged this task as High priority.Apr 1 2019, 3:54 PM