Page MenuHomePhabricator

make thin_out_key_rev_value_data.js more robust
Closed, ResolvedPublic

Description

restbase-mod-table-cassandra/maintenance/thin_out_key_rev_value_data.js has moved from ad-hoc catch-all script to first-class citizen of late. As such it could use a bit of work:

  • File-based logging
  • Accept command line arguments for the time-span
  • Accept command line argument for Cassandra consistency level
  • More control of paging (at the least, it should be easy to skip a partition without reverse-engineering the driver pageState).
  • ...

Event Timeline

Eevans raised the priority of this task from to Needs Triage.
Eevans updated the task description. (Show Details)
Eevans subscribed.

A lot of this has been implemented in https://github.com/wikimedia/restbase-mod-table-cassandra/pull/129:

  • auto-retry with back-off and reduced consistency
  • commandline accepts pagestate, domain + title *or* token
  • token printed for each deletion to get an idea of progress
GWicke triaged this task as Medium priority.Oct 12 2016, 4:54 PM
GWicke added a project: Services (later).
GWicke set Security to None.
GWicke claimed this task.