This will:
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Dry run for external store | mediawiki/extensions/Flow | master | +41 -4 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Stalled | None | T106386 Compress data at external storage | |||
| Stalled | None | T106388 Audit all existing code to ensure that any extension currently or previously adding blobs to ExternalStore has been registering a reference in the text table (and fix up if wrong) | |||
| Declined | None | T106363 Migrate Flow content to new separate logical External Store in production | |||
| Resolved | • Mattflaschen-WMF | T119568 Run External Store migration for real on Beta | |||
| Resolved | • Mattflaschen-WMF | T119567 Run Flow External Store migration in dry-run mode on Beta | |||
| Resolved | • Mattflaschen-WMF | T119566 Add dry-run mode to Flow External Store migration script | |||
| Resolved | Daimona | T34478 AbuseFilter not setting utf-8 flag | |||
| Resolved | Urbanecm | T246539 Dry-run, then actually run updateVarDumps | |||
| Declined | Daimona | T246938 How to update/delete ExternalStore entries? | |||
| Resolved | Daimona | T252696 Find a good way to run the updateVarDumps script on large wikis |
Change 265524 had a related patch set uploaded (by Mattflaschen):
WIP: Dry run for external store
@jcrespo Do you want to review the dry run patch, or should we just review it in-team?
Checked the script in wmflabs
extensions/Flow/maintenance/FlowExternalStoreMoveCluster.php --wiki='enwiki' --dry-run --from=first_cluster --to=another_cluster Starting dry run Dry run completed
mwscript extensions/Flow/maintenance/FlowExternalStoreMoveCluster.php --wiki='enwiki' --dry-run --from=cluster1 --to=cluster2 Starting dry run Starting dry run batch Old content: Add content LBFactoryMulti::newExternalLB: Unknown cluster "cluster2" flow_revision columns would become: array ( ) New content for ID t2wzag8vz21wpcew does not match prior content. New content: Old content: Add content Terminating dry run.
Starting dry run Starting dry run batch Old content: Add content flow_revision columns would become: array ( 'rev_content' => 'DB://cluster1/5581', 'rev_flags' => 'utf-8,gzip,external,topic-title-wikitext', ) New content for ID t2wzag8vz21wpcew does not match prior content. New content: sLIQH??+I?+ Old content: Add content Terminating dry run.
Good catch, this is actually a bug. It wrongly says the content doesn't match, because the new one is compressed. Not caught locally since it is not compressed there.
Starting dry run Starting dry run batch Old content: Add content flow_revision columns would become: array ( 'rev_content' => 'DB://cluster1/5581', 'rev_flags' => 'utf-8,gzip,external,topic-title-wikitext', ) New content for ID t2wzag8vz21wpcew does not match prior content. New content: sLIQH??+I?+ Old content: Add content Terminating dry run.