Change Details

- perform a full dump of a large wiki through RESTBase, such as enwiki (can use a tool like https://github.com/gwicke/htmldumper) - measure performance of reads in repeat run, after cassandra is filled - would be great to test response times with realistic traffic mix, possibly from the parsoid-lb service; look into getting logs from there & replaying those requests at high speed - could additionally resurrect the old wikitext dump import script (https://github.com/wikimedia/restbase-cassandra/tree/master/test/dump) & test a full wikitext import

- [x] perform a full dump of a large wiki through RESTBase, such as enwiki (can use a tool like https://github.com/gwicke/htmldumper) - done. Size for enwiki with lz4 compression: 70G html, 45G data-parsoid. - [x] measure performance of reads in repeat run, after cassandra is filled - would be great to test response times with realistic traffic mix, possibly from the parsoid-lb service; look into getting logs from there & replaying those requests at high speed - could additionally resurrect the old wikitext dump import script (https://github.com/wikimedia/restbase-cassandra/tree/master/test/dump) & test a full wikitext import

- [x] perform a full dump of a large wiki through RESTBase, such as enwiki (can use a tool like https://github.com/gwicke/htmldumper) - done. Size for enwiki with lz4 compression: 70G html, 45G data-parsoid. - [x] measure performance of reads in repeat run, after cassandra is filled - would be great to test response times with realistic traffic mix, possibly from the parsoid-lb service; look into getting logs from there & replaying those requests at high speed - could additionally resurrect the old wikitext dump import script (https://github.com/wikimedia/restbase-cassandra/tree/master/test/dump) & test a full wikitext import