Some cirrus indices have shards > 30GB. This is starting to cause issue when reallocating them during cluster restart (finding space to allocate 45GB is not entirely trivial). We should probably increase the number of shards for the following indices:
- enwiki_general
- viwiki_general
- wikidatawiki_content
The largest shards are below:
curl -s 'localhost:9200/_cat/shards?h=i,s,sto' | grep gb | sort -k 3 -n | tail -n 60 commonswiki_file_1521735948 10 33.5gb commonswiki_file_1521735948 10 33.5gb commonswiki_file_1521735948 4 33.6gb commonswiki_file_1521735948 4 33.6gb commonswiki_file_1521735948 4 33.6gb commonswiki_file_1521735948 7 33.7gb commonswiki_file_1521735948 7 33.7gb commonswiki_file_1521735948 7 33.8gb commonswiki_file_1521735948 10 34gb wikidatawiki_content_1522105797 6 42.6gb wikidatawiki_content_1522105797 4 43.4gb wikidatawiki_content_1522105797 4 43.4gb wikidatawiki_content_1522105797 6 43.5gb wikidatawiki_content_1522105797 0 43.7gb wikidatawiki_content_1522105797 0 43.8gb wikidatawiki_content_1522105797 0 43.8gb wikidatawiki_content_1522105797 6 44.5gb viwiki_general_1499851663 1 44.6gb viwiki_general_1499851663 1 44.6gb viwiki_general_1499851663 1 44.6gb viwiki_general_1499851663 0 44.7gb viwiki_general_1499851663 0 44.7gb viwiki_general_1499851663 0 44.7gb wikidatawiki_content_1522105797 3 45gb wikidatawiki_content_1522105797 3 45.1gb wikidatawiki_content_1522105797 3 45.2gb enwiki_general_1521866192 6 45.4gb enwiki_general_1521866192 6 45.4gb enwiki_general_1521866192 6 45.4gb enwiki_general_1521866192 5 45.6gb enwiki_general_1521866192 7 45.7gb enwiki_general_1521866192 1 45.8gb enwiki_general_1521866192 2 45.8gb enwiki_general_1521866192 0 45.9gb enwiki_general_1521866192 1 45.9gb enwiki_general_1521866192 1 45.9gb enwiki_general_1521866192 7 45.9gb enwiki_general_1521866192 7 46gb wikidatawiki_content_1522105797 1 46gb enwiki_general_1521866192 4 46.1gb wikidatawiki_content_1522105797 1 46.1gb enwiki_general_1521866192 2 46.2gb enwiki_general_1521866192 2 46.2gb enwiki_general_1521866192 4 46.2gb wikidatawiki_content_1522105797 1 46.2gb wikidatawiki_content_1522105797 5 46.4gb enwiki_general_1521866192 4 46.5gb enwiki_general_1521866192 3 46.7gb enwiki_general_1521866192 3 46.7gb enwiki_general_1521866192 3 46.8gb enwiki_general_1521866192 0 46.9gb enwiki_general_1521866192 5 46.9gb enwiki_general_1521866192 0 47gb enwiki_general_1521866192 5 47.3gb wikidatawiki_content_1522105797 4 47.3gb wikidatawiki_content_1522105797 5 47.4gb wikidatawiki_content_1522105797 5 47.6gb wikidatawiki_content_1522105797 2 48.1gb wikidatawiki_content_1522105797 2 48.1gb wikidatawiki_content_1522105797 2 48.1gb