Page MenuHomePhabricator

Reindex should retry requests for certain error classes
Open, MediumPublic

Description

Noticed that viwiki didn't get reindexed with everything else in the last batch. Looking back through the logs i found:

Reindex task was not successfull: Failed: [{"index":"viwiki_content_1499849366","shard":3,"node":"vD0XklyiQxO59QHMM-wERQ","reason":{"type":"es_rejected_execution_exception","reason":"r
ejected execution of org.elasticsearch.transport.TcpTransport$RequestHandler@26a9eeed on EsThreadPoolExecutor[search, queue capacity = 1000, org.elasticsearch.common.util.concurrent.Es
ThreadPoolExecutor@727a778d[Running, pool size = 32, active threads = 32, queued tasks = 989, completed tasks = 1075697127]]"}}]

Reindex should have seen this and retried a few times, hoping to hit different nodes, rather than giving up and aborting.

Event Timeline

debt triaged this task as Medium priority.May 3 2018, 5:20 PM
debt moved this task from needs triage to Up Next on the Discovery-Search board.
debt subscribed.

Need to fix/repair this error handling, not a huge issue, but needs to be done.

Vvjjkkii renamed this task from Reindex should retry requests for certain error classes to 7qdaaaaaaa.Jul 1 2018, 1:12 AM
Vvjjkkii raised the priority of this task from Medium to High.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed a subscriber: Aklapper.
CommunityTechBot renamed this task from 7qdaaaaaaa to Reindex should retry requests for certain error classes.Jul 1 2018, 8:12 PM
CommunityTechBot lowered the priority of this task from High to Medium.
CommunityTechBot updated the task description. (Show Details)
CommunityTechBot added a subscriber: Aklapper.