Maniphest T207277

Wait for blocking tasks to finish before running next container script
Open, MediumPublic
Actions

Assigned To

None

Authored By

	Samwalton9-WMF
	Oct 17 2018, 2:04 PM

Description

When the tool is brought up for the first time the database takes a little while to start up, but Docker Compose won't natively wait for the database to finish setup before starting to run the Django app. This results in the app not being able to connect successfully and erroring out. The Scripts container then has the same problem connecting to the app - migrations need to finish running before the script can find the right database table.

To avoid this for now, simply wait for the build to finish, then re-build the containers twice. We should develop a better solution though.

See https://docs.docker.com/compose/startup-order/

The simplest solution would be editing gunicorn.sh and collect_hashtags.py to wait for their dependencies to be ready before running.

Related Objects

Mentioned In: T216393: Database is continually denying access to root@localhost

Event Timeline

Samwalton9-WMF created this task.Oct 17 2018, 2:04 PM

Samwalton9-WMF moved this task from Features to Bugs on the Hashtags board.Oct 19 2018, 2:22 PM

Samwalton9-WMF added a comment.Oct 23 2018, 12:40 PM

This comment was removed by Samwalton9-WMF.

Samwalton9-WMF renamed this task from Wait for database to start before running anything that requires it to Wait for blocking tasks to finish before running next container script.Oct 24 2018, 10:50 AM

Samwalton9-WMF updated the task description. (Show Details)

The app now waits for mysqladmin to return a valid ping before attempting to start and migrate (https://github.com/Samwalton9/hashtags/commit/cebaefec0f8e6bb24dca3648b652306cf4c7c77f).

Still need to fix the script not connecting, but that requires a slightly different fix.

Specifically, the script needs to check that the hashtags_hashtag table exists, and that migrations have finished running, before starting, which is a much more involved check.

Samwalton9-WMF triaged this task as Medium priority.Dec 20 2018, 9:39 PM

Samwalton9-WMF mentioned this in T216393: Database is continually denying access to root@localhost.Feb 22 2019, 9:31 AM

Can this be referenced here ? - https://github.com/Samwalton9/hashtags/issues/26

I got issues while building with docker and had to build it twice for the app to load.

I will try fixing this.

That Github issue doesn't appear to be relevant as it turned out to be a firewall conflict.

Additionally, the first step (app not starting because db isn't ready) should now be fixed by the health check. The remaining step is having the script container wait for migrations to finish on the app container.

Samwalton9-WMF removed PrakharGurunani as the assignee of this task.Jul 5 2019, 11:49 AM

Wait for blocking tasks to finish before running next container scriptOpen, MediumPublicActions

Description

Related Objects

Event Timeline

Wait for blocking tasks to finish before running next container script
Open, MediumPublic
Actions