Page MenuHomePhabricator
Paste P42712

Airflow sensor log
ActivePublic
Actions

Authored by dcausse on Dec 15 2022, 1:53 PM.
Tags
None
Referenced Files
F35867671: Airflow sensor log
Dec 15 2022, 1:53 PM
Subscribers
None
*** Reading local file: /var/log/airflow/mediawiki_revision_recommendation_create_hourly/wait_for_data/2022-12-14T15:00:00+00:00/1.log
[2022-12-14 16:28:13,261] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:28:13,309] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:28:13,310] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:28:13,310] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:28:13,310] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:28:13,361] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:28:13,365] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310416', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpzo8pxyn_']
[2022-12-14 16:28:14,038] {base_task_runner.py:115} INFO - Job 2310416: Subtask wait_for_data [2022-12-14 16:28:14,038] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=32615
[2022-12-14 16:28:14,790] {base_task_runner.py:115} INFO - Job 2310416: Subtask wait_for_data [2022-12-14 16:28:14,788] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:28:14,791] {base_task_runner.py:115} INFO - Job 2310416: Subtask wait_for_data [2022-12-14 16:28:14,790] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:28:14,925] {base_task_runner.py:115} INFO - Job 2310416: Subtask wait_for_data [2022-12-14 16:28:14,923] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:28:15,203] {logging_mixin.py:112} INFO - [2022-12-14 16:28:15,202] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:28:15,205] {logging_mixin.py:112} INFO - [2022-12-14 16:28:15,205] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:28:15,209] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:28:15,262] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:28:15,387] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:28:18,218] {logging_mixin.py:112} INFO - [2022-12-14 16:28:18,217] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.97169 s
[2022-12-14 16:28:23,199] {logging_mixin.py:112} INFO - [2022-12-14 16:28:23,196] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:31:27,704] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:31:27,765] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:31:27,765] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:31:27,765] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:31:27,765] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:31:27,812] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:31:27,812] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310454', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpy6hf32v_']
[2022-12-14 16:31:28,548] {base_task_runner.py:115} INFO - Job 2310454: Subtask wait_for_data [2022-12-14 16:31:28,547] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=3397
[2022-12-14 16:31:29,782] {base_task_runner.py:115} INFO - Job 2310454: Subtask wait_for_data [2022-12-14 16:31:29,782] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:31:29,783] {base_task_runner.py:115} INFO - Job 2310454: Subtask wait_for_data [2022-12-14 16:31:29,782] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:31:29,916] {base_task_runner.py:115} INFO - Job 2310454: Subtask wait_for_data [2022-12-14 16:31:29,915] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:31:30,177] {logging_mixin.py:112} INFO - [2022-12-14 16:31:30,176] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:31:30,179] {logging_mixin.py:112} INFO - [2022-12-14 16:31:30,179] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:31:30,181] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:31:30,256] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:31:30,364] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:31:32,672] {logging_mixin.py:112} INFO - [2022-12-14 16:31:32,672] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.959856 s
[2022-12-14 16:31:37,635] {logging_mixin.py:112} INFO - [2022-12-14 16:31:37,635] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:34:41,575] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:34:41,617] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:34:41,618] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:34:41,618] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:34:41,618] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:34:41,649] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:34:41,649] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310486', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpcsrwh7qj']
[2022-12-14 16:34:42,201] {base_task_runner.py:115} INFO - Job 2310486: Subtask wait_for_data [2022-12-14 16:34:42,201] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=6114
[2022-12-14 16:34:42,902] {base_task_runner.py:115} INFO - Job 2310486: Subtask wait_for_data [2022-12-14 16:34:42,901] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:34:42,902] {base_task_runner.py:115} INFO - Job 2310486: Subtask wait_for_data [2022-12-14 16:34:42,902] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:34:43,002] {base_task_runner.py:115} INFO - Job 2310486: Subtask wait_for_data [2022-12-14 16:34:43,001] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:34:43,225] {logging_mixin.py:112} INFO - [2022-12-14 16:34:43,225] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:34:43,226] {logging_mixin.py:112} INFO - [2022-12-14 16:34:43,226] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:34:43,228] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:34:43,289] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:34:43,402] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:34:46,535] {logging_mixin.py:112} INFO - [2022-12-14 16:34:46,534] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.965175 s
[2022-12-14 16:34:51,507] {logging_mixin.py:112} INFO - [2022-12-14 16:34:51,505] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:37:48,203] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:37:48,252] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:37:48,252] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:37:48,252] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:37:48,252] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:37:48,298] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:37:48,299] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310513', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp142gh_ck']
[2022-12-14 16:37:48,994] {base_task_runner.py:115} INFO - Job 2310513: Subtask wait_for_data [2022-12-14 16:37:48,993] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=8490
[2022-12-14 16:37:49,691] {base_task_runner.py:115} INFO - Job 2310513: Subtask wait_for_data [2022-12-14 16:37:49,690] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:37:49,691] {base_task_runner.py:115} INFO - Job 2310513: Subtask wait_for_data [2022-12-14 16:37:49,691] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:37:49,817] {base_task_runner.py:115} INFO - Job 2310513: Subtask wait_for_data [2022-12-14 16:37:49,816] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:37:50,106] {logging_mixin.py:112} INFO - [2022-12-14 16:37:50,106] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:37:50,114] {logging_mixin.py:112} INFO - [2022-12-14 16:37:50,114] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:37:50,119] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:37:50,203] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:37:50,353] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:37:53,168] {logging_mixin.py:112} INFO - [2022-12-14 16:37:53,167] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.965698 s
[2022-12-14 16:37:58,136] {logging_mixin.py:112} INFO - [2022-12-14 16:37:58,135] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:41:00,053] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:41:00,107] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:41:00,108] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:41:00,108] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:41:00,108] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:41:00,155] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:41:00,156] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310539', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp__0u5u84']
[2022-12-14 16:41:00,713] {base_task_runner.py:115} INFO - Job 2310539: Subtask wait_for_data [2022-12-14 16:41:00,712] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=10804
[2022-12-14 16:41:01,364] {base_task_runner.py:115} INFO - Job 2310539: Subtask wait_for_data [2022-12-14 16:41:01,363] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:41:01,365] {base_task_runner.py:115} INFO - Job 2310539: Subtask wait_for_data [2022-12-14 16:41:01,364] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:41:01,498] {base_task_runner.py:115} INFO - Job 2310539: Subtask wait_for_data [2022-12-14 16:41:01,496] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:41:01,791] {logging_mixin.py:112} INFO - [2022-12-14 16:41:01,791] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:41:01,793] {logging_mixin.py:112} INFO - [2022-12-14 16:41:01,793] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:41:01,797] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:41:01,870] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:41:02,035] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:41:05,009] {logging_mixin.py:112} INFO - [2022-12-14 16:41:05,009] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.963695 s
[2022-12-14 16:41:09,983] {logging_mixin.py:112} INFO - [2022-12-14 16:41:09,979] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:44:14,156] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:44:14,209] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:44:14,209] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:44:14,209] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:44:14,209] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:44:14,256] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:44:14,256] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310566', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmptgb9tnjx']
[2022-12-14 16:44:14,781] {base_task_runner.py:115} INFO - Job 2310566: Subtask wait_for_data [2022-12-14 16:44:14,780] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=13160
[2022-12-14 16:44:15,430] {base_task_runner.py:115} INFO - Job 2310566: Subtask wait_for_data [2022-12-14 16:44:15,429] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:44:15,432] {base_task_runner.py:115} INFO - Job 2310566: Subtask wait_for_data [2022-12-14 16:44:15,431] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:44:15,535] {base_task_runner.py:115} INFO - Job 2310566: Subtask wait_for_data [2022-12-14 16:44:15,534] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:44:15,792] {logging_mixin.py:112} INFO - [2022-12-14 16:44:15,792] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:44:15,794] {logging_mixin.py:112} INFO - [2022-12-14 16:44:15,793] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:44:15,797] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:44:15,868] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:44:16,011] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:44:19,115] {logging_mixin.py:112} INFO - [2022-12-14 16:44:19,114] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.965268 s
[2022-12-14 16:44:24,087] {logging_mixin.py:112} INFO - [2022-12-14 16:44:24,085] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:47:26,368] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:47:26,413] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:47:26,413] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:47:26,413] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:47:26,413] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:47:26,448] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:47:26,448] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310591', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpuq6o0f84']
[2022-12-14 16:47:27,439] {base_task_runner.py:115} INFO - Job 2310591: Subtask wait_for_data [2022-12-14 16:47:27,439] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=15444
[2022-12-14 16:47:28,120] {base_task_runner.py:115} INFO - Job 2310591: Subtask wait_for_data [2022-12-14 16:47:28,119] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:47:28,121] {base_task_runner.py:115} INFO - Job 2310591: Subtask wait_for_data [2022-12-14 16:47:28,120] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:47:28,229] {base_task_runner.py:115} INFO - Job 2310591: Subtask wait_for_data [2022-12-14 16:47:28,229] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:47:28,489] {logging_mixin.py:112} INFO - [2022-12-14 16:47:28,489] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:47:28,490] {logging_mixin.py:112} INFO - [2022-12-14 16:47:28,490] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:47:28,494] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:47:28,554] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:47:28,684] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:47:31,361] {logging_mixin.py:112} INFO - [2022-12-14 16:47:31,360] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.955029 s
[2022-12-14 16:47:36,320] {logging_mixin.py:112} INFO - [2022-12-14 16:47:36,319] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:50:40,756] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:50:40,807] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:50:40,808] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:50:40,808] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:50:40,808] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:50:40,856] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:50:40,857] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310617', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpfudx9rvc']
[2022-12-14 16:50:41,492] {base_task_runner.py:115} INFO - Job 2310617: Subtask wait_for_data [2022-12-14 16:50:41,492] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=17845
[2022-12-14 16:50:42,135] {base_task_runner.py:115} INFO - Job 2310617: Subtask wait_for_data [2022-12-14 16:50:42,134] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:50:42,136] {base_task_runner.py:115} INFO - Job 2310617: Subtask wait_for_data [2022-12-14 16:50:42,135] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:50:42,243] {base_task_runner.py:115} INFO - Job 2310617: Subtask wait_for_data [2022-12-14 16:50:42,242] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:50:42,549] {logging_mixin.py:112} INFO - [2022-12-14 16:50:42,549] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:50:42,551] {logging_mixin.py:112} INFO - [2022-12-14 16:50:42,551] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:50:42,555] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:50:42,619] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:50:42,768] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:50:45,696] {logging_mixin.py:112} INFO - [2022-12-14 16:50:45,695] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.967544 s
[2022-12-14 16:50:50,671] {logging_mixin.py:112} INFO - [2022-12-14 16:50:50,669] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:53:53,130] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:53:53,181] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:53:53,181] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:53:53,181] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:53:53,181] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:53:53,227] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:53:53,227] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310642', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpvac4lzlj']
[2022-12-14 16:53:53,788] {base_task_runner.py:115} INFO - Job 2310642: Subtask wait_for_data [2022-12-14 16:53:53,787] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=20230
[2022-12-14 16:53:54,472] {base_task_runner.py:115} INFO - Job 2310642: Subtask wait_for_data [2022-12-14 16:53:54,471] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:53:54,472] {base_task_runner.py:115} INFO - Job 2310642: Subtask wait_for_data [2022-12-14 16:53:54,471] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:53:54,572] {base_task_runner.py:115} INFO - Job 2310642: Subtask wait_for_data [2022-12-14 16:53:54,572] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:53:54,825] {logging_mixin.py:112} INFO - [2022-12-14 16:53:54,824] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:53:54,829] {logging_mixin.py:112} INFO - [2022-12-14 16:53:54,828] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:53:54,832] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:53:54,904] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:53:55,048] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:53:58,079] {logging_mixin.py:112} INFO - [2022-12-14 16:53:58,078] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.962077 s
[2022-12-14 16:54:03,048] {logging_mixin.py:112} INFO - [2022-12-14 16:54:03,044] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 16:56:59,843] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:56:59,901] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 16:56:59,902] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:56:59,902] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 16:56:59,902] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 16:56:59,970] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 16:56:59,970] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310665', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp03vdcbvm']
[2022-12-14 16:57:00,662] {base_task_runner.py:115} INFO - Job 2310665: Subtask wait_for_data [2022-12-14 16:57:00,661] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=25095
[2022-12-14 16:57:01,597] {base_task_runner.py:115} INFO - Job 2310665: Subtask wait_for_data [2022-12-14 16:57:01,595] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 16:57:01,597] {base_task_runner.py:115} INFO - Job 2310665: Subtask wait_for_data [2022-12-14 16:57:01,596] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 16:57:01,696] {base_task_runner.py:115} INFO - Job 2310665: Subtask wait_for_data [2022-12-14 16:57:01,695] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 16:57:01,987] {logging_mixin.py:112} INFO - [2022-12-14 16:57:01,986] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:57:01,989] {logging_mixin.py:112} INFO - [2022-12-14 16:57:01,988] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 16:57:01,993] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 16:57:02,064] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 16:57:02,219] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 16:57:04,388] {logging_mixin.py:112} INFO - [2022-12-14 16:57:04,387] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.960811 s
[2022-12-14 16:57:09,356] {logging_mixin.py:112} INFO - [2022-12-14 16:57:09,354] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:15:26,675] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:15:26,724] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:15:26,724] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:15:26,724] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:15:26,724] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:15:26,766] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:15:26,767] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310696', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpda_ahg4p']
[2022-12-14 17:15:27,577] {base_task_runner.py:115} INFO - Job 2310696: Subtask wait_for_data [2022-12-14 17:15:27,576] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=4752
[2022-12-14 17:15:28,310] {base_task_runner.py:115} INFO - Job 2310696: Subtask wait_for_data [2022-12-14 17:15:28,309] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:15:28,311] {base_task_runner.py:115} INFO - Job 2310696: Subtask wait_for_data [2022-12-14 17:15:28,310] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:15:28,409] {base_task_runner.py:115} INFO - Job 2310696: Subtask wait_for_data [2022-12-14 17:15:28,408] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:15:28,669] {logging_mixin.py:112} INFO - [2022-12-14 17:15:28,668] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:15:28,671] {logging_mixin.py:112} INFO - [2022-12-14 17:15:28,671] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:15:28,676] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:15:28,738] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:15:28,877] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:15:31,665] {logging_mixin.py:112} INFO - [2022-12-14 17:15:31,664] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.96108 s
[2022-12-14 17:15:36,636] {logging_mixin.py:112} INFO - [2022-12-14 17:15:36,633] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:18:40,818] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:18:40,867] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:18:40,868] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:18:40,868] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:18:40,868] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:18:40,913] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:18:40,914] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310720', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpypo7dtjf']
[2022-12-14 17:18:41,477] {base_task_runner.py:115} INFO - Job 2310720: Subtask wait_for_data [2022-12-14 17:18:41,476] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=7103
[2022-12-14 17:18:42,190] {base_task_runner.py:115} INFO - Job 2310720: Subtask wait_for_data [2022-12-14 17:18:42,188] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:18:42,191] {base_task_runner.py:115} INFO - Job 2310720: Subtask wait_for_data [2022-12-14 17:18:42,190] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:18:42,377] {base_task_runner.py:115} INFO - Job 2310720: Subtask wait_for_data [2022-12-14 17:18:42,376] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:18:42,719] {logging_mixin.py:112} INFO - [2022-12-14 17:18:42,718] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:18:42,720] {logging_mixin.py:112} INFO - [2022-12-14 17:18:42,720] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:18:42,723] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:18:42,792] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:18:42,946] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:18:45,756] {logging_mixin.py:112} INFO - [2022-12-14 17:18:45,756] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.969905 s
[2022-12-14 17:18:50,735] {logging_mixin.py:112} INFO - [2022-12-14 17:18:50,732] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:21:55,105] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:21:55,157] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:21:55,158] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:21:55,158] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:21:55,158] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:21:55,203] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:21:55,204] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310747', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp1n9zl_uc']
[2022-12-14 17:21:55,727] {base_task_runner.py:115} INFO - Job 2310747: Subtask wait_for_data [2022-12-14 17:21:55,726] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=9536
[2022-12-14 17:21:56,381] {base_task_runner.py:115} INFO - Job 2310747: Subtask wait_for_data [2022-12-14 17:21:56,380] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:21:56,381] {base_task_runner.py:115} INFO - Job 2310747: Subtask wait_for_data [2022-12-14 17:21:56,381] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:21:56,500] {base_task_runner.py:115} INFO - Job 2310747: Subtask wait_for_data [2022-12-14 17:21:56,498] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:21:56,781] {logging_mixin.py:112} INFO - [2022-12-14 17:21:56,781] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:21:56,784] {logging_mixin.py:112} INFO - [2022-12-14 17:21:56,783] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:21:56,788] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:21:56,863] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:21:57,000] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:22:00,056] {logging_mixin.py:112} INFO - [2022-12-14 17:22:00,056] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.964992 s
[2022-12-14 17:22:05,031] {logging_mixin.py:112} INFO - [2022-12-14 17:22:05,026] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:25:09,133] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:25:09,187] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:25:09,188] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:25:09,188] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:25:09,188] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:25:09,235] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:25:09,235] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310772', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpkb_e4883']
[2022-12-14 17:25:10,057] {base_task_runner.py:115} INFO - Job 2310772: Subtask wait_for_data [2022-12-14 17:25:10,057] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=12543
[2022-12-14 17:25:10,742] {base_task_runner.py:115} INFO - Job 2310772: Subtask wait_for_data [2022-12-14 17:25:10,741] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:25:10,742] {base_task_runner.py:115} INFO - Job 2310772: Subtask wait_for_data [2022-12-14 17:25:10,742] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:25:10,843] {base_task_runner.py:115} INFO - Job 2310772: Subtask wait_for_data [2022-12-14 17:25:10,842] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:25:11,107] {logging_mixin.py:112} INFO - [2022-12-14 17:25:11,106] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:25:11,109] {logging_mixin.py:112} INFO - [2022-12-14 17:25:11,108] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:25:11,113] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:25:11,174] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:25:11,308] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:25:14,089] {logging_mixin.py:112} INFO - [2022-12-14 17:25:14,088] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.967823 s
[2022-12-14 17:25:19,059] {logging_mixin.py:112} INFO - [2022-12-14 17:25:19,059] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:28:23,620] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:28:23,658] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:28:23,658] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:28:23,658] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:28:23,658] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:28:23,683] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:28:23,683] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310806', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp_lokdagb']
[2022-12-14 17:28:24,555] {base_task_runner.py:115} INFO - Job 2310806: Subtask wait_for_data [2022-12-14 17:28:24,554] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=17473
[2022-12-14 17:28:25,275] {base_task_runner.py:115} INFO - Job 2310806: Subtask wait_for_data [2022-12-14 17:28:25,273] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:28:25,276] {base_task_runner.py:115} INFO - Job 2310806: Subtask wait_for_data [2022-12-14 17:28:25,275] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:28:25,340] {base_task_runner.py:115} INFO - Job 2310806: Subtask wait_for_data [2022-12-14 17:28:25,340] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:28:25,521] {logging_mixin.py:112} INFO - [2022-12-14 17:28:25,521] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:28:25,522] {logging_mixin.py:112} INFO - [2022-12-14 17:28:25,522] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:28:25,524] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:28:25,574] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:28:25,672] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:28:28,598] {logging_mixin.py:112} INFO - [2022-12-14 17:28:28,597] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.9613 s
[2022-12-14 17:28:33,564] {logging_mixin.py:112} INFO - [2022-12-14 17:28:33,563] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:31:35,791] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:31:35,842] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:31:35,843] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:31:35,843] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:31:35,843] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:31:35,890] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:31:35,890] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310839', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpqe44jdsv']
[2022-12-14 17:31:36,458] {base_task_runner.py:115} INFO - Job 2310839: Subtask wait_for_data [2022-12-14 17:31:36,457] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=20110
[2022-12-14 17:31:37,105] {base_task_runner.py:115} INFO - Job 2310839: Subtask wait_for_data [2022-12-14 17:31:37,104] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:31:37,105] {base_task_runner.py:115} INFO - Job 2310839: Subtask wait_for_data [2022-12-14 17:31:37,105] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:31:37,182] {base_task_runner.py:115} INFO - Job 2310839: Subtask wait_for_data [2022-12-14 17:31:37,182] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:31:37,420] {logging_mixin.py:112} INFO - [2022-12-14 17:31:37,420] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:31:37,422] {logging_mixin.py:112} INFO - [2022-12-14 17:31:37,422] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:31:37,426] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:31:37,483] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:31:37,609] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:31:40,728] {logging_mixin.py:112} INFO - [2022-12-14 17:31:40,728] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.957101 s
[2022-12-14 17:31:45,692] {logging_mixin.py:112} INFO - [2022-12-14 17:31:45,691] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:34:46,101] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:34:46,158] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:34:46,159] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:34:46,159] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:34:46,159] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:34:46,206] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:34:46,206] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310865', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpl8z0xn1y']
[2022-12-14 17:34:46,758] {base_task_runner.py:115} INFO - Job 2310865: Subtask wait_for_data [2022-12-14 17:34:46,758] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=22509
[2022-12-14 17:34:47,464] {base_task_runner.py:115} INFO - Job 2310865: Subtask wait_for_data [2022-12-14 17:34:47,463] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:34:47,464] {base_task_runner.py:115} INFO - Job 2310865: Subtask wait_for_data [2022-12-14 17:34:47,464] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:34:47,549] {base_task_runner.py:115} INFO - Job 2310865: Subtask wait_for_data [2022-12-14 17:34:47,548] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:34:47,766] {logging_mixin.py:112} INFO - [2022-12-14 17:34:47,766] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:34:47,768] {logging_mixin.py:112} INFO - [2022-12-14 17:34:47,768] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:34:47,770] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:34:47,833] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:34:47,962] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:34:51,079] {logging_mixin.py:112} INFO - [2022-12-14 17:34:51,079] {local_task_job.py:124} WARNING - Time since last heartbeat(0.05 s) < heartrate(5.0 s), sleeping for 4.948886 s
[2022-12-14 17:34:56,038] {logging_mixin.py:112} INFO - [2022-12-14 17:34:56,034] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:37:58,458] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:37:58,510] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:37:58,510] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:37:58,510] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:37:58,510] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:37:58,540] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:37:58,541] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310893', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp9nlowihz']
[2022-12-14 17:37:59,209] {base_task_runner.py:115} INFO - Job 2310893: Subtask wait_for_data [2022-12-14 17:37:59,209] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=25233
[2022-12-14 17:38:00,112] {base_task_runner.py:115} INFO - Job 2310893: Subtask wait_for_data [2022-12-14 17:38:00,111] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:38:00,113] {base_task_runner.py:115} INFO - Job 2310893: Subtask wait_for_data [2022-12-14 17:38:00,112] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:38:00,187] {base_task_runner.py:115} INFO - Job 2310893: Subtask wait_for_data [2022-12-14 17:38:00,187] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:38:00,368] {logging_mixin.py:112} INFO - [2022-12-14 17:38:00,368] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:38:00,369] {logging_mixin.py:112} INFO - [2022-12-14 17:38:00,369] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:38:00,372] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:38:00,415] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:38:00,538] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:38:03,406] {logging_mixin.py:112} INFO - [2022-12-14 17:38:03,406] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.959122 s
[2022-12-14 17:38:08,372] {logging_mixin.py:112} INFO - [2022-12-14 17:38:08,371] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:41:04,480] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:41:04,536] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:41:04,537] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:41:04,537] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:41:04,537] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:41:04,586] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:41:04,587] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310917', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmph9hdjn0y']
[2022-12-14 17:41:05,273] {base_task_runner.py:115} INFO - Job 2310917: Subtask wait_for_data [2022-12-14 17:41:05,272] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=27489
[2022-12-14 17:41:06,087] {base_task_runner.py:115} INFO - Job 2310917: Subtask wait_for_data [2022-12-14 17:41:06,086] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:41:06,087] {base_task_runner.py:115} INFO - Job 2310917: Subtask wait_for_data [2022-12-14 17:41:06,087] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:41:06,196] {base_task_runner.py:115} INFO - Job 2310917: Subtask wait_for_data [2022-12-14 17:41:06,195] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:41:06,444] {logging_mixin.py:112} INFO - [2022-12-14 17:41:06,444] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:41:06,446] {logging_mixin.py:112} INFO - [2022-12-14 17:41:06,446] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:41:06,450] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:41:06,514] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:41:06,649] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:41:09,496] {logging_mixin.py:112} INFO - [2022-12-14 17:41:09,496] {local_task_job.py:124} WARNING - Time since last heartbeat(0.05 s) < heartrate(5.0 s), sleeping for 4.946072 s
[2022-12-14 17:41:14,451] {logging_mixin.py:112} INFO - [2022-12-14 17:41:14,447] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:44:18,739] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:44:18,796] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:44:18,796] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:44:18,796] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:44:18,796] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:44:18,856] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:44:18,856] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310943', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpr2mjp2kq']
[2022-12-14 17:44:19,369] {base_task_runner.py:115} INFO - Job 2310943: Subtask wait_for_data [2022-12-14 17:44:19,368] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=29819
[2022-12-14 17:44:20,093] {base_task_runner.py:115} INFO - Job 2310943: Subtask wait_for_data [2022-12-14 17:44:20,091] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:44:20,094] {base_task_runner.py:115} INFO - Job 2310943: Subtask wait_for_data [2022-12-14 17:44:20,093] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:44:20,204] {base_task_runner.py:115} INFO - Job 2310943: Subtask wait_for_data [2022-12-14 17:44:20,203] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:44:20,493] {logging_mixin.py:112} INFO - [2022-12-14 17:44:20,492] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:44:20,494] {logging_mixin.py:112} INFO - [2022-12-14 17:44:20,494] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:44:20,496] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:44:20,559] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:44:20,700] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:44:23,694] {logging_mixin.py:112} INFO - [2022-12-14 17:44:23,694] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.968176 s
[2022-12-14 17:44:28,670] {logging_mixin.py:112} INFO - [2022-12-14 17:44:28,668] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:47:30,888] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:47:30,940] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:47:30,940] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:47:30,941] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:47:30,941] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:47:30,989] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:47:30,989] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310969', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpzv0th2pl']
[2022-12-14 17:47:31,569] {base_task_runner.py:115} INFO - Job 2310969: Subtask wait_for_data [2022-12-14 17:47:31,568] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=32136
[2022-12-14 17:47:32,237] {base_task_runner.py:115} INFO - Job 2310969: Subtask wait_for_data [2022-12-14 17:47:32,236] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:47:32,238] {base_task_runner.py:115} INFO - Job 2310969: Subtask wait_for_data [2022-12-14 17:47:32,237] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:47:32,332] {base_task_runner.py:115} INFO - Job 2310969: Subtask wait_for_data [2022-12-14 17:47:32,331] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:47:32,567] {logging_mixin.py:112} INFO - [2022-12-14 17:47:32,567] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:47:32,570] {logging_mixin.py:112} INFO - [2022-12-14 17:47:32,569] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:47:32,575] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:47:32,636] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:47:32,778] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:47:35,858] {logging_mixin.py:112} INFO - [2022-12-14 17:47:35,857] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.959567 s
[2022-12-14 17:47:40,824] {logging_mixin.py:112} INFO - [2022-12-14 17:47:40,823] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:50:36,950] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:50:37,000] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:50:37,001] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:50:37,001] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:50:37,001] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:50:37,049] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:50:37,049] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2310992', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp2o4vav75']
[2022-12-14 17:50:37,773] {base_task_runner.py:115} INFO - Job 2310992: Subtask wait_for_data [2022-12-14 17:50:37,773] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=1949
[2022-12-14 17:50:38,718] {base_task_runner.py:115} INFO - Job 2310992: Subtask wait_for_data [2022-12-14 17:50:38,717] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:50:38,718] {base_task_runner.py:115} INFO - Job 2310992: Subtask wait_for_data [2022-12-14 17:50:38,718] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:50:38,833] {base_task_runner.py:115} INFO - Job 2310992: Subtask wait_for_data [2022-12-14 17:50:38,833] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:50:39,110] {logging_mixin.py:112} INFO - [2022-12-14 17:50:39,109] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:50:39,112] {logging_mixin.py:112} INFO - [2022-12-14 17:50:39,111] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:50:39,115] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:50:39,192] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:50:39,325] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:50:41,889] {logging_mixin.py:112} INFO - [2022-12-14 17:50:41,889] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.968491 s
[2022-12-14 17:50:46,867] {logging_mixin.py:112} INFO - [2022-12-14 17:50:46,863] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:53:49,295] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:53:49,352] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:53:49,353] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:53:49,353] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:53:49,353] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:53:49,401] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:53:49,402] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311017', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpy11x5s2a']
[2022-12-14 17:53:49,964] {base_task_runner.py:115} INFO - Job 2311017: Subtask wait_for_data [2022-12-14 17:53:49,964] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=4297
[2022-12-14 17:53:50,751] {base_task_runner.py:115} INFO - Job 2311017: Subtask wait_for_data [2022-12-14 17:53:50,751] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:53:50,752] {base_task_runner.py:115} INFO - Job 2311017: Subtask wait_for_data [2022-12-14 17:53:50,751] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:53:50,821] {base_task_runner.py:115} INFO - Job 2311017: Subtask wait_for_data [2022-12-14 17:53:50,821] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:53:51,069] {logging_mixin.py:112} INFO - [2022-12-14 17:53:51,069] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:53:51,071] {logging_mixin.py:112} INFO - [2022-12-14 17:53:51,071] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:53:51,075] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:53:51,134] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:53:51,269] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:53:54,262] {logging_mixin.py:112} INFO - [2022-12-14 17:53:54,261] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.958146 s
[2022-12-14 17:53:59,230] {logging_mixin.py:112} INFO - [2022-12-14 17:53:59,226] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 17:56:55,597] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:56:55,659] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 17:56:55,660] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:56:55,660] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 17:56:55,660] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 17:56:55,702] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 17:56:55,702] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311040', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp4p2aj7ow']
[2022-12-14 17:56:56,306] {base_task_runner.py:115} INFO - Job 2311040: Subtask wait_for_data [2022-12-14 17:56:56,305] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=9024
[2022-12-14 17:56:57,085] {base_task_runner.py:115} INFO - Job 2311040: Subtask wait_for_data [2022-12-14 17:56:57,084] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 17:56:57,085] {base_task_runner.py:115} INFO - Job 2311040: Subtask wait_for_data [2022-12-14 17:56:57,085] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 17:56:57,172] {base_task_runner.py:115} INFO - Job 2311040: Subtask wait_for_data [2022-12-14 17:56:57,172] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 17:56:57,400] {logging_mixin.py:112} INFO - [2022-12-14 17:56:57,400] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:56:57,406] {logging_mixin.py:112} INFO - [2022-12-14 17:56:57,406] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 17:56:57,411] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 17:56:57,475] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 17:56:57,602] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 17:57:00,571] {logging_mixin.py:112} INFO - [2022-12-14 17:57:00,570] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.965097 s
[2022-12-14 17:57:05,539] {logging_mixin.py:112} INFO - [2022-12-14 17:57:05,539] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:00:09,549] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:00:09,602] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:00:09,603] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:00:09,603] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:00:09,603] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:00:09,663] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:00:09,663] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311065', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpmxsf08bs']
[2022-12-14 18:00:10,189] {base_task_runner.py:115} INFO - Job 2311065: Subtask wait_for_data [2022-12-14 18:00:10,189] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=11417
[2022-12-14 18:00:10,933] {base_task_runner.py:115} INFO - Job 2311065: Subtask wait_for_data [2022-12-14 18:00:10,932] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:00:10,933] {base_task_runner.py:115} INFO - Job 2311065: Subtask wait_for_data [2022-12-14 18:00:10,933] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:00:11,013] {base_task_runner.py:115} INFO - Job 2311065: Subtask wait_for_data [2022-12-14 18:00:11,013] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:00:11,260] {logging_mixin.py:112} INFO - [2022-12-14 18:00:11,259] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:00:11,261] {logging_mixin.py:112} INFO - [2022-12-14 18:00:11,261] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:00:11,264] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:00:11,325] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:00:11,451] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 18:00:14,518] {logging_mixin.py:112} INFO - [2022-12-14 18:00:14,517] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.957629 s
[2022-12-14 18:00:19,485] {logging_mixin.py:112} INFO - [2022-12-14 18:00:19,482] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:03:21,733] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:03:21,783] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:03:21,783] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:03:21,783] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:03:21,784] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:03:21,825] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:03:21,826] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311091', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp0rw8kyz0']
[2022-12-14 18:03:22,435] {base_task_runner.py:115} INFO - Job 2311091: Subtask wait_for_data [2022-12-14 18:03:22,435] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=13753
[2022-12-14 18:03:23,213] {base_task_runner.py:115} INFO - Job 2311091: Subtask wait_for_data [2022-12-14 18:03:23,213] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:03:23,214] {base_task_runner.py:115} INFO - Job 2311091: Subtask wait_for_data [2022-12-14 18:03:23,213] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:03:23,295] {base_task_runner.py:115} INFO - Job 2311091: Subtask wait_for_data [2022-12-14 18:03:23,294] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:03:23,530] {logging_mixin.py:112} INFO - [2022-12-14 18:03:23,530] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:03:23,532] {logging_mixin.py:112} INFO - [2022-12-14 18:03:23,532] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:03:23,533] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:03:23,591] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:03:23,678] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 18:03:26,697] {logging_mixin.py:112} INFO - [2022-12-14 18:03:26,697] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.956923 s
[2022-12-14 18:03:31,660] {logging_mixin.py:112} INFO - [2022-12-14 18:03:31,660] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:06:30,084] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:06:30,137] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:06:30,137] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:06:30,137] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:06:30,137] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:06:30,184] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:06:30,185] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311115', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp68ugtrtn']
[2022-12-14 18:06:30,763] {base_task_runner.py:115} INFO - Job 2311115: Subtask wait_for_data [2022-12-14 18:06:30,762] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=16054
[2022-12-14 18:06:31,895] {base_task_runner.py:115} INFO - Job 2311115: Subtask wait_for_data [2022-12-14 18:06:31,894] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:06:31,896] {base_task_runner.py:115} INFO - Job 2311115: Subtask wait_for_data [2022-12-14 18:06:31,896] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:06:31,994] {base_task_runner.py:115} INFO - Job 2311115: Subtask wait_for_data [2022-12-14 18:06:31,993] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:06:32,256] {logging_mixin.py:112} INFO - [2022-12-14 18:06:32,255] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:06:32,257] {logging_mixin.py:112} INFO - [2022-12-14 18:06:32,257] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:06:32,260] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:06:32,328] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:06:32,442] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 18:06:35,057] {logging_mixin.py:112} INFO - [2022-12-14 18:06:35,056] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.959724 s
[2022-12-14 18:06:40,023] {logging_mixin.py:112} INFO - [2022-12-14 18:06:40,019] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:09:44,160] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:09:44,218] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:09:44,219] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:09:44,219] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:09:44,219] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:09:44,263] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:09:44,264] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311141', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp1g27e_k4']
[2022-12-14 18:09:44,782] {base_task_runner.py:115} INFO - Job 2311141: Subtask wait_for_data [2022-12-14 18:09:44,782] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=18402
[2022-12-14 18:09:45,620] {base_task_runner.py:115} INFO - Job 2311141: Subtask wait_for_data [2022-12-14 18:09:45,619] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:09:45,620] {base_task_runner.py:115} INFO - Job 2311141: Subtask wait_for_data [2022-12-14 18:09:45,620] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:09:45,700] {base_task_runner.py:115} INFO - Job 2311141: Subtask wait_for_data [2022-12-14 18:09:45,700] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:09:45,935] {logging_mixin.py:112} INFO - [2022-12-14 18:09:45,935] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:09:45,936] {logging_mixin.py:112} INFO - [2022-12-14 18:09:45,936] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:09:45,938] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:09:45,997] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:09:46,137] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 18:09:49,125] {logging_mixin.py:112} INFO - [2022-12-14 18:09:49,124] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.957259 s
[2022-12-14 18:09:54,089] {logging_mixin.py:112} INFO - [2022-12-14 18:09:54,088] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:12:56,462] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:12:56,528] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:12:56,528] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:12:56,528] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:12:56,528] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:12:56,575] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:12:56,576] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311167', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpq5f3li27']
[2022-12-14 18:12:57,158] {base_task_runner.py:115} INFO - Job 2311167: Subtask wait_for_data [2022-12-14 18:12:57,157] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=20757
[2022-12-14 18:12:57,909] {base_task_runner.py:115} INFO - Job 2311167: Subtask wait_for_data [2022-12-14 18:12:57,908] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:12:57,910] {base_task_runner.py:115} INFO - Job 2311167: Subtask wait_for_data [2022-12-14 18:12:57,910] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:12:58,004] {base_task_runner.py:115} INFO - Job 2311167: Subtask wait_for_data [2022-12-14 18:12:58,003] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:12:58,258] {logging_mixin.py:112} INFO - [2022-12-14 18:12:58,257] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:12:58,260] {logging_mixin.py:112} INFO - [2022-12-14 18:12:58,260] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:12:58,263] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:12:58,327] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:12:58,446] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 18:13:01,410] {logging_mixin.py:112} INFO - [2022-12-14 18:13:01,410] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.968588 s
[2022-12-14 18:13:06,385] {logging_mixin.py:112} INFO - [2022-12-14 18:13:06,383] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:16:10,701] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:16:10,758] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:16:10,758] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:16:10,758] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:16:10,758] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:16:10,807] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:16:10,808] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311192', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpbj4zngf1']
[2022-12-14 18:16:11,345] {base_task_runner.py:115} INFO - Job 2311192: Subtask wait_for_data [2022-12-14 18:16:11,345] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=23114
[2022-12-14 18:16:12,083] {base_task_runner.py:115} INFO - Job 2311192: Subtask wait_for_data [2022-12-14 18:16:12,078] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:16:12,083] {base_task_runner.py:115} INFO - Job 2311192: Subtask wait_for_data [2022-12-14 18:16:12,079] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:16:12,181] {base_task_runner.py:115} INFO - Job 2311192: Subtask wait_for_data [2022-12-14 18:16:12,180] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:16:12,398] {logging_mixin.py:112} INFO - [2022-12-14 18:16:12,398] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:16:12,401] {logging_mixin.py:112} INFO - [2022-12-14 18:16:12,401] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:16:12,403] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:16:12,460] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:16:12,589] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 18:16:15,653] {logging_mixin.py:112} INFO - [2022-12-14 18:16:15,652] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.966842 s
[2022-12-14 18:16:20,628] {logging_mixin.py:112} INFO - [2022-12-14 18:16:20,625] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:19:17,065] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:19:17,120] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:19:17,120] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:19:17,121] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:19:17,121] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:19:17,164] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:19:17,165] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311217', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmp93_tx_78']
[2022-12-14 18:19:18,043] {base_task_runner.py:115} INFO - Job 2311217: Subtask wait_for_data [2022-12-14 18:19:18,043] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=25354
[2022-12-14 18:19:19,159] {base_task_runner.py:115} INFO - Job 2311217: Subtask wait_for_data [2022-12-14 18:19:19,158] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:19:19,160] {base_task_runner.py:115} INFO - Job 2311217: Subtask wait_for_data [2022-12-14 18:19:19,159] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:19:19,270] {base_task_runner.py:115} INFO - Job 2311217: Subtask wait_for_data [2022-12-14 18:19:19,270] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:19:19,555] {logging_mixin.py:112} INFO - [2022-12-14 18:19:19,554] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:19:19,557] {logging_mixin.py:112} INFO - [2022-12-14 18:19:19,556] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:19:19,560] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:19:19,626] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:19:19,794] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 18:19:22,035] {logging_mixin.py:112} INFO - [2022-12-14 18:19:22,035] {local_task_job.py:124} WARNING - Time since last heartbeat(0.03 s) < heartrate(5.0 s), sleeping for 4.966025 s
[2022-12-14 18:19:27,004] {logging_mixin.py:112} INFO - [2022-12-14 18:19:27,003] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:22:30,990] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:22:31,033] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:22:31,033] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:22:31,033] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:22:31,033] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:22:31,070] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:22:31,070] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311243', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpsezfz3a8']
[2022-12-14 18:22:31,575] {base_task_runner.py:115} INFO - Job 2311243: Subtask wait_for_data [2022-12-14 18:22:31,575] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=27736
[2022-12-14 18:22:32,269] {base_task_runner.py:115} INFO - Job 2311243: Subtask wait_for_data [2022-12-14 18:22:32,269] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:22:32,270] {base_task_runner.py:115} INFO - Job 2311243: Subtask wait_for_data [2022-12-14 18:22:32,269] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:22:32,341] {base_task_runner.py:115} INFO - Job 2311243: Subtask wait_for_data [2022-12-14 18:22:32,341] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:22:32,584] {logging_mixin.py:112} INFO - [2022-12-14 18:22:32,584] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:22:32,586] {logging_mixin.py:112} INFO - [2022-12-14 18:22:32,586] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:22:32,588] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:22:32,648] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:22:32,776] {taskinstance.py:1054} INFO - Rescheduling task, marking task as UP_FOR_RESCHEDULE
[2022-12-14 18:22:35,971] {logging_mixin.py:112} INFO - [2022-12-14 18:22:35,971] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.95958 s
[2022-12-14 18:22:40,940] {logging_mixin.py:112} INFO - [2022-12-14 18:22:40,937] {local_task_job.py:103} INFO - Task exited with return code 0
[2022-12-14 18:25:45,376] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:25:45,430] {taskinstance.py:630} INFO - Dependencies all met for <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [queued]>
[2022-12-14 18:25:45,431] {taskinstance.py:841} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:25:45,431] {taskinstance.py:842} INFO - Starting attempt 1 of 5
[2022-12-14 18:25:45,431] {taskinstance.py:843} INFO -
--------------------------------------------------------------------------------
[2022-12-14 18:25:45,479] {taskinstance.py:862} INFO - Executing <Task(NamedHivePartitionSensor): wait_for_data> on 2022-12-14T15:00:00+00:00
[2022-12-14 18:25:45,479] {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'mediawiki_revision_recommendation_create_hourly', 'wait_for_data', '2022-12-14T15:00:00+00:00', '--job_id', '2311270', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/mediawiki_revision_recommendation_create.py', '--cfg_path', '/tmp/tmpymzjynuf']
[2022-12-14 18:25:46,170] {base_task_runner.py:115} INFO - Job 2311270: Subtask wait_for_data [2022-12-14 18:25:46,169] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=32566
[2022-12-14 18:25:47,164] {base_task_runner.py:115} INFO - Job 2311270: Subtask wait_for_data [2022-12-14 18:25:47,163] {__init__.py:51} INFO - Using executor LocalExecutor
[2022-12-14 18:25:47,165] {base_task_runner.py:115} INFO - Job 2311270: Subtask wait_for_data [2022-12-14 18:25:47,164] {dagbag.py:92} INFO - Filling up the DagBag from /srv/deployment/wikimedia/discovery/analytics/airflow/dags/mediawiki_revision_recommendation_create.py
[2022-12-14 18:25:47,282] {base_task_runner.py:115} INFO - Job 2311270: Subtask wait_for_data [2022-12-14 18:25:47,281] {cli.py:545} INFO - Running <TaskInstance: mediawiki_revision_recommendation_create_hourly.wait_for_data 2022-12-14T15:00:00+00:00 [running]> on host an-airflow1001.eqiad.wmnet
[2022-12-14 18:25:47,558] {logging_mixin.py:112} INFO - [2022-12-14 18:25:47,557] {hive_hooks.py:554} INFO - Trying to connect to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:25:47,559] {logging_mixin.py:112} INFO - [2022-12-14 18:25:47,559] {hive_hooks.py:556} INFO - Connected to analytics-hive.eqiad.wmnet:9083
[2022-12-14 18:25:47,563] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=eqiad/year=2022/month=12/day=14/hour=15
[2022-12-14 18:25:47,641] {named_hive_partition_sensor.py:92} INFO - Poking for event.mediawiki_revision_recommendation_create/datacenter=codfw/year=2022/month=12/day=14/hour=15
[2022-12-14 18:25:47,712] {base_sensor_operator.py:123} INFO - Success criteria met. Exiting.
[2022-12-14 18:25:50,354] {logging_mixin.py:112} INFO - [2022-12-14 18:25:50,353] {local_task_job.py:124} WARNING - Time since last heartbeat(0.04 s) < heartrate(5.0 s), sleeping for 4.955724 s
[2022-12-14 18:25:55,320] {logging_mixin.py:112} INFO - [2022-12-14 18:25:55,316] {local_task_job.py:103} INFO - Task exited with return code 0
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL