Page MenuHomePhabricator
Paste P13088

Oozie job log
ActivePublic
Actions

Authored by SBisson on Oct 28 2020, 3:15 PM.
Tags
None
Referenced Files
F32417530: Oozie job log
Oct 28 2020, 3:15 PM
Subscribers
nshahquinn-wmf
2020-10-28 15:12:59,593 INFO CoordSubmitXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[sbisson] GROUP[-] TOKEN[] APP[wikipediapreview_stats-daily-coord] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[-] ENDED Coordinator Submit jobId=0018758-201015070320240-oozie-oozi-C
2020-10-28 15:12:59,708 INFO CoordMaterializeTransitionXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[sbisson] GROUP[-] TOKEN[] APP[wikipediapreview_stats-daily-coord] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[-] materialize actions for tz=Coordinated Universal Time,
start=Tue Oct 20 00:00:00 UTC 2020, end=Wed Oct 21 00:00:00 UTC 2020,
timeUnit 5,
frequency :1:DAY,
lastActionNumber 0
2020-10-28 15:12:59,712 INFO CoordMaterializeTransitionXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[sbisson] GROUP[-] TOKEN[] APP[wikipediapreview_stats-daily-coord] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[-] [0018758-201015070320240-oozie-oozi-C]: Update status from PREP to RUNNING
2020-10-28 15:12:59,712 INFO CoordMaterializeTransitionXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[sbisson] GROUP[-] TOKEN[] APP[wikipediapreview_stats-daily-coord] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[-] [0018758-201015070320240-oozie-oozi-C]: all actions have been materialized, set pending to true
2020-10-28 15:12:59,712 INFO CoordMaterializeTransitionXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[sbisson] GROUP[-] TOKEN[] APP[wikipediapreview_stats-daily-coord] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[-] Coord Job status updated to = RUNNING
2020-10-28 15:12:59,723 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::CoordActionInputCheck:: Missing deps:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=23/_SUCCESS
2020-10-28 15:12:59,725 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: In checkListOfPaths: hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=23/_SUCCESS is Missing.
2020-10-28 15:12:59,727 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=23/_SUCCESS, Exists? :true
2020-10-28 15:12:59,730 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=22/_SUCCESS, Exists? :true
2020-10-28 15:12:59,732 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=21/_SUCCESS, Exists? :true
2020-10-28 15:12:59,734 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=20/_SUCCESS, Exists? :true
2020-10-28 15:12:59,736 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=19/_SUCCESS, Exists? :true
2020-10-28 15:12:59,738 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=18/_SUCCESS, Exists? :true
2020-10-28 15:12:59,740 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=17/_SUCCESS, Exists? :true
2020-10-28 15:12:59,742 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=16/_SUCCESS, Exists? :true
2020-10-28 15:12:59,744 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=15/_SUCCESS, Exists? :true
2020-10-28 15:12:59,746 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=14/_SUCCESS, Exists? :true
2020-10-28 15:12:59,748 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=13/_SUCCESS, Exists? :true
2020-10-28 15:12:59,750 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=12/_SUCCESS, Exists? :true
2020-10-28 15:12:59,752 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=11/_SUCCESS, Exists? :true
2020-10-28 15:12:59,754 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=10/_SUCCESS, Exists? :true
2020-10-28 15:12:59,756 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=9/_SUCCESS, Exists? :true
2020-10-28 15:12:59,758 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=8/_SUCCESS, Exists? :true
2020-10-28 15:12:59,760 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=7/_SUCCESS, Exists? :true
2020-10-28 15:12:59,762 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=6/_SUCCESS, Exists? :true
2020-10-28 15:12:59,764 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=5/_SUCCESS, Exists? :true
2020-10-28 15:12:59,766 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=4/_SUCCESS, Exists? :true
2020-10-28 15:12:59,768 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=3/_SUCCESS, Exists? :true
2020-10-28 15:12:59,771 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=2/_SUCCESS, Exists? :true
2020-10-28 15:12:59,773 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=1/_SUCCESS, Exists? :true
2020-10-28 15:12:59,775 INFO CoordActionInputCheckXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] [0018758-201015070320240-oozie-oozi-C@1]::ActionInputCheck:: File:hdfs://analytics-hadoop/wmf/data/wmf/webrequest/webrequest_source=text/year=2020/month=10/day=20/hour=0/_SUCCESS, Exists? :true
2020-10-28 15:12:59,828 INFO CoordActionNotificationXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] No Notification URL is defined. Therefore nothing to notify for job 0018758-201015070320240-oozie-oozi-C@1
2020-10-28 15:12:59,845 WARN LiteWorkflowAppService:523 - SERVER[an-coord1001.eqiad.wmnet] USER[sbisson] GROUP[-] TOKEN[] APP[wikipediapreview_stats-daily-coord] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] libpath [/tmp/oozie-sbisson/oozie/lib] does not exist
2020-10-28 15:13:00,026 INFO CoordActionNotificationXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] No Notification URL is defined. Therefore nothing to notify for job 0018758-201015070320240-oozie-oozi-C@1
2020-10-28 15:13:18,415 INFO CoordActionUpdateXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[sbisson] GROUP[-] TOKEN[] APP[-] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[0018758-201015070320240-oozie-oozi-C@1] Updating Coordinator action id: [0018758-201015070320240-oozie-oozi-C@1] status [RUNNING] to [KILLED] pending [1] to [0]
2020-10-28 15:13:20,546 INFO CoordStatusTransitXCommand:520 - SERVER[an-coord1001.eqiad.wmnet] USER[sbisson] GROUP[-] TOKEN[] APP[wikipediapreview_stats-daily-coord] JOB[0018758-201015070320240-oozie-oozi-C] ACTION[-] Set coordinator job [0018758-201015070320240-oozie-oozi-C] status to 'KILLED' from 'RUNNING'
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL