Page MenuHomePhabricator

hive / beeline query for interlanguage links fails
Closed, ResolvedPublic

Description

Hi,

On stat1002 I am trying to run the first two queries from https://www.mediawiki.org/wiki/Universal_Language_Selector/Design/Interlanguage_links/metrics (DROP TABLE and CREATE TABLE).

CREATE TABLE seems to run correctly, but then it fails:

2016-05-26 12:32:47,907 Stage-1 map = 99%,  reduce = 5%, Cumulative CPU 3244.15 sec
2016-05-26 12:32:48,953 Stage-1 map = 99%,  reduce = 11%, Cumulative CPU 3300.06 sec
2016-05-26 12:32:50,003 Stage-1 map = 100%,  reduce = 17%, Cumulative CPU 3332.53 sec
2016-05-26 12:32:51,071 Stage-1 map = 100%,  reduce = 49%, Cumulative CPU 3508.69 sec
2016-05-26 12:32:52,139 Stage-1 map = 100%,  reduce = 97%, Cumulative CPU 3857.66 sec
2016-05-26 12:32:53,178 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 3888.37 sec
MapReduce Total cumulative CPU time: 0 days 1 hours 4 minutes 48 seconds 370 msec
Ended Job = job_1464023694161_8405
Moving data to: hdfs://analytics-hadoop/user/hive/warehouse/ill.db/cross_wiki_navigation
Failed with exception Unable to move source hdfs://analytics-hadoop/tmp/hive-staging_hive_2016-05-26_12-32-08_134_4219103500284394650-1/-ext-10001 to destination hdfs://analytics-hadoop/user/hive/warehouse/ill.db/cross_wiki_navigation
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
MapReduce Jobs Launched: 
Stage-Stage-1: Map: 153  Reduce: 173   Cumulative CPU: 3888.37 sec   HDFS Read: 4655771158 HDFS Write: 47334 SUCCESS
Total MapReduce CPU Time Spent: 0 days 1 hours 4 minutes 48 seconds 370 msec

I tried with both hive and beeline and it fails similarly with both.

Event Timeline

Amire80 created this task.May 26 2016, 1:22 PM
Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptMay 26 2016, 1:22 PM
Amire80 closed this task as Resolved.May 26 2016, 1:51 PM
Amire80 assigned this task to JAllemandou.
Amire80 added subscribers: JAllemandou, Ottomata.

Resolved by creating my own database and creating the table in it.

Thanks to @Ottomata and @JAllemandou!