The WDCM_Sqoop_Clients.R fails from stat1004 again. This is an orchestrating R program that runs hundreds of Apache Sqoop jobs to produce the goransm.wdcm_clients_wb_entity_usage Hive table in the Data Lake.
What I have noticed thus far:
- From stat1004, beeline, following a kinit auth as gorasnm:
select * from goransm.wdcm_clients_wb_entity_usage where wiki_db="enwiki" limit 10;
results in (verbatim output suppressed):
Error: Error while compiling statement: FAILED: SemanticException Unable to determine if hdfs://analytics-hadoop/tmp/wmde/analytics/wdcm/wdcmsqoop/wdcm_clients_wb_entity_usage is encrypted: org.apache.hadoop.security.AccessControlException: Permission denied: user=goransm, access=EXECUTE, inode="/tmp/wmde":analytics-privatedata:hdfs:drwxr-x---
However, working from the R script on stat1004 directly, where analytics-privatedata is used in place of goransm, the following command:
sudo -u analytics-privatedata kerberos-run-command analytics-privatedata /usr/bin/sqoop import --connect jdbc:mysql://s1-analytics-replica.eqiad.wmnet:3311/enwiki --password-file /user/goransm/mysql-analytics-research-client-pw.txt --username research -m 16 --driver org.mariadb.jdbc.Driver --query "select * from wbc_entity_usage where \$CONDITIONS" --split-by eu_row_id --as-avrodatafile --target-dir /tmp/wmde/analytics/wdcm/wdcmsqoop/wdcm_clients_wb_entity_usage/wiki_db=enwiki --delete-target-dir> `
results in (verbatim output suppressed):
21/04/27 21:24:09 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: org.mariadb.jdbc.Driver java.lang.RuntimeException: Could not load db driver class: org.mariadb.jdbc.Driver
for which I believe to be similar to a problem recently addressed in T274866.
Please advise. The WDCM updates are incomplete and the dashboards are currently down.