実行エラー、org.apache.hadoop.hive.ql.exec.mr.MapRedTask（状態= 08S01、コード= 1）

Question

からの戻りコード1クエリの下

#./beeline -u jdbc:hive2://192.168.0.10:10000 -e 'select count(*) from test_tb' --hiveconf hive.root.logger=DEBUG,console --verbose=true 

それは

の下にログインhiveserver2エラー

Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask (state=08S01,code=1) 
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask 
     at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:275) 
     at org.apache.hive.beeline.Commands.execute(Commands.java:736) 
     at org.apache.hive.beeline.Commands.sql(Commands.java:657) 
     at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:804) 
     at org.apache.hive.beeline.BeeLine.initArgs(BeeLine.java:608) 
     at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:630) 
     at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:368) 
     at org.apache.hive.beeline.BeeLine.main(BeeLine.java:351) 
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
     at java.lang.reflect.Method.invoke(Method.java:606) 
     at org.apache.hadoop.util.RunJar.main(RunJar.java:160) 
Beeline version 0.13.1 by Apache Hive 

下に投げます

6/06/14 10:57:32 [main]: WARN common.LogUtils: DEPRECATED: Ignoring hive-default.xml found on the CLASSPATH at /data/offline/apache-hive-0.13.1-bin/conf/hive-default.xml 
16/06/14 10:57:32 [main]: INFO metastore.HiveMetaStore: Starting hive metastore on port 9083 
16/06/14 10:57:32 [main]: INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 
16/06/14 10:57:32 [main]: INFO metastore.ObjectStore: ObjectStore, initialize called 
16/06/14 10:57:33 [main]: INFO metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" 
16/06/14 10:57:33 [main]: INFO metastore.ObjectStore: Initialized ObjectStore 
16/06/14 10:57:34 [main]: INFO metastore.HiveMetaStore: Added admin role in metastore 
16/06/14 10:57:34 [main]: INFO metastore.HiveMetaStore: Added public role in metastore 
16/06/14 10:57:34 [main]: INFO metastore.HiveMetaStore: No user is added in admin role, since config is empty 
16/06/14 10:57:34 [main]: INFO metastore.HiveMetaStore: Starting DB backed MetaStore Server 
16/06/14 10:57:34 [main]: INFO metastore.HiveMetaStore: Started the new metaserver on port [9083]... 
16/06/14 10:57:34 [main]: INFO metastore.HiveMetaStore: Options.minWorkerThreads = 200 
16/06/14 10:57:34 [main]: INFO metastore.HiveMetaStore: Options.maxWorkerThreads = 100000 
16/06/14 10:57:34 [main]: INFO metastore.HiveMetaStore: TCP keepalive = true 
16/06/14 10:57:40 [pool-3-thread-1]: INFO metastore.HiveMetaStore: 1: source:/10.234.177.127 get_table : db=default tbl=test_tb 
16/06/14 10:57:40 [pool-3-thread-1]: INFO HiveMetaStore.audit: ugi=qspace  ip=/10.234.177.127  cmd=source:/192.168.0.10 get_table : db=default tbl=test_tb 
16/06/14 10:57:40 [pool-3-thread-1]: INFO metastore.HiveMetaStore: 1: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 
16/06/14 10:57:40 [pool-3-thread-1]: INFO metastore.ObjectStore: ObjectStore, initialize called 
16/06/14 10:57:40 [pool-3-thread-1]: INFO metastore.ObjectStore: Initialized ObjectStore 

Answer 1

あなたはHiveserver2を使用しています。そのような集計については、構成に応じて、実行前に減速機の数を設定する必要があると私は信じています。ハイブを使用すると、この構文を使用することができます：

SET mapreduce.job.reduces=1 

私はこれが役に立てば幸い：Hive2上しかし

SET mapred.reduce.tasks=1 

を私が使用する必要が気づきました！以前は同じエラーメッセージが表示されていましたが、これを変更すると問題が解決しました。

Answer 2

は、あなたのクエリを実行する前に、以下のスニペットを追加します。

SET hive.auto.convert.join=false; 
SET mapreduce.map.memory.mb = 16384; 
SET mapreduce.map.java.opts='-Djava.net.preferIPv4Stack=true -Xmx13107M'; 
SET mapreduce.reduce.memory.mb = 13107; 
SET mapreduce.reduce.java.opts='-Djava.net.preferIPv4Stack=true -Xmx16384M'; 
set hive.support.concurrency = false;