Member since
01-04-2016
409
Posts
313
Kudos Received
35
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3502 | 01-16-2018 07:00 AM | |
893 | 09-13-2017 06:17 PM | |
1682 | 09-13-2017 05:58 AM | |
1093 | 08-28-2017 07:16 AM | |
3207 | 05-11-2017 11:30 AM |
09-21-2018
10:24 AM
I am using RHEL 7.4
... View more
08-04-2018
10:52 AM
I have tried this bit not worked.
... View more
08-03-2018
01:42 PM
@nkumar We are not overlapping the data. And log files are very huge not able to attach here.
... View more
08-03-2018
01:37 PM
I am using ambari 2.4.2 and getting below error while registering ambari-agent . If I do not want two-way ssl then how I can disable. Tried this link but didn't worked. ERROR 2018-08-03 13:20:12,579 Controller.py:212 - Unable to connect to: https://mosaic.sandbox.com:8441/agent/v1/register/mosaic.sandbox.com
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/ambari_agent/Controller.py", line 165, in registerWithServer
ret = self.sendRequest(self.registerUrl, data)
File "/usr/lib/python2.6/site-packages/ambari_agent/Controller.py", line 496, in sendRequest
raise IOError(\'Request to {0} failed due to {1}\'.format(url, str(exception)))
IOError: Request to https://mosaic.sandbox.com:8441/agent/v1/register/mosaic.sandbox.com failed due to EOF occurred in violation of protocol (_ssl.c:579)
ERROR 2018-08-03 13:20:12,579 Controller.py:213 - Error:Request to https://mosaic.sandbox.com:8441/agent/v1/register/mosaic.sandbox.com failed due to EOF occurred in violation of protocol (_ssl.c:579)
WARNING 2018-08-03 13:20:12,580 Controller.py:214 - Sleeping for 15 seconds and then trying again
', None)
('INFO 2018-08-03 13:20:12,459 Facter.py:194 - Directory: \'/etc/resource_overrides\' does not exist - it won\'t be used for gathering system resources.
... View more
Labels:
- Labels:
-
Apache Ambari
08-01-2018
07:54 AM
HDP version - 2.6.2.14 I have enable the HIVE LLAP and configured successfully. I have enable the cache also with following property hive.llap.io.memory.mode=cache But still cache is not in use . Please help to resolve the issue.
... View more
Labels:
- Labels:
-
Apache Hive
07-27-2018
09:21 AM
@Dmitro Vasilenko If I am managing it through Ambari then also I need to run command?
... View more
07-20-2018
11:53 AM
@Sindhu And consecutive query performance also decreased. Please suggest it I can tune the reducer's. I have tried to tune my cluster with following parameter. MemPerDaemon (Container Size) > LLAP Heapsize (Java process heap) + CacheSize (off heap) +headroom
Multiple of yarn min allocation
Should be less than yarn.nodemanager.resource.memory-mb
Headroom is capped at 6GB
QueueSize (Yarn Queue) >= MemPerDaemon * num daemons + slider + (tez AM size * concurrency) Cachesize = MemPerDaemon - (hive tez container * num of executors)
Num executors per daemon = (MemPerDaemon - cache_size)/hive tez container size Our cluster size is 4 datanode and 1 master.
... View more
07-20-2018
07:23 AM
@Sindhu No change in volume and we were running continuous query on llap like 3-7 queries in parallel. Same thing we were doing and now also but it is taking time. My obserbation is it is taking time for reducer's.
... View more
07-19-2018
10:45 AM
We have HDP 2.6.2.14 version installed. Enable the LLAP and it was working very fine till 4 month. Now we are facing issue for performance. Earlier same query was taking around 51 sec and now it is taking more than 9 min's. We haven't change anything on server and configuration. Immediate help will be appreciated. Thanks in advance.
... View more
- Tags:
- Data Processing
- Hive
Labels:
- Labels:
-
Apache Hive
05-21-2018
08:01 AM
@Bolke de Bruin Could you please provide the link or doc to install and configure airflow with HDP.
... View more
05-21-2018
06:06 AM
@Mykola Mykhalov I have tried with mpack but services are getting start and going down in a second. After debugging the issue found there is not /usr/local/airflow/airflow_control.sh script. Could you please guide me from where I can get this.
... View more
03-14-2018
06:42 AM
@Matt Andruff After disabling [https] verify=disable issue is resolved.
... View more
03-14-2018
06:38 AM
@Mahmoud Sabri, COuld you plese provide the yarn logs for the same.
... View more
02-19-2018
07:48 AM
@Naresh P R I have checked. But I am not able to see any hive 1.x jar in LLAP classpath
... View more
02-19-2018
07:14 AM
Here is the describe formatted fo table +-------------------------------+------------------------------------------------------------------------------------------------------+-----------------------------+--+
| col_name | data_type | comment |
+-------------------------------+------------------------------------------------------------------------------------------------------+-----------------------------+--+
| # col_name | data_type | comment |
| | NULL | NULL |
| key1 | int | |
| key2 | int | |
| val1 | string | |
| flag | string | |
| seq | int | |
| | NULL | NULL |
| # Detailed Table Information | NULL | NULL |
| Database: | testdb | NULL |
| Owner: | hive | NULL |
| CreateTime: | Mon Feb 12 11:20:26 UTC 2018 | NULL |
| LastAccessTime: | UNKNOWN | NULL |
| Retention: | 0 | NULL |
| Location: | hdfs://ip-192-168-180-204.ca-central-1.compute.internal:8020/apps/hive/warehouse/testdb.db/cdc_test | NULL |
| Table Type: | MANAGED_TABLE | NULL |
| Table Parameters: | NULL | NULL |
| | COLUMN_STATS_ACCURATE | {\"BASIC_STATS\":\"true\"} |
| | numFiles | 18 |
| | numRows | 18 |
| | rawDataSize | 3294 |
| | totalSize | 8504 |
| | transient_lastDdlTime | 1518765761 |
| | NULL | NULL |
| # Storage Information | NULL | NULL |
| SerDe Library: | org.apache.hadoop.hive.ql.io.orc.OrcSerde | NULL |
| InputFormat: | org.apache.hadoop.hive.ql.io.orc.OrcInputFormat | NULL |
| OutputFormat: | org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat | NULL |
| Compressed: | No | NULL |
| Num Buckets: | -1 | NULL |
| Bucket Columns: | [] | NULL |
| Sort Columns: | [] | NULL |
| Storage Desc Params: | NULL | NULL |
| | serialization.format | 1 |
... View more
02-17-2018
06:45 PM
@priyank pandey What is this blog? I am not getting anything in blog related to my query.
... View more
02-17-2018
05:53 PM
@Sergey Soldatov I am already using Tez. Could you please help me to configure Tez with LLAP? Or any document so I can walk through.
... View more
02-17-2018
05:51 PM
Hi I am using HDp 2.6..2.14. Earlier I am was able to run query select max(seq) from test; . But when I have tried to run same query again. I am getting following error. Need help. Query :- select max(seq) from testdb.cdc_test; ERROR : Status: Failed
ERROR : Vertex failed, vertexName=Map 1, vertexId=vertex_1518761170058_0014_1_00, diagnostics=[Task failed, taskId=task_1518761170058_0014_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : java.lang.NoSuchMethodError: org.apache.hadoop.hive.serde2.ColumnProjectionUtils.getReadColumnNames(Lorg/apache/hadoop/conf/Configuration;)[Ljava/lang/String;
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.<init>(LlapRecordReader.java:126)
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.create(LlapRecordReader.java:109)
at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat.getRecordReader(LlapInputFormat.java:109)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:380)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.<init>(TezGroupedSplitsInputFormat.java:145)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:111)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setupOldRecordReader(MRReaderMapred.java:157)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setSplit(MRReaderMapred.java:83)
at org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:694)
at org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:653)
at org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:145)
at org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:109)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.getMRInput(MapRecordProcessor.java:525)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:171)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
, errorMessage=Cannot recover from this error:java.lang.NoSuchMethodError: org.apache.hadoop.hive.serde2.ColumnProjectionUtils.getReadColumnNames(Lorg/apache/hadoop/conf/Configuration;)[Ljava/lang/String;
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.<init>(LlapRecordReader.java:126)
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.create(LlapRecordReader.java:109)
at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat.getRecordReader(LlapInputFormat.java:109)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:380)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.<init>(TezGroupedSplitsInputFormat.java:145)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:111)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setupOldRecordReader(MRReaderMapred.java:157)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setSplit(MRReaderMapred.java:83)
at org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:694)
at org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:653)
at org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:145)
at org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:109)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.getMRInput(MapRecordProcessor.java:525)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:171)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1518761170058_0014_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]
ERROR : Vertex killed, vertexName=Reducer 2, vertexId=vertex_1518761170058_0014_1_01, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1518761170058_0014_1_01 [Reducer 2] killed/failed due to:OTHER_VERTEX_FAILURE]
ERROR : DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
--------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED
--------------------------------------------------------------------------------
Map 1 llap RUNNING 1 0 0 1 1
Reducer 2 llap INITED 1 0 0 1 0
--------------------------------------------------------------------------------
VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 0.47 s
--------------------------------------------------------------------------------
INFO : org.apache.tez.common.counters.DAGCounter:
INFO : NUM_FAILED_TASKS: 1
INFO : TOTAL_LAUNCHED_TASKS: 1
INFO : AM_CPU_MILLISECONDS: 1610
INFO : AM_GC_TIME_MILLIS: 0
ERROR : FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1518761170058_0014_1_00, diagnostics=[Task failed, taskId=task_1518761170058_0014_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : java.lang.NoSuchMethodError: org.apache.hadoop.hive.serde2.ColumnProjectionUtils.getReadColumnNames(Lorg/apache/hadoop/conf/Configuration;)[Ljava/lang/String;
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.<init>(LlapRecordReader.java:126)
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.create(LlapRecordReader.java:109)
at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat.getRecordReader(LlapInputFormat.java:109)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:380)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.<init>(TezGroupedSplitsInputFormat.java:145)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:111)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setupOldRecordReader(MRReaderMapred.java:157)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setSplit(MRReaderMapred.java:83)
at org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:694)
at org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:653)
at org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:145)
at org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:109)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.getMRInput(MapRecordProcessor.java:525)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:171)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
, errorMessage=Cannot recover from this error:java.lang.NoSuchMethodError: org.apache.hadoop.hive.serde2.ColumnProjectionUtils.getReadColumnNames(Lorg/apache/hadoop/conf/Configuration;)[Ljava/lang/String;
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.<init>(LlapRecordReader.java:126)
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.create(LlapRecordReader.java:109)
at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat.getRecordReader(LlapInputFormat.java:109)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:380)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.<init>(TezGroupedSplitsInputFormat.java:145)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:111)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setupOldRecordReader(MRReaderMapred.java:157)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setSplit(MRReaderMapred.java:83)
at org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:694)
at org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:653)
at org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:145)
at org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:109)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.getMRInput(MapRecordProcessor.java:525)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:171)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1518761170058_0014_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]Vertex killed, vertexName=Reducer 2, vertexId=vertex_1518761170058_0014_1_01, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1518761170058_0014_1_01 [Reducer 2] killed/failed dueto:OTHER_VERTEX_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
INFO : Resetting the caller context to HIVE_SSN_ID:8b5aab92-b58f-4fa5-9803-6c361485e08f
INFO : Completed executing command(queryId=hive_20180216103105_63ef1192-864d-4ef5-b462-6155870b07f5); Time taken: 1.47 seconds
Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1518761170058_0014_1_00, diagnostics=[Task failed, taskId=task_1518761170058_0014_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : java.lang.NoSuchMethodError: org.apache.hadoop.hive.serde2.ColumnProjectionUtils.getReadColumnNames(Lorg/apache/hadoop/conf/Configuration;)[Ljava/lang/String;
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.<init>(LlapRecordReader.java:126)
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.create(LlapRecordReader.java:109)
at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat.getRecordReader(LlapInputFormat.java:109)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:380)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.<init>(TezGroupedSplitsInputFormat.java:145)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:111)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setupOldRecordReader(MRReaderMapred.java:157)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setSplit(MRReaderMapred.java:83)
at org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:694)
at org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:653)
at org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:145)
at org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:109)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.getMRInput(MapRecordProcessor.java:525)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:171)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
, errorMessage=Cannot recover from this error:java.lang.NoSuchMethodError: org.apache.hadoop.hive.serde2.ColumnProjectionUtils.getReadColumnNames(Lorg/apache/hadoop/conf/Configuration;)[Ljava/lang/String;
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.<init>(LlapRecordReader.java:126)
at org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.create(LlapRecordReader.java:109)
at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat.getRecordReader(LlapInputFormat.java:109)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:380)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.<init>(TezGroupedSplitsInputFormat.java:145)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:111)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setupOldRecordReader(MRReaderMapred.java:157)
at org.apache.tez.mapreduce.lib.MRReaderMapred.setSplit(MRReaderMapred.java:83)
at org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:694)
at org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:653)
at org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:145)
at org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:109)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.getMRInput(MapRecordProcessor.java:525)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:171)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1518761170058_0014_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]Vertex killed, vertexName=Reducer 2, vertexId=vertex_1518761170058_0014_1_01, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1518761170058_0014_1_01 [Reducer 2] killed/failed dueto:OTHER_VERTEX_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1 (state=08S01,code=2)
... View more
- Tags:
- Data Processing
- llap
Labels:
02-15-2018
09:46 AM
Hi I am using HDP 2.6. I am getting No suitable error while doing insert into phoenix table through hive llap. Please find error:-
ERROR : Status: Failed
ERROR : Vertex failed, vertexName=Map 1, vertexId=vertex_1518677556019_0007_5_00, diagnostics=[Task failed, taskId=task_1518677556019_0007_5_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_0:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_1:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 2 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_2:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_3:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1518677556019_0007_5_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]
ERROR : DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
INFO : org.apache.tez.common.counters.DAGCounter:
INFO : NUM_FAILED_TASKS: 4
INFO : TOTAL_LAUNCHED_TASKS: 4
INFO : AM_CPU_MILLISECONDS: 150
INFO : AM_GC_TIME_MILLIS: 0
ERROR : FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1518677556019_0007_5_00, diagnostics=[Task failed, taskId=task_1518677556019_0007_5_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_0:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_1:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 2 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_2:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_3:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1518677556019_0007_5_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
INFO : Resetting the caller context to HIVE_SSN_ID:beff635c-672c-4ce3-be0b-4f3e7eedf010
INFO : Completed executing command(queryId=hive_20180215093836_9a35bc31-9d15-4e3c-8bdf-e1186eb2d6ec); Time taken: 2.346 seconds
Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1518677556019_0007_5_00, diagnostics=[Task failed, taskId=task_1518677556019_0007_5_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_0:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_1:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 2 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_2:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
], TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) : attempt_1518677556019_0007_5_00_000000_3:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:188)
... 15 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:442)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:564)
at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:516)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:384)
at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:443)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
... 16 more
Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:359)
... 25 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-204.ca-central-1.compute.internal,ip-192-168-180-27.ca-central-1.compute.internal,ip-192-168-180-230.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... 27 more
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1518677556019_0007_5_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0 (state=08S01,code=2)
... View more
Labels:
- Labels:
-
Apache Phoenix
02-12-2018
08:15 AM
Hi I am using HDP 2.6.2.14. I have enabled the LLAP. First time LLAP restarted successfully. But when I tried to restart but not getting start. javax.net.ssl.SSLException: Received fatal alert:
unknown_ca Error messages on a container launched by Slider AM Also I have copied phoenix-4.7.0.2.6.2.14-5-client.jar to following path for phoenix connectivity. /usr/hdp/2.6.2.14-5/hive2/auxlib/phoenix-4.7.0.2.6.2.14-5-client.jar
... View more
- Tags:
- Data Processing
- llap
Labels:
02-03-2018
09:53 AM
1 Kudo
I am using HDP 2.6.2 version.
I have Hive LLAP enable successfully. but when I am running query from beeline after creaating connection thorugh llap I am getting error.
Scenario :- Table is created with phoenix handle property . Like table is created in phenix and then external table is created over the phoenix table in hive. Just want to confirm that is possible to access phoenix tables in LLAP hie. If yes then please suggest me steps. I am getting No suitable driver error. FAILED: RuntimeException org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-228.ca-central-1.compute.internal,ip-192-168-180-102.ca-central-1.compute.internal,ip-192-168-180-189.ca-central-1.compute.internal:2181:/hbase-unsecure;org.apache.hadoop.hive.serde2.SerDeException: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-228.ca-central-1.compute.internal,ip-192-168-180-102.ca-central-1.compute.internal,ip-192-168-180-189.ca-central-1.compute.internal:2181:/hbase-unsecure;
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:82)
at org.apache.phoenix.hive.PhoenixSerDe.initialize(PhoenixSerDe.java:86)
at org.apache.hadoop.hive.serde2.AbstractSerDe.initialize(AbstractSerDe.java:54)
at org.apache.hadoop.hive.serde2.SerDeUtils.initializeSerDeWithoutErrorCheck(SerDeUtils.java:553)
at org.apache.hadoop.hive.ql.plan.TableDesc.getDeserializer(TableDesc.java:101)
at org.apache.hadoop.hive.ql.exec.FetchOperator.setupOutputObjectInspector(FetchOperator.java:585)
at org.apache.hadoop.hive.ql.exec.FetchOperator.initialize(FetchOperator.java:182)
at org.apache.hadoop.hive.ql.exec.FetchOperator.<init>(FetchOperator.java:147)
at org.apache.hadoop.hive.ql.exec.FetchTask.initialize(FetchTask.java:86)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:483)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:336)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1197)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1184)
at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:191)
at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:276)
at org.apache.hive.service.cli.operation.Operation.run(Operation.java:312)
at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:508)
at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:495)
at org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:309)
at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:506)
at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLException: No suitable driver found for jdbc:phoenix:ip-192-168-180-228.ca-central-1.compute.internal,ip-192-168-180-102.ca-central-1.compute.internal,ip-192-168-180-189.ca-central-1.compute.internal:2181:/hbase-unsecure;
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getConnection(PhoenixConnectionUtil.java:96)
at org.apache.phoenix.hive.util.PhoenixConnectionUtil.getInputConnection(PhoenixConnectionUtil.java:63)
at org.apache.phoenix.hive.PhoenixSerializer.<init>(PhoenixSerializer.java:70)
... View more
Labels:
- Labels:
-
Apache Phoenix
02-02-2018
11:25 AM
HI I am using HDP 2.6.2. I am facing issue while runing upsert command through Java
phoenix jdbc connection. Please find the exception below: java.sql.SQLException: ERROR 2004 (INT05): Parameter value
unbound. Parameter 2 is unbound at
org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:443) at
org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145) at
org.apache.phoenix.jdbc.PhoenixPreparedStatement.throwIfUnboundParameters(PhoenixPreparedStatement.java:150) at
org.apache.phoenix.jdbc.PhoenixPreparedStatement.executeUpdate(PhoenixPreparedStatement.java:191) Reference: https://community.hortonworks.com/questions/45896/problem-executing-joins-on-phoenix-query-server.html
. It’s a bug as per the link provided above. We need to know
if the bug is fixed in HDP 2.6 version. After this exception whenever I am running the jar. I got
FileNotFoundException even though file is present on specific location.
... View more
Labels:
- Labels:
-
Apache Phoenix
01-16-2018
07:00 AM
@Sandeep Nemuri I have resolved this issue with increasing spark_daemon_memory in spark configuration Advanced spark2-env.
... View more