Member since
11-11-2019
89
Posts
5
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
66 | 01-12-2021 12:01 AM | |
236 | 08-11-2020 10:11 AM | |
2148 | 07-09-2020 04:21 AM | |
659 | 07-09-2020 02:15 AM |
01-12-2021
12:01 AM
Hive on spark is not supported on HDP 3.0.1 . You need to use Spark HWC and integrate with LLAP to take advantage, In HDP 3.x ,Tez is the default execution engine and you can also use MR.
... View more
01-04-2021
02:43 AM
copied antlr-runtime-xxx.jar from the standard lib of hive into the standard jar lib of spark,
... View more
12-16-2020
03:33 AM
Apologies for the late reply .We need the driver logs. Please check the below document to get the JDBC driver logs. https://www.simba.com/resources/drivers/enable-logging-odbc-driver/
... View more
12-09-2020
09:21 AM
Is the connection string correct? I see below message: org.apache.hadoop.hive.metastore.api.MetaException No such database row
... View more
12-07-2020
02:44 AM
The location would be in odbc.ini
... View more
12-07-2020
12:58 AM
1. Do you use HDP/CDH/CDP? 2. What is the version? 3. What is the driver version? 4. Driver logs 5. Is your cluster SSL/Kerberos enabled?
... View more
12-07-2020
12:32 AM
Do you face same issue when you connect via beeline ? If yes we need to check HMS logs.
... View more
11-13-2020
01:16 AM
Where do you want to implement HDP/CDH/CDP ? What is your version ?
... View more
10-21-2020
10:13 AM
The task is not getting launched [8A[2K---------------------------------------------------------------------------------------------- [2K[36;1m VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED [22;0m[2K---------------------------------------------------------------------------------------------- [2KMap 1 container INITIALIZING -1 0 0 -1 0 0 Reducer 2 container INITED 1 0 0 1 0 0 [2K---------------------------------------------------------------------------------------------- [2K[31;1mVERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 29.84 s [22;0m[2K---------------------------------------------------------------------------------------------- ERROR : Status: Failed Can you try with the below settings: Navigato Ambari => Tez ==> tez.am.resource.memory.mb =5120 and restart hive and tez. Set the below in beeline or at the client session and try: +++++ set hive.tez.container.size=5120; set hive.tez.java.opts=-Xmx4096m; set tez.runtime.io.sort.mb=2048; set tez.task.resource.memory.mb=4096; +++++++++ If issue persist try with below: set hive.tez.container.size=10240; set hive.tez.java.opts=-Xmx8192m; set tez.runtime.io.sort.mb=4096; set tez.task.resource.memory.mb=7680; If it fails then issue might be with Kafka or the yarn
... View more
10-20-2020
01:24 AM
1 Kudo
I can see that none of the containers are initialised yet: Map 1 container INITIALIZING -1 0 0 -1 0 0 Reducer 2 container INITED 1 0 0 1 0 0 and eventually fails with timeout exception: java.io.IOException: java.util.concurrent.TimeoutException Action Plan: 1. The issue seems to be with yarn contention issue. Set a queue where it is unutilised. set tez.queue.name=<under utilised queue> 2. Increase the task container timeout set tez.task.timeout-ms=6000 Set the above values in beeline session (not in AMbari cluster) and re-run the query. Attach below if query fails: 1. set -v 2. APplication logs 3. Console output
... View more
10-20-2020
01:10 AM
You can check the explain plan . It provided the order of the execution. It is not a rule that certain reucers would start after all the mapper phase. The ceratin mapper phase depends on the results from the reducers too. You can check the explain plan . If you want map join then you can set property map.auto.conevrt.join =true
... View more
10-08-2020
05:29 AM
She meant to say for non managed HDP/CDH.
... View more
10-08-2020
04:26 AM
It wont work in CDH or HDP managed cluster. You need to try in independent not managed by CDH or HDP as per Sindhu's comment
... View more
10-08-2020
03:10 AM
Does this hiveserver2 managed by CDH cluster or independent of CDH ?
... View more
09-08-2020
10:53 PM
Please share the updated logs.I want to check the error
... View more
09-08-2020
01:04 AM
COuld you adjust the value bit more than 6518628 and check?
... View more
09-07-2020
02:34 AM
The latest ODBC driver is 2.6.9 Please download https://www.cloudera.com/downloads/connectors/impala/odbc/2-6-9.html
... View more
09-07-2020
02:17 AM
Can you provide the output from MySQL show variables like 'max_allowed_packet'; Please also increase the variable in MySQL: https://dev.mysql.com/doc/refman/8.0/en/packet-too-large.html
... View more
08-13-2020
09:45 AM
The serde class is no more supported in HDP 3.0. It's replaced with 'AbstractSerDe'.
... View more
08-12-2020
02:01 AM
1. Follow below document to run Oozie in time basis (weekly/daily/hourly) https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/admin_oozie_cron.html 2. Follow below document for Oozie email action http://oozie.apache.org/docs/5.2.0/DG_EmailActionExtension.html
... View more
08-11-2020
10:11 AM
Derby only allows single connection (process) to access the database at a give time, hence only one user can access the Hive. Upgrade your hive metastore to either MySQL, PostgreSQL to support multiple concurrent connections to Hive.
... View more
08-11-2020
07:13 AM
My understanding is ,you can access from Tableau via ODBC driver to Hive. Could you please explain in brief ? Is it possible to get the server name, etc without access to admin links/directories?
... View more
08-11-2020
02:41 AM
In my understanding, you want to connect Tableu to CDP. You need to use ODBC driver .Please follow below document https://docs.cloudera.com/runtime/7.2.0/integrating-hive-and-bi/topics/hive_connecting_hive_to_bi_tools.html
... View more
08-06-2020
04:59 AM
You mean to say Hiveserver2 and Hivemetatsore is not starting? If my understanding is correct we need hiveserver2 and hivemetastore log after reproducing the issue? What changes made i.e causing the issue?
... View more
08-04-2020
03:46 AM
I believe the syntax is not correct. Can you please run below command and try: +++++ CREATE TABLE IF NOT EXISTS test_ext ( NAME string, city string ) partitioned by(ID int) clustered by (NAME) into 3 buckets ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS ORC TBLPROPERTIES ("transactional"="true"); +++++ Is it HDP or CDH or CDP ? What is the version ?
... View more
07-09-2020
07:50 AM
It is decided by the optmiser,the planning .We can not do much on this.
... View more
07-09-2020
05:02 AM
1 Kudo
This is decided by the optimiser. Until Mappers are finished for that query,Reducers would not be stated.
... View more
07-09-2020
04:21 AM
In Mapreduce the Reducer output would wait after all ten Mapper is finished. We recommend to use Tez.
... View more
07-09-2020
04:13 AM
I have checked the screenshot. This is not application concurrency. Reducer phases1 is waiting for all the mappers to get finished. DAG is decided by the optimizer. Are you using MAPREDUCE or Tez as an execution engine?
... View more