Member since
04-11-2016
535
Posts
148
Kudos Received
77
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
7497 | 09-17-2018 06:33 AM | |
1827 | 08-29-2018 07:48 AM | |
2744 | 08-28-2018 12:38 PM | |
2126 | 08-03-2018 05:42 AM | |
1991 | 07-27-2018 04:00 PM |
03-07-2018
05:09 AM
@Aymen Rahal The issue is due to 'Connection refused on the default ssh port'. Verify the following: 1. Check the ssh port under file /etc/ssh/sshd_config, if not set try setting to 22. 2. Try running ssh to the host from terminal.
... View more
03-06-2018
02:42 PM
@Aymen Rahal Can you click on 'Failed' and share the error shown?
... View more
03-04-2018
03:04 PM
1 Kudo
@SUDHIR KUMAR The issue seems to be Namenode not able to reach the Data nodes: "File /tmp/hadoop-yarn/staging/hadoop /.staging/job_1520083308767_0005/job.splitmetainfo could only be written to 0 of the 1 minReplic ation nodes. There are 3 datanode(s) running and 3 node(s) are excluded in this operation. " Check the Namenode's reachability to Data nodes using "hdfs dfsadmin -report"
... View more
03-01-2018
09:02 AM
@rama I guess the issue here is due to incorrect mapping between the substr return type and the value being compared. I verified similar scenario and below are the details: hive> desc flight_details;
OK
flightnum string
tailnum string
uniquecarrier string
origin string
dest string
Time taken: 0.295 seconds, Fetched: 5 row(s)
hive> select * from flight_details where substr(tailnum,2,3)>=500 limit 10;
OK
1018 N828UA UA OAK ORD
1020 N567UA UA IAD BOS
1020 N561UA UA IAD BOS
1020 N554UA UA IAD BOS
1020 N535UA UA IAD BOS
1020 N571UA UA IAD BOS
1020 N530UA UA IAD BOS
1020 N553UA UA IAD BOS
1020 N525UA UA IAD BOS
1020 N585UA UA IAD BOS
... View more
12-19-2017
06:20 AM
@Ashnee Sharma Try below parameters and then run select count(*): set hive.compute.query.using.stats=true;
set hive.stats.fetch.column.stats=true;
set hive.stats.fetch.partition.stats=true;
set hive.fetch.task.conversion=more
... View more
11-28-2017
09:43 AM
@Ashnee SharmaFor INTERNAL tables, Hive manages the lifecycle of the table and data. When a Hive table is created, a corresponding Phoenix table is also created. Once the Hive table is dropped, the Phoenix table is also deleted. For EXTERNAL tables, Hive works with an existing Phoenix table and manages only Hive metadata. Dropping an EXTERNAL table from Hive deletes only Hive metadata but does not delete the Phoenix table. Refer https://phoenix.apache.org/hive_storage_handler.html
... View more
11-28-2017
06:16 AM
Hi @Mallik Sunkara If you want to change logging to ERROR for Hive services (not from Ambari), then change the logging under below files: /etc/hive/2.5.0.0-1245/0/conf.server/hive-log4j.properties /etc/hive/2.5.0.0-1245/0/conf.server/hive-exec-log4j.properties Also, fyi, if the services are Ambari, then these changes would be reverted when the services are restarted from Ambari.
... View more
11-27-2017
07:46 AM
@Ashnee Sharma The issue could be due to mismatch in the column cases of the Hive table columns being mapped to Phoenix table. Match the case of columns under phoenix.column.mapping for example, CREATE external db.test( teste_hive decimal(38,10) ,teste1_hive decimal(38,10) ) STORED BY 'org.apache.phoenix.hive.PhoenixStorageHandler' WITH SERDEPROPERTIES ( 'serialization.format'='1') TBLPROPERTIES ( 'COLUMN_STATS_ACCURATE'='{\"BASIC_STATS\":\"true\"}', 'phoenix.column.mapping’=“teste_hive:TESTE,teste1_hive:TESTE1”, 'phoenix.rowkeys’=’TESTE1’, 'phoenix.table.name'='TEST_PHOENIX_TABLE’, 'phoenix.zookeeper.client.port'='2181', 'phoenix.zookeeper.quorum'='x.com', 'phoenix.zookeeper.znode.parent'='/hbase-unsecure' );
... View more
11-09-2017
06:37 AM
@Ashnee Sharma Usually, it should be GA in next major release, but cannot confirm on that.
... View more
11-09-2017
05:34 AM
1 Kudo
@Ashnee Sharma Hive Phoenix handler is not a supported feature in HDP 2.5.x versions. This feature is available as Tech Preview feature starting HDP 2.6.2. Below is the document with list of TP features in HDP 2.6.2: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_release-notes/content/tech_previews.html
... View more