About shyamshaw

shyamshaw · ‎08-18-2017

@Rajesh Balamohan We are also facing the similar issue. Please let us know if there are any fixes available or any plan for fix in future releases for HDP. HDP 2.5.3 (EC2 Instances), Hive 1.2.1 Thanks..

shyamshaw · ‎08-18-2017

You can try below workaround. -Create merged temp table (old data + new data) using union all -Insert overwrite the final table with merged data -Drop temp table .

shyamshaw · ‎07-09-2017

@Gaurav Mallikarjuna Try the below command and see if it works for you. In my environment, hive.server2.zookeeper.namespace is set to hiveserver2. Try to put the command within quotes. [hdfs@hadoopnn01 ~]$ beeline -u "jdbc:hive2://hadoopnn01.infoshop.com.tr:2181,hadoop01.infoshop.com.tr:2181,hadoopnn02.infoshop.com.tr:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2" WARNING: Use "yarn jar" to launch YARN applications. Connecting to jdbc:hive2://hadoopnn01.infoshop.com.tr:2181,hadoop01.infoshop.com.tr:2181,hadoopnn02.infoshop.com.tr:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2 Connected to: Apache Hive (version 1.2.1000.2.4.3.0-227) Driver: Hive JDBC (version 1.2.1000.2.4.3.0-227) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.2.1000.2.4.3.0-227 by Apache Hive 0: jdbc:hive2://hadoopnn01.infoshop.com.tr:21> https://community.hortonworks.com/questions/1342/how-to-enable-zookeeper-discovery-for-hiveserver2.html

shyamshaw · ‎06-28-2017

Hi @Scott Shaw Thank you so much.. We will test this feature..

shyamshaw · ‎06-28-2017

Hi Everyone, We are working on configuring LLAP where we need to use only 5 dedicated servers. We found that we can choose the number on nodes used by LLAP but can we also select the hosts/nodes for llap. Any help on this?

shyamshaw · ‎06-16-2017

@Robert Levas Thanks for the quick response. After removing entries in the kerberos_principal_host and kerberos_principal, it worked.

shyamshaw · ‎06-15-2017

We have configured Hive LLAP in our existing environment for testing purpose. Cluster setup has been done using Service User Accounts present in AD. We tried to Enable Kerberos today and it got failed in Create Keytabs steps with below error message: stderr: errors-257.txt 2017-06-15 20:09:24,381 - Failed to create keytab for hive_llap-061517@TESTING.COM, missing cached file stdout: output-257.txt 2017-06-15 20:09:24,315 - Processing identities... 2017-06-15 20:09:24,378 - Creating keytab file for hive_llap-061517@TESTING.COM on host master1.TESTING.com 2017-06-15 20:09:24,380 - Creating keytab file for hive_llap-061517@TESTING.COM on host data1.TESTING.com It seems that ambari is trying to create keytabs on linux hosts. we configured hive LLAP through ambari only. Any help on this issue?

shyamshaw · ‎06-04-2017

@Namit Maheshwari @Dominika Bialek Thanks for your response.

shyamshaw · ‎06-02-2017

We are facing issues while trying to configure Hadoop cluster to use Server Side Encryption on Amazon S3. Error Message: Error: java.lang.RuntimeException: Hive Runtime Error while closing operators: org.apache.hadoop.fs.s3a.AWSS3IOException: saving output on XXX.db/.hive-staging_hive_2017-06-02_05-35-09_761_2361068000315861367-1/_task_tmp.-ext-10001/_tmp.000000_3: com.amazonaws.services.s3.model.AmazonS3Exception: The encryption method specified is not supported (Service: Amazon S3; Status Code: 400; Error Code: InvalidArgument; Request ID: DBE44B5B11EA4CAC), S3 Extended Request ID: 0S6KxrK+bNFU0uZAZVju1EpL1QIGH4bvmbffWNxb/BR3r5540ZWQ47Qtk/L/WIWReO239mfkxYM=: The encryption method specified is not supported (Service: Amazon S3; Status Code: 400; Error Code: InvalidArgument; Request ID: DBE44B5B11EA4CAC) HDP Version-2.5.3.0 Ambari Version-2.4.2.0 Hive-1.2.1 https://issues.apache.org/jira/browse/HADOOP-13075. Does hdp support SSE-KMS? If yes, then what are the required configuration? Note: We can use SSE-S3 Encryption (AES256) without any issues. Added below property in core-site.xml to use SSE-KMS. <property> <name>fs.s3a.server-side-encryption-algorithm</name> <value>SSE-KMS</value> </property> <property> <name>fs.s3a.server-side-encryption-key</name> <value>your_kms_key_id</value> </property>

shyamshaw · ‎05-02-2017

@Raagul S Did you looked at https://github.com/cloudera/hue/issues/193

Online	Offline
Last Visited	‎02-28-2020 06:33 AM

Member Since	‎10-26-2016 06:42 AM
Last Visited	‎02-28-2020 06:33 AM
Posts	98
Kudos received	11

Cloudera Community

Re: How to restart/refresh client config on all th...

Re: Receiving Error "Incorrect string value: '\xC5...

Re: Keys Backup other than PostgreS DB backup

Re: We are getting below error when trying to read...

Re: Hive Insert Into S3 External Table Overwrites ...

Re: Hive Insert Into S3 External Table Overwrites ...

Re: Beeline -u "JDBC:hive2://url..." -n username ...

Re: Can we also select dedicated hosts/nodes which...

Can we also select dedicated hosts/nodes which can...

Re: AD Kerberos setup is failing in Create Keytabs...

AD Kerberos setup is failing in Create Keytabs ste...

Re: Issue while configuring Encryption (SSE-KMS) f...

Issue while configuring Encryption (SSE-KMS) for A...

Re: How to change the default logs path of HUE?