About deepesh1

deepesh1 · ‎05-12-2017

For enabling the SQL Std Auth manually you would need to set the following settings in the hive-site.xml before restarting the HiveServer2. hive.server2.enable.doAs=false hive.security.authorization.enabled=true hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.SessionStateUserAuthenticator hive.users.in.admin.role=<admin user> In the above <admin user> would be replaced by the user you want as admin. Note that you can perform admin operations after you connect to your beeline session as the admin user and then run the following command: set role ADMIN; For an Ambari controlled cluster recommendation would be to enable it through toggle on the Hive configs page.

deepesh1 · ‎05-10-2017

Can you check the status of WebHCat Server under Hive services? This typically means that WebHCat server is down.

deepesh1 · ‎05-05-2017

Can you try the following? http://vn1:50111/templeton/v1/ddl/database/?user.name=hive

deepesh1 · ‎05-03-2017

Can you try adding the property hadoop.security.auth_to_local to hive-site.xml as well, bounce the hive services and then try?

deepesh1 · ‎04-28-2017

The official hue rpm that is available with HDP-2.5/2.6 is hue-2.6.1. I don't see anyway to get more recent hue rpms for HDP stack.

deepesh1 · ‎04-28-2017

Yes, CBO is a client side property. You can disable at the beginning of query by specifying: set hive.cbo.enable=false;

deepesh1 · ‎04-28-2017

As the error message suggests, the containers launched by LLAP have failed, can you check the failed application logs?

deepesh1 · ‎04-28-2017

Yes, this (HIVE-14959) is a known issue in HDP-2.5.0 and is resolved in HDP-2.5.3.

deepesh1 · ‎04-27-2017

HiveServer2 transport mode can be set to http, clients will be able to connect using either the Zookeeper Service Discovery mode or directly to the HS2 server.

deepesh1 · ‎04-27-2017

If i understand your question, you want to connect to HiveServer2 using Zookeeper without having the client to worry about the transport mode. This is supported by the HiveServer2 feature - Zookeeper Service Discovery Mode. If you are using Ambari this is the default mode. With introduction of HIVE-11581, the JDBC url becomes very simple as none of the additional configuration parameters such as authentication mode, transport mode, or SSL parameters need to be specified, as they are retrieved from the ZooKeeper entries along with the hostname. JDBC URL: jdbc:hive2://<zookeeper quorum>/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2 The <zookeeper quorum> is the same as the value of hive.zookeeper.quorum configuration parameter in hive-site.xml/hivserver2-site.xml used by HiveServer2. Read more about it here.

deepesh1 · ‎04-27-2017

Are you seeing this when connecting using the hive cli? If that is the case you will need to kinit using the user keytab before invoking the hive cli.

deepesh1 · ‎04-27-2017

hive.server2.transport.mode values are either binary or http. hive.server2.authentication – Authentication mode, default NONE. Options are NONE (uses plain SASL), NOSASL, KERBEROS, LDAP, PAM and CUSTOM. Read more at https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2#SettingUpHiveServer2-Authentication/SecurityConfiguration. I believe Tableau is making you select the authentication mode and not the transport mode.

deepesh1 · ‎04-21-2017

Set the Superset database type to 'mysql' or 'postgresql'.

deepesh1 · ‎04-17-2017

This is a known issue, see more on how to get around here. https://community.hortonworks.com/questions/96619/druid-superset-wont-start-on-hdp-26.html

deepesh1 · ‎04-14-2017

HDP-2.5.0.2-3 looks like a specific patched release for SLES 11 SP3 with a Zookeeper fix (ZOOKEEPER-1936). Its essentially HDP-2.5.0.0 + ZOOKEEPER-1936 and its available only on SLES 11 SP3. For SLES 12, your options are For HDP-2.5.0.0 is http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.0.0/hdp.repo For HDP-2.5.3.0 (latest update release) is http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.3.0/hdp.repo

deepesh1 · ‎04-14-2017

Depending on the scale and complexity of table I can think of one of three ways: Export the data from Hive and Oracle as CSV file and diff the files Use Sqoop to pull the tables from Hive to Oracle or vice versa and write a join query to get the diff Programmatically use a simple JDBC client to fetch data from Oracle and Hive and compare

deepesh1 · ‎04-13-2017

Can you search your HDFS configs from Ambari UI?

deepesh1 · ‎04-12-2017

For HDP 2.6, supported OS are Centos 6/7/ppc, SLES 11/12, Debian 6/7, Ubuntu 12/14/16 https://community.hortonworks.com/articles/93067/hdp-26ambari-25-ga.html

deepesh1 · ‎04-12-2017

Sqoop allows you to export data from Hive to SQL Server, see Sqoop documentation here. A sample command to export a hive table would look like this: sqoop export --connect "jdbc:sqlserver://SQLHOST:9433;databaseName=DBNAME;user=USER;password=PASSWORD" --table TABLENAME --export-dir HDFS_EXPORT_DIR

deepesh1 · ‎04-11-2017

Application IDs are provided by Resource Manager to the client through the ApplicationSubmissionContext. More information can be found here: https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html

deepesh1 · ‎04-11-2017

The file_roll sink is pretty basic, the best it can provide is to turn off time based rolling by setting rollInterval to 0. In that case all events are written to a single file. If writing to hdfs is an option for you then look at the HDFS sink, it has lot more flexibility and more efficient.

deepesh1 · ‎04-11-2017

The status command that you used was fine, unfortunately WebHCat doesn't have any status command specifically for hive REST API call. Perhaps the webhcat.log has rolled over, can you do a directory listing of your webhcat log folder?

deepesh1 · ‎04-10-2017

Status check just verifies that the Templeton (aka webhcat) server is up, it doesn't mean that all different REST APIs will work. Can you post the output of the following command? grep "hive.metastore.uris" PATH_TO_WEBHCAT_LOG

deepesh1 · ‎04-10-2017

HDP 2.5 & 2.6 ship both Hive 1 and Hive 2 but the schema is Hive 2 based hence you might be seeing the issue.

deepesh1 · ‎04-10-2017

This is expected behavior for file_roll sink according to the Flume Guide. Basically the default roll interval for files written using file_roll sink is 30 seconds, so regardless of whether any events are written the file get rolled over.

deepesh1 · ‎04-07-2017

Can you attach a screenshot?

deepesh1 · ‎04-07-2017

If you are trying to determine the current database in your custom Hive UDF code, this should help https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/UDFCurrentDB.java From beeline / hive cli you can check by running: 0: jdbc:hive2://localhost> select current_database(); +----------+--+ | _c0 | +----------+--+ | default | +----------+--

deepesh1 · ‎04-07-2017

Just to be sure that permissions are correct does the following work? mysql -uhive -phivepass -hhdata2.edi.local

deepesh1 · ‎04-07-2017

This is a little bit different from your situation. Here the user was not using Ambari and believe his service was not actually running. In your case you should check Ambari Hive Summary page to see if your Hive Metastore service is up, if not start it using Ambari.

deepesh1 · ‎04-07-2017

You can use the "Refresh configs" option under the Service Actions dropdown on the Flume configs page. This will only refresh the configs and not restart Flume service. Flume agent process periodically polls for any changes to the agent config and will reload the changed config file automatically.

Online	Offline
Last Visited	‎05-09-2018 06:03 AM

Date Registered	‎09-25-2015 05:14 PM
Last Visited	‎05-09-2018 06:03 AM
Total Messages Posted	356
Total Kudos Received	379

Re: Hive 2 is missing after HDP upgrade

Re: Is Hortonworks HDP 2.6.0 supports Centos 6.9

Re: Add Service - BigSQL fails

Re: hi , I am having trouble connecting to beeline...

Re: Hive Metastore throws a null pointer exception

Re: hive with SQL Standard-based Authorization

Re: Getting alert.

Re: Webhcat show database error missing operand

Re: Hive not applying auth_to_local rules with Ker...

Re: Hue for HDP RPM

Re: Can Cost Based Optimization be configured per ...

Re: HiveServer2 Interactive Start failed

Re: Error: Error while compiling statement: FAILED...

Re: Transparant Hiverserver2 transport modes with ...

Re: Transparant Hiverserver2 transport modes with ...

Re: Exception in thread "main" java.lang.RuntimeEx...

Re: Ambari transport mode set to binary, but must ...

Re: Superset of Druid can't be started in HDP 2.6....

Re: Superset of Druid can't be started in HDP 2.6....

Re: Where to find a particular HDP-Stack repositor...

Re: Compare Tables between Hive and Oracle

Re: Hadoop Namenode hdfs.distro file referring to ...

Re: As new releases of HDP are rolled out (e.g. HD...

Re: How to transfer Hive data into Sql Server?

Re: Yarn: Application Id - How is it generated ?

Re: Flume sink type "file_roll" generates empty fi...

Re: hive rest api: java.net.URISyntaxException Mal...

Re: hive rest api: java.net.URISyntaxException Mal...

Re: HDP 2.6 Hive column type name is too long

Re: Flume sink type "file_roll" generates empty fi...

Re: Difference between two Hive "Cost Based Optimi...

Re: Get Database name within Hive UDF

Re: start Hive metastore process abend with MySQL ...

Re: Getting error while opening hive shell

Re: How to refresh flume agent configure without r...