About smruti

smruti · ‎12-25-2023

@wert_1311 Are we talking about a DataHub/Data Engineering cluster or DataWarehouse? If you have a Cloudera Manager for the cluster, check under the configuration tab of respective services. You may search for "hive_log_dir". If you SSH to the specific AWS instance hosting Hive service, you should be able to find the service logs under that path.

smruti · ‎12-22-2023

@jayes please share the exact error. What do you mean error code 4? Is it exit code? The error must be getting logged to stdout/stderr. If nothing is getting logged, in the JDBC connection string could you also add "--verbose=true" e.g. bash /opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976/bin/../lib/hive/bin/beeline -u 'jdbc:hive2://machine1.domain.com:2181/default;password=***;principal=hive/_HOST@DOMAIN.COM;serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=*****;user=HiveUser;zooKeeperNamespace=hiveserver2' --showHeader=false --outputformat=tsv2 --verbose=true

smruti · ‎12-21-2023

@jayes The beeline command seems to be using both kerberos(principal) and username-password based authentication? What's the auth mechanism we are aiming for? Also, what's the error message? When you fork it from another process, which user the beeline command runs as? Within the JDBC connection string, we are trying to authenticate as "HiveUser" however we are also using -n switch and authenticating as loki user. It's confusing. We need not use "-n" in this case.

smruti · ‎12-15-2023

Cloudera's official statement on this subject can be found here. Cloudera supports various RDBMS options, each of which have multiple possible strategies to implement HA. Cloudera cannot reasonably test and certify on each strategy for each RDBMS. Cloudera expects HA solutions for RDBMS to be transparent to Cloudera software, and therefore are not supported and debugged by Cloudera. It is the responsibility of the customer to provision, configure, and manage the RDBMS HA deployment, so that Cloudera software behaves as it would when interfacing with a single, non-HA service.

smruti · ‎11-13-2023

@jayes Please make sure that you have set this property in "HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml" under Hive on Tez configuration. I tried this and it works for me: Beeline version 3.1.3000.7.1.7.2000-305 by Apache Hive 0: jdbc:hive2://c1649-node2.coelab.cloudera.c> set dfs.replication=1; No rows affected (0.208 seconds) 0: jdbc:hive2://c1649-node2.coelab.cloudera.c> set hive.security.authorization.sqlstd.confwhitelist.append; +----------------------------------------------------+ | set | +----------------------------------------------------+ | hive.security.authorization.sqlstd.confwhitelist.append=mapred\..*|hive\..*|mapreduce\..*|spark\..*|dfs\..* | +----------------------------------------------------+ 1 row selected (0.109 seconds)

smruti · ‎11-06-2023

@jayes Hive reads this parameter value from hdfs-site.xml. So, you should probably consider setting the value under HDFS service. Nevertheless, if you want to export that parameter in Hive/beeline cli, you could try setting 'hive.security.authorization.sqlstd.confwhitelist.append' correctly. e.g. <name>hive.security.authorization.sqlstd.confwhitelist.append</name> <value>mapred\..*|hive\..*|mapreduce\..*|spark\..*|dfs\..*</value>

smruti · ‎10-20-2023

@Kalpit Do check if you have any jars added to hive classpath using hive.aux.jars.path. Remove them and try once. It's possible that the jars added are not compatible with the current version.

smruti · ‎09-29-2023

@Srinivas-M You may set these properties in a safety valve for core-site.xml. CM UI > HDFS > Configuration > Cluster-wide Advanced Configuration Snippet (Safety Valve) for core-site.xml

smruti · ‎09-20-2023

@PetiaLeshiy Adding to @asish 's comment, as its a struct column, we could write the query something like this: SELECT * FROM TABLE_NAME LATERAL VIEW explode(struct_col_name.list_name) exploded_column AS xyz WHERE xyz IS NOT NULL; You may make changes where required.

smruti · ‎08-31-2023

we tried replicating the issue with the data shared by @Shivakuk . Left/Right Single/Double Quotation Mark(smart quotes) in the text did not show up correctly and got converted to ? . I was able to fix this issue by changing the LC_CTYPE from "UTF-8" to "en_US.UTF-8". Check "locale" command output: # locale LANG=en_US.UTF-8 LC_CTYPE=en_US.UTF-8 LC_NUMERIC="en_US.UTF-8" LC_TIME="en_US.UTF-8" LC_COLLATE="en_US.UTF-8" LC_MONETARY="en_US.UTF-8" LC_MESSAGES="en_US.UTF-8" LC_PAPER="en_US.UTF-8" LC_NAME="en_US.UTF-8" LC_ADDRESS="en_US.UTF-8" LC_TELEPHONE="en_US.UTF-8" LC_MEASUREMENT="en_US.UTF-8" LC_IDENTIFICATION="en_US.UTF-8" LC_ALL= See what your LC_CTYPE read. If it does not read "en_US.UTF-8", do the following: vi ~/.bash_profile Add the following two lines at the bottom: +++ LC_CTYPE=en_US.UTF-8 export LC_CTYPE +++ Save the file, and source it for it to take effect: #source ~/.bash_profile Now connect to beeline, and see if the data show up correctly.

Online	Offline
Last Visited	‎10-10-2025 03:01 AM

Member Since	‎10-28-2020 05:19 AM
Last Visited	‎10-10-2025 03:01 AM
Posts	622
Kudos received	46

Cloudera Community

Re: I have a HIVE table which contains JSON as a c...

Re: ANALYZE command not write data into hive metas...

Re: HBase stores base64 data when data is inserted...

Re: Deleting hive service on CDP Private Base and ...

Re: Not Able to run import command. it fails with ...

Re: HS2 & Hive Metastore logs on CDP PC

Re: Beeline command failing with error 4

Re: Beeline command failing with error 4

Re: MySQL HA for Cloudera CDP Provate Cloud Base D...

Re: Not able to set dfs.replication while running ...

Re: Not able to set dfs.replication while running ...

Re: Not able to start hive metastore in hive 3.1.3

Re: How to add custom properties for hadoop.proxyu...

Re: How not show null fields in hive(Hue, beeline)...

Re: Special characters are displayed as question m...