@jayes If we intend to use kerberos auth, we need to pass username in the connection string. Remove "user=loki" and also two usernames we passed using "-n". -n loki -n /tmp/cmdcvhive.3935975.140226804802880  In Beeline '-n' is used to pass the username for authentication purpose. If we are using kerberos, then we can avoid this completely.  Please review your script and fix it wherever this is coming from. Unless we review the complete script, it will be difficult to say what's causing this issue. ... View more

@wert_1311 Are we talking about a DataHub/Data Engineering cluster or DataWarehouse? If you have a Cloudera Manager for the cluster, check under the configuration tab of respective services. You may search for "hive_log_dir". If you SSH to the specific AWS instance hosting Hive service, you should be able to find the service logs under that path. ... View more

@jayes please share the exact error. What do you mean error code 4? Is it exit code? The error must be getting logged to stdout/stderr. If nothing is getting logged, in the JDBC connection string could you also add "--verbose=true"  e.g. bash /opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976/bin/../lib/hive/bin/beeline -u 'jdbc:hive2://machine1.domain.com:2181/default;password=***;principal=hive/_HOST@DOMAIN.COM;serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=*****;user=HiveUser;zooKeeperNamespace=hiveserver2' --showHeader=false --outputformat=tsv2 --verbose=true ... View more

@jayes The beeline command seems to be using both kerberos(principal) and username-password based authentication? What's the auth mechanism we are aiming for? Also, what's the error message? When you fork it from another process, which user the beeline command runs as?  Within the JDBC connection string, we are trying to authenticate as "HiveUser" however we are also using -n switch and authenticating as loki user. It's confusing. We need not use "-n" in this case. ... View more

@jayes Please make sure that you have set this property in "HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml" under Hive on Tez configuration. I tried this and it works for me: Beeline version 3.1.3000.7.1.7.2000-305 by Apache Hive 0: jdbc:hive2://c1649-node2.coelab.cloudera.c> set dfs.replication=1; No rows affected (0.208 seconds) 0: jdbc:hive2://c1649-node2.coelab.cloudera.c> set hive.security.authorization.sqlstd.confwhitelist.append; +----------------------------------------------------+ | set | +----------------------------------------------------+ | hive.security.authorization.sqlstd.confwhitelist.append=mapred\..*|hive\..*|mapreduce\..*|spark\..*|dfs\..* | +----------------------------------------------------+ 1 row selected (0.109 seconds) ... View more

@PetiaLeshiy Adding to @asish 's comment, as its a struct column, we could write the query something like this: SELECT * FROM TABLE_NAME LATERAL VIEW explode(struct_col_name.list_name) exploded_column AS xyz WHERE xyz IS NOT NULL; You may make changes where required. ... View more