Cloudera Community
jayes
user rank
Contributor

Re: Beeline command failing with error 4

by Contributor in Support Questions
‎12-26-2023 10:49 PM
‎12-26-2023 10:49 PM
Hello @smruti , Please let me know if any way where we can have call or meet to review the script ? I will in mean time will try to remove the -n options and check if that works. ... View more

Re: Beeline command failing with error 4

by Contributor in Support Questions
‎12-25-2023 11:13 PM
‎12-25-2023 11:13 PM
Hi @smruti , Yes the exit code is 4. I tried to redirect the stdout and stderr to the file but there was no file created. Following is output of ps -eaf :  loki 3936766 3935975 0 02:06 ? 00:00:00 bash /opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976/bin/../lib/hive/bin/beeline -u 'jdbc:hive2://machine.domain.com:2181/default;password=**;principal=hive/_HOST@DEVEMC.COMMVAULT.COM;serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=***;user=loki;zooKeeperNamespace=hiveserver2' -n loki -n /tmp/cmdcvhive.3935975.140226804802880 --showHeader=false --outputformat=tsv2 --verbose=true -e 'use underscoretest; show tables;' >> /tmp/file 2>&1 loki 3936766 3935975 2 02:06 ? 00:00:00 bash /opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976/bin/../lib/hive/bin/beeline -u 'jdbc:hive2://machine.domain.com:2181/default;password=**;principal=hive/_HOST@DEVEMC.COMMVAULT.COM;serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=**;user=loki;zooKeeperNamespace=hiveserver2' -n loki -n /tmp/cmdcvhive.3935975.140226804802880 --showHeader=false --outputformat=tsv2 --verbose=true -e 'use underscoretest; show tables;' >> /tmp/file 2>&1 ... View more

Re: Beeline command failing with error 4

by Contributor in Support Questions
‎12-22-2023 03:19 AM
‎12-22-2023 03:19 AM
Hi @smruti , The setup has kerberos authentication.  There is no error message the moment the process is launched with loki user, the process exits with error 4. Sorry but the HiveUser and loki user is same its just replacing the username went wrong. The same command when i do su loki and then run the same command it works. or if the same command is ran using sudo it works. Issue is with launching it with other process.  ... View more

Re: Beeline command failing with error 4

by Contributor in Support Questions
‎12-22-2023 03:16 AM
‎12-22-2023 03:16 AM
Hi @cloude , Which logs should i share cause the moment the beeline command is launched in another process it fails. so i dont have a way to check why is it failing. it just says process exited with error 4. Can you please help here to know which logs file might have those error ? ... View more

Beeline command failing with error 4

by Contributor in Support Questions
‎12-19-2023 01:59 AM
‎12-19-2023 01:59 AM
Hello Team, I am running a process in which i am trying to run beeline command. While running beeline command with sudo it is working but if i am trying to run beeline in a process which if forked from parent process with the hive user it is failing with error 4  Can you please help me to debug what's going wrong or anything that i need to set. If i do su hiveuser and run the same command t works but while running via process it is failing. Command that i see while running via fork process : bash /opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976/bin/../lib/hive/bin/beeline -u 'jdbc:hive2://machine1.domain.com:2181/default;password=***;principal=hive/_HOST@DOMAIN.COM;serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=*****;user=HiveUser;zooKeeperNamespace=hiveserver2' -n loki -n /tmp/cmdcvhive.4015998.140520474391872 --showHeader=false --outputformat=tsv2 -e 'use underscoretest; show tables;' ... View more
Labels:

Re: Not able to set dfs.replication while running ...

by Contributor in Support Questions
‎11-06-2023 10:27 PM
‎11-06-2023 10:27 PM
Hi @smruti , Yes agree that we can set parameter in hdfs-site.xml, so that it will reflect, but i dont want to change replication factor of whole cluster. Its just while running command i want to change. i tried setting the property in hive-site.xml on all 3 nodes of cluster and restarted the hive service, but still it is failing with same error. <property> <name>hive.security.authorization.sqlstd.confwhitelist.append</name> <value>mapred\..*|hive\..*|mapreduce\..*|spark\..*|dfs\..*</value> </property> Error : Connected to: Apache Hive (version 3.1.3000.7.1.7.0-551) Driver: Hive JDBC (version 3.1.3000.7.1.7.0-551) Transaction isolation: TRANSACTION_REPEATABLE_READ Error: Error while processing statement: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime (state=42000,code=1)     ... View more

Re: Not able to set dfs.replication while running ...

by Contributor in Support Questions
‎11-06-2023 10:03 PM
‎11-06-2023 10:03 PM
IT is still not working tried from the beeline shell too ... View more

Re: Not able to set dfs.replication while running ...

by Contributor in Support Questions
‎11-06-2023 10:03 PM
‎11-06-2023 10:03 PM
0: jdbc:hive2://machine1.***.***.c> show databases; INFO : Compiling command(queryId=hive_20231107010124_eaff8e06-cd0a-4484-a1b0-80f9eb2bae64): show databases INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) INFO : Completed compiling command(queryId=hive_20231107010124_eaff8e06-cd0a-4484-a1b0-80f9eb2bae64); Time taken: 0.038 seconds INFO : Executing command(queryId=hive_20231107010124_eaff8e06-cd0a-4484-a1b0-80f9eb2bae64): show databases INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=hive_20231107010124_eaff8e06-cd0a-4484-a1b0-80f9eb2bae64); Time taken: 0.037 seconds INFO : OK +---------------------+ | database_name | +---------------------+ | default | | information_schema | | largedb | | newtest | | sys | | testdb | | underscore | | underscoretest | +---------------------+ 0: jdbc:hive2://machine1.***.***.c> set def-replication=1; Error: Error while processing statement: Cannot modify def-replication at runtime. It is not in list of params that are allowed to be modified at runtime (state=42000,code=1)   ... View more

Not able to set dfs.replication while running beel...

by Contributor in Support Questions
‎11-05-2023 08:53 PM
‎11-05-2023 08:53 PM
Hello Team, I am trying to run beeline commandline to export the hive table to a location. i am trying to set replication factor to 1 but it if failing with following error : Error: Error while processing statement: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime (state=42000,code=1) Cluster details : 3 nodes cluster  and in all hvie-site.xml i have set the following property and then restarted hive and hiveserver2  <property> <name>hive.security.authorization.sqlstd.confwhitelist.append</name> <value>mapred.*|hive.*|mapreduce.*|spark.*|dfs.*</value> </property> Beeline Command :  sudo -u hive beeline -u "jdbc:hive2://machine1.dev.domain.com:2181/default;password=hive;principal=hive/_HOST@DEV.domain.COM;serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=****;user=hive;zooKeeperNamespace=hiveserver2" -n hive--showHeader=false --outputformat=tsv2 -e "Set dfs.replication=1; use testdb; export table newt1 to '/staging/exporttable/testdb/newt1';" --------------------------------------------------------------------------------------------------------------------- sudo -u hive beeline -u "jdbc:hive2://machine1.dev.domain.com:2181/default;password=hive;principal=hive/_HOST@DEV.domain.COM;serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=****;user=hive;zooKeeperNamespace=hiveserver2"  --hiveconf dfs.replication=1  -n hive--showHeader=false --outputformat=tsv2 -e "use testdb; export table newt1 to '/staging/exporttable/testdb/newt1';" Error :  23/10/31 02:01:14 [main]: ERROR jdbc.Utils: Unable to read HiveServer2 configs from ZooKeeper Error: Could not open client transport for any of the Server URI's in ZooKeeper: Failed to open new session: java.lang.IllegalArgumentException: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime (state=08S01,code=0) ... View more
Labels:

Re: Not able to set dfs.replication while running ...

by Contributor in Support Questions
‎10-30-2023 11:05 PM
‎10-30-2023 11:05 PM
Hi @rki_ , i tired that but still it is failing with same error. sudo -u hive beeline -u "jdbc:hive2://machine1.dev.domain.com:2181/default;password=hive;principal=hive/_HOST@DEV.domain.COM;serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;trustStorePassword=****;user=hive;zooKeeperNamespace=hiveserver2"  --hiveconf dfs.replication=1  -n hive--showHeader=false --outputformat=tsv2 -e "use testdb; export table newt1 to '/staging/exporttable/testdb/newt1';" Error :  23/10/31 02:01:14 [main]: ERROR jdbc.Utils: Unable to read HiveServer2 configs from ZooKeeper Error: Could not open client transport for any of the Server URI's in ZooKeeper: Failed to open new session: java.lang.IllegalArgumentException: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime (state=08S01,code=0) ... View more
Contact Me
Online
Offline
Last Visited
‎10-28-2024 01:19 AM
Community Statistics
Member Since ‎09-26-2023 06:53 AM
Last Visited ‎10-28-2024 01:19 AM
Posts 24
Kudos received 6