Support Questions
Find answers, ask questions, and share your expertise

Hive issue while trying to create table or run any command . only two commands are running fine which are desc and select command.

Driver returned: 1. Errors: OK FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:java.io.IOException: Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is:

5 REPLIES 5

Re: Hive issue while trying to create table or run any command . only two commands are running fine which are desc and select command.

Rising Star

What are the ulimits for each hadoop user? Or at least for the ones trying to create the table.

Try to set them to a higher value

Re: Hive issue while trying to create table or run any command . only two commands are running fine which are desc and select command.

@Ashnee Sharma this is from our documentation.

  • dfs.datanode.max.locked.memory This property determines the maximum amount of memory (in bytes) that a DataNode will use for caching. The "locked-inmemory size" ulimit (ulimit -l) of the DataNode user also needs to be increased to exceed this parameter. When setting this value, remember that you will need space in memory for other things as well, such as the DataNode and application JVM heaps, and the operating system page cache.
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_hdfs_admin_tools/bk_hdfs_admin_tools-2016...

Re: Hive issue while trying to create table or run any command . only two commands are running fine which are desc and select command.

I found in logs :-

hive was pointed to non active NN. any idea why this hapepend, because we configured the HA and this issue occurred in production ?

Re: Hive issue while trying to create table or run any command . only two commands are running fine which are desc and select command.

It would be great if you can share the full exception trace. However this issue could be related to the ulimit setting for datanode process therefore please check the ulimit and try to increase it, if it doesn't help then kindly share the full exception trace log.

Re: Hive issue while trying to create table or run any command . only two commands are running fine which are desc and select command.

Issue was that Hive was pointed to non active NN. Will investigate why Hive is not picking up NNHA. any idea why this hapepend, because we configured the HA and this issue occurred in production.