Driver returned: 1. Errors: OK FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:java.io.IOException: Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is:
What are the ulimits for each hadoop user? Or at least for the ones trying to create the table.
Try to set them to a higher value
@Ashnee Sharma this is from our documentation.
I found in logs :-
hive was pointed to non active NN. any idea why this hapepend, because we configured the HA and this issue occurred in production ?
It would be great if you can share the full exception trace. However this issue could be related to the ulimit setting for datanode process therefore please check the ulimit and try to increase it, if it doesn't help then kindly share the full exception trace log.
Issue was that Hive was pointed to non active NN. Will investigate why Hive is not picking up NNHA. any idea why this hapepend, because we configured the HA and this issue occurred in production.