Yes, that's been the usual JVM behaviour for class-loaders (pick classes from the earliest classpath entry presenting it), so we are effectively reordering our classpath to rely on that. ... View more

No, the illustrated technique prepends to a default classpath, and does not replace/overwrite it. To be extra safe though, if you already are using HADOOP_CLASSPATH for something else, you may also do it this way: export HADOOP_CLASSPATH=/path/to/O-9.jar:$HADOOP_CLASSPATH export HADOOP_USER_CLASSPATH_FIRST=true sqoop …rest of args… ... View more

The HDFS Balancer only balances on HDFS Used % per DataNode. If your disk space fillup is for reasons other than DFS utilised space, then that tool will not resolve it. You can look at the 'dfsadmin -report' to see the DFS Used % values per DN, and if they are all within 10±% of each other, then the Balancer is not at fault here. Have you tried checking what is consuming space on the affected hosts? Is it the DN dirs holding the space, or is it something from YARN/etc.? ... View more

Glad to hear you were able to resolve it. Please consider marking the topic solved so others with similar issues may find it quicker! If the directory of config XML files is on the classpath of the program, then the Configuration instance will automatically discover them (ClassLoader.getResource(…) style). ... View more

Glad to hear you were able to figure it out! In spirit of https://xkcd.com/979/, please consider sharing more details of the solution and marking the topic as solved for others with similar issues. ... View more

The transaction manager cannot be set on a per-query basis - it can be set at the HS2 config. Note that we do not recommend use of the transaction manager features currently: http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_rn_hive_ki.html ... View more