it's throwing me following error if I have multiple column family in my Hbase table. Does this approach works only for the single column family ? java.lang.RuntimeException: Hive Runtime Error while closing operators: java.io.IOException: Multiple family directories found in hdfs://hadoopdev/apps/hive/warehouse/temp.db/employee_details/_temporary/0/_temporary/attempt_1527799542731_1180_r_000000_0 ... View more

@Naresh P R I am using following repo and it resolve my issue http://repo.hortonworks.com/content/groups/public/ ... View more

@Naresh P R Thanks, Now I can resolve the dependancy However, not able to compile the code. I am getting following error. I tried to add the dependancy mentioned, However it's not helping either. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.2-beta-5:single (default-cli) on project hive-normalize: Failed to create assembly: Failed to resolve dependencies for project: ca.abc:hive-normalize:jar:1.0: Missing: [ERROR] ---------- [ERROR] 1) org.mortbay.jetty:jetty-util:jar:6.1.ca26.hwx [ERROR] [ERROR] Try downloading the file manually from the project website. [ERROR] [ERROR] Then, install it using the command: [ERROR] mvn install:install-file -DgroupId=org.mortbay.jetty -DartifactId=jetty-util -Dversion=6.1.26.hwx -Dpackaging=jar -Dfile=/path/to/file [ERROR] [ERROR] Alternatively, if you host your own repository you can deploy the file there: [ERROR] mvn deploy:deploy-file -DgroupId=org.mortbay.jetty -DartifactId=jetty-util -Dversion=6.1.26.hwx -Dpackaging=jar -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] [ERROR] [ERROR] Path to dependency: [ERROR] 1) ca.abc:hive-normalize:jar:1.0 [ERROR] 2) org.apache.hive:hive-exec:jar:1.2.1000.2.6.4.0-91 [ERROR] 3) org.apache.hive:hive-shims:jar:1.2.1000.2.6.4.0-91 [ERROR] 4) org.apache.hive.shims:hive-shims-0.23:jar:1.2.1000.2.6.4.0-91 [ERROR] 5) org.apache.hadoop:hadoop-hdfs:jar:2.7.3.2.6.4.0-91 [ERROR] 6) org.mortbay.jetty:jetty-util:jar:6.1.26.hwx [ERROR] [ERROR] 2) org.mortbay.jetty:jetty:jar:6.1.26.hwx [ERROR] [ERROR] Try downloading the file manually from the project website. [ERROR] [ERROR] Then, install it using the command: [ERROR] mvn install:install-file -DgroupId=org.mortbay.jetty -DartifactId=jetty -Dversion=6.1.26.hwx -Dpackaging=jar -Dfile=/path/to/file [ERROR] [ERROR] Alternatively, if you host your own repository you can deploy the file there: [ERROR] mvn deploy:deploy-file -DgroupId=org.mortbay.jetty -DartifactId=jetty -Dversion=6.1.26.hwx -Dpackaging=jar -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] [ERROR] [ERROR] Path to dependency: [ERROR] 1) ca.abc:hive-normalize:jar:1.0 [ERROR] 2) org.apache.hive:hive-exec:jar:1.2.1000.2.6.4.0-91 [ERROR] 3) org.apache.hive:hive-shims:jar:1.2.1000.2.6.4.0-91 [ERROR] 4) org.apache.hive.shims:hive-shims-0.23:jar:1.2.1000.2.6.4.0-91 [ERROR] 5) org.apache.hadoop:hadoop-hdfs:jar:2.7.3.2.6.4.0-91 [ERROR] 6) org.mortbay.jetty:jetty:jar:6.1.26.hwx [ERROR] [ERROR] 3) org.mortbay.jetty:jetty-sslengine:jar:6.1.26.hwx [ERROR] [ERROR] Try downloading the file manually from the project website. [ERROR] [ERROR] Then, install it using the command: [ERROR] mvn install:install-file -DgroupId=org.mortbay.jetty -DartifactId=jetty-sslengine -Dversion=6.1.26.hwx -Dpackaging=jar -Dfile=/path/to/file [ERROR] [ERROR] Alternatively, if you host your own repository you can deploy the file there: [ERROR] mvn deploy:deploy-file -DgroupId=org.mortbay.jetty -DartifactId=jetty-sslengine -Dversion=6.1.26.hwx -Dpackaging=jar -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] [ERROR] [ERROR] Path to dependency: [ERROR] 1) ca.abc:hive-normalize:jar:1.0 [ERROR] 2) org.apache.hive:hive-exec:jar:1.2.1000.2.6.4.0-91 [ERROR] 3) org.apache.hive:hive-shims:jar:1.2.1000.2.6.4.0-91 [ERROR] 4) org.apache.hive.shims:hive-shims-0.23:jar:1.2.1000.2.6.4.0-91 [ERROR] 5) org.apache.hadoop:hadoop-yarn-server-resourcemanager:jar:2.7.3.2.6.4.0-91 [ERROR] 6) org.apache.hadoop:hadoop-yarn-server-common:jar:2.7.3.2.6.4.0-91 [ERROR] 7) org.apache.hadoop:hadoop-yarn-registry:jar:2.7.3.2.6.4.0-91 [ERROR] 8) org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.4.0-91 [ERROR] 9) org.mortbay.jetty:jetty-sslengine:jar:6.1.26.hwx [ERROR] [ERROR] ---------- [ERROR] 3 required artifacts are missing. [ERROR] [ERROR] for artifact: [ERROR] ca.abc:hive-normalize:jar:1.0 [ERROR] [ERROR] from the specified remote repositories: [ERROR] hortonworks.extrepo (http://repo.hortonworks.com/content/repositories/releases, releases=true, snapshots=true), [ERROR] central (https://repo.maven.apache.org/maven2, releases=true, snapshots=false) [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException ... View more

@bkosaraju HDFS file has UTF-8 encoding and Netezza table also has UTF-8 encoding. the problem is with NFC (normalization) ... View more

The issue was with the /n character at the end of the file. It works perfectly without issue on Netezza however it creates an issue on SQL Server following command to create new password file resolved the issue. tr -d '\n' < sqlserver_password.pass > sqlserver.pass ... View more

@Rahul Soni Thanks for the great explanation. just a quick question, is there a way I can modify that value. Just in case if I need to restart the flow from some specific point ... View more

@Constantin Stanca could you please explain the approach in detail. ... View more