Support Questions
Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Advanced Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Sqoop2Job

Highlighted

Sqoop2Job

Labels:
clouder
New Contributor

Created on ‎02-25-2019 11:19 PM - last edited on ‎02-26-2019 05:54 AM by Community Manager cjervis Community Manager

Hi,

 

I am trying to run sqoop2 job importing data from postgres to HDFS.

getting below error.

any leads...

 

2019-02-26 12:12:00,972 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1550828147878_0009_000002
2019-02-26 12:12:01,093 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: 
/************************************************************
[system properties]
os.name: Linux
os.version: 4.15.0-29-generic
java.home: /usr/lib/jvm/java-8-openjdk-amd64/jre
java.runtime.version: 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12
java.vendor: Oracle Corporation
java.version: 1.8.0_191
java.vm.name: OpenJDK 64-Bit Server VM
java.class.path: /opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001:/opt/hadoop/hadoop3.2/etc/hadoop:/opt/hadoop/hadoop3.2/share/hadoop/common/hadoop-common-3.2.0-tests.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/hadoop-nfs-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/hadoop-kms-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/hadoop-common-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-util-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/zookeeper-3.4.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/curator-recipes-2.12.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-io-2.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-server-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jetty-io-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/metrics-core-3.2.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/asm-5.0.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-common-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jetty-webapp-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jackson-databind-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jetty-util-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jetty-server-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerby-config-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/snappy-java-1.0.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/avro-1.7.7.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jersey-json-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-lang3-3.7.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/re2j-1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jetty-http-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jsr305-3.0.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jersey-core-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/json-smart-2.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerby-util-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/httpclient-4.5.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/hadoop-auth-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/accessors-smart-1.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/token-provider-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jsch-0.1.54.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/hadoop-annotations-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/netty-3.10.5.Final.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jersey-servlet-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/httpcore-4.4.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jetty-security-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-codec-1.11.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-client-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jetty-servlet-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jersey-server-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jackson-annotations-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-text-1.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/commons-net-3.6.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/curator-framework-2.12.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jetty-xml-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/dnsjava-2.1.7.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/stax2-api-3.1.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/curator-client-2.12.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/common/lib/jackson-core-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-rbf-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-client-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-native-client-3.2.0-tests.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-client-3.2.0-tests.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-nfs-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-3.2.0-tests.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-native-client-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/hadoop-hdfs-rbf-3.2.0-tests.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/zookeeper-3.4.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/curator-recipes-2.12.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-io-2.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-io-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/asm-5.0.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-webapp-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jackson-databind-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-util-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-server-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/xz-1.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-compress-1.4.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/avro-1.7.7.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-lang3-3.7.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/re2j-1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-http-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/json-smart-2.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/hadoop-auth-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jettison-1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/okio-1.6.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/hadoop-annotations-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-security-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/paranamer-2.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-servlet-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jackson-annotations-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/gson-2.2.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-text-1.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/commons-net-3.6.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/curator-framework-2.12.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jetty-xml-9.3.24.v20180605.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/curator-client-2.12.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/jackson-core-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/hdfs/lib/netty-all-4.0.52.Final.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-common-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-router-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-api-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-registry-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-services-core-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-common-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-client-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-submarine-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-services-api-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/hadoop-yarn-server-tests-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/guice-4.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/objenesis-1.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/json-io-2.5.1.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/jersey-client-1.19.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/jackson-jaxrs-base-2.9.5.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/java-util-1.9.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/yarn/lib/fst-2.50.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.2.0-tests.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.2.0.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/giraph-hcatalog-1.2.0-hadoop2.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/giraph-hbase-1.2.0-hadoop2.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/giraph-gora-1.2.0-hadoop2.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/giraph-accumulo-1.2.0-hadoop2.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/giraph-core-1.2.0-hadoop2.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/giraph-examples-1.2.0-hadoop2.jar:/opt/hadoop/hadoop3.2/share/hadoop/mapreduce/lib/giraph-block-app-1.2.0-hadoop2.jar:job.jar/*:job.jar/classes/:job.jar/lib/*:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/sqoop-connector-generic-jdbc-1.99.7.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/json-simple-1.1.1.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/sqoop-core-1.99.7.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/sqoop-connector-hdfs-1.99.7.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/sqoop-common-1.99.7.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/guava-11.0.2.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/connector-sdk-1.99.7.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/joda-time-2.4.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/sqoop-execution-mapreduce-1.99.7.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/connector-sdk-hadoop-1.99.7.jar:/opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/postgresql-42.2.5.jar
java.io.tmpdir: /opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001/tmp
user.dir: /opt/hadoop/hadoop3.2/logs/nodemanagerlogs/usercache/hadoop/appcache/application_1550828147878_0009/container_1550828147878_0009_02_000001
user.name: hadoop
************************************************************/
2019-02-26 12:12:01,156 INFO [main] org.apache.hadoop.security.SecurityUtil: Updating Configuration
2019-02-26 12:12:01,298 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: [Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 9 cluster_timestamp: 1550828147878 } attemptId: 2 } keyId: 328747556)]
2019-02-26 12:12:01,356 INFO [main] org.apache.hadoop.conf.Configuration: resource-types.xml not found
2019-02-26 12:12:01,357 INFO [main] org.apache.hadoop.yarn.util.resource.ResourceUtils: Unable to find 'resource-types.xml'.
2019-02-26 12:12:01,376 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter.
2019-02-26 12:12:01,378 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null
2019-02-26 12:12:01,411 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.sqoop.job.mr.SqoopNullOutputFormat$SqoopDestroyerOutputCommitter
2019-02-26 12:12:01,503 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.namenode.name.dir;  Ignoring.
2019-02-26 12:12:02,086 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2019-02-26 12:12:02,087 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2019-02-26 12:12:02,087 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2019-02-26 12:12:02,088 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2019-02-26 12:12:02,088 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2019-02-26 12:12:02,089 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2019-02-26 12:12:02,089 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2019-02-26 12:12:02,090 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2019-02-26 12:12:02,112 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://masterhadoop:9000]
2019-02-26 12:12:02,123 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://masterhadoop:9000]
2019-02-26 12:12:02,136 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://masterhadoop:9000]
2019-02-26 12:12:02,146 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
2019-02-26 12:12:02,147 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Not attempting to recover. Recovery is not supported by class org.apache.sqoop.job.mr.SqoopNullOutputFormat$SqoopDestroyerOutputCommitter. Use an OutputCommitter that supports recovery.
2019-02-26 12:12:02,163 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://masterhadoop:9000]
2019-02-26 12:12:02,166 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Previous history file is at hdfs://masterhadoop:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1550828147878_0009/job_1550828147878_0009_1.jhist
2019-02-26 12:12:02,498 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Starting to clean up previous job's temporary files
2019-02-26 12:12:02,533 ERROR [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.NoClassDefFoundError: org/apache/commons/lang/StringUtils
	at org.apache.sqoop.model.ConfigUtils.getConfigName(ConfigUtils.java:582)
	at org.apache.sqoop.model.ConfigUtils.fillValues(ConfigUtils.java:504)
	at org.apache.sqoop.job.mr.MRConfigurationUtils.loadConfiguration(MRConfigurationUtils.java:260)
	at org.apache.sqoop.job.mr.MRConfigurationUtils.getConnectorLinkConfig(MRConfigurationUtils.java:164)
	at org.apache.sqoop.job.mr.SqoopDestroyerExecutor.executeDestroyer(SqoopDestroyerExecutor.java:71)
	at org.apache.sqoop.job.mr.SqoopNullOutputFormat$SqoopDestroyerOutputCommitter$1.call(SqoopNullOutputFormat.java:87)
	at org.apache.sqoop.job.mr.SqoopNullOutputFormat$SqoopDestroyerOutputCommitter$1.call(SqoopNullOutputFormat.java:84)
	at org.apache.sqoop.utils.ClassUtils.executeWithClassLoader(ClassUtils.java:281)
	at org.apache.sqoop.job.mr.SqoopNullOutputFormat$SqoopDestroyerOutputCommitter.invokeDestroyerExecutor(SqoopNullOutputFormat.java:83)
	at org.apache.sqoop.job.mr.SqoopNullOutputFormat$SqoopDestroyerOutputCommitter.abortJob(SqoopNullOutputFormat.java:76)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.cleanUpPreviousJobOutput(MRAppMaster.java:1407)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1222)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$6.run(MRAppMaster.java:1761)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1757)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1691)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 19 more
2019-02-26 12:12:02,536 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.lang.NoClassDefFoundError: org/apache/commons/lang/StringUtils
Reply
362 Views
0 Kudos
1 REPLY 1
Highlighted

Re: Sqoop2Job

Jerry
Rising Star

Created ‎03-05-2019 07:36 AM

Hi,

From the shared exception it seems you are hitting bug "SQOOP-2999".

A change to sqoop (SQOOP-2737) introduced a new class OracleUtils which has a dependency on org.apache.commons.lang3.StringUtils. Unfortunately the jar that fulfills this dependency is not on the classpath that Sqoop passes to the mappers.

As a workaround add the jar manually

sqoop import -libjars /opt/cloudera/parcels/CDH/jars/commons-lang3-3.1.jar

Let us know if any questions

Thanks
Jerry
Reply
302 Views
0 Kudos
Don't have an account?
Register
Coming from Hortonworks? Activate your account here