Cloudera Community
t1
user rank
Explorer

Unable to execute import-hive.sh

by Explorer in Support Questions
‎07-12-2021 11:26 PM
‎07-12-2021 11:26 PM
hadoop@0.0.0.0:~/apache-atlas-2.1.0/hook/apache-atlas-hive-hook-2.1.0/hook-bin$ ./import-hive.sh Using Hive configuration directory [/home/hadoop/hive/conf] Log file for import is /home/hadoop/apache-atlas-2.1.0/hook/apache-atlas-hive-hook-2.1.0/logs/import-hive.log 2021-07-13T06:16:50,895 INFO [main] org.apache.atlas.ApplicationProperties - Looking for atlas-application.properties in classpath 2021-07-13T06:16:50,897 INFO [main] org.apache.atlas.ApplicationProperties - Loading atlas-application.properties from file:/home/hadoop/hive/conf/atlas-application.properties 2021-07-13T06:16:50,947 INFO [main] org.apache.atlas.ApplicationProperties - Using graphdb backend 'janus' 2021-07-13T06:16:50,947 INFO [main] org.apache.atlas.ApplicationProperties - Using storage backend 'hbase2' 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Using index backend 'solr' 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Atlas is running in MODE: PROD. 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Setting solr-wait-searcher property 'true' 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Setting index.search.map-name property 'false' 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Setting atlas.graph.index.search.max-result-set-size = 150 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Property (set to default) atlas.graph.cache.db-cache = true 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Property (set to default) atlas.graph.cache.db-cache-clean-wait = 20 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Property (set to default) atlas.graph.cache.db-cache-size = 0.5 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Property (set to default) atlas.graph.cache.tx-cache-size = 15000 2021-07-13T06:16:50,948 INFO [main] org.apache.atlas.ApplicationProperties - Property (set to default) atlas.graph.cache.tx-dirty-size = 120 Enter username for atlas :- admin Enter password for atlas :- Exception in thread "main" java.lang.NoClassDefFoundError: com/sun/jersey/core/util/FeaturesAndProperties at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:756) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:468) at java.net.URLClassLoader.access$100(URLClassLoader.java:74) at java.net.URLClassLoader$1.run(URLClassLoader.java:369) at java.net.URLClassLoader$1.run(URLClassLoader.java:363) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:362) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:134) Caused by: java.lang.ClassNotFoundException: com.sun.jersey.core.util.FeaturesAndProperties at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 13 more Failed to import Hive Meta Data!!!   Hi Team While running import-hive.sh getting above error. Could you please help me out on this.   Thanks Venkat ... View more
Labels:

Re: While running sqoop import from MySQL to Hive ...

by Explorer in Support Questions
‎07-07-2021 05:12 AM
‎07-07-2021 05:12 AM
@Shelton    I have copied avro-1.8.1.jar and commons-lang3-3.1.jar both jars. It's working now .   Thanks for your response . ... View more

Re: While running sqoop import from MySQL to Hive ...

by Explorer in Support Questions
‎07-05-2021 07:22 AM
‎07-05-2021 07:22 AM
@Shelton  After adding also getting same error:   Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/avro/LogicalType at org.apache.sqoop.manager.DefaultManagerFactory.accept(DefaultManagerFactory.java:67) at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:184) at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:272) at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:96) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:616) at org.apache.sqoop.Sqoop.run(Sqoop.java:147) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243) at org.apache.sqoop.Sqoop.main(Sqoop.java:252) Caused by: java.lang.ClassNotFoundException: org.apache.avro.LogicalType at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 11 more   I am trying to execute below command : sqoop list-databases \ --connect jdbc:mysql://localhost:3306/ \ --username root \ --password root   For this also getting above error. ... View more

Re: While running sqoop import from MySQL to Hive ...

by Explorer in Support Questions
‎07-05-2021 04:49 AM
‎07-05-2021 04:49 AM
@Shelton  sqoop import \ > --connect jdbc:mysql://localhost:3306/sample \ > --username root \ > --table test \ > --hive-import \ > --fields-terminated-by "," --hive-import --create-hive-table --hive-table sample.tesr --m 4 Warning: /home/hadoop/sqoop-1.4.7/../hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /home/hadoop/sqoop-1.4.7/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. Warning: /home/hadoop/sqoop-1.4.7/../zookeeper does not exist! Accumulo imports will fail. Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation. 21/07/05 11:39:26 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7 Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/avro/LogicalType at org.apache.sqoop.manager.DefaultManagerFactory.accept(DefaultManagerFactory.java:67) at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:184) at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:272) at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:96) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:616) at org.apache.sqoop.Sqoop.run(Sqoop.java:147) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243) at org.apache.sqoop.Sqoop.main(Sqoop.java:252) Caused by: java.lang.ClassNotFoundException: org.apache.avro.LogicalType at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 11 more ... View more

While running sqoop import from MySQL to Hive gett...

by Explorer in Support Questions
‎07-04-2021 08:39 AM
‎07-04-2021 08:39 AM
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/avro/LogicalType at org.apache.sqoop.manager.DefaultManagerFactory.accept(DefaultManagerFactory.java:67) at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:184) at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:272) at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:96) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:616) at org.apache.sqoop.Sqoop.run(Sqoop.java:147) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243) at org.apache.sqoop.Sqoop.main(Sqoop.java:252) Caused by: java.lang.ClassNotFoundException: org.apache.avro.LogicalType at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 11 more   Could you please help me with this. Thanks in Advance. Regards, Venkataramana  ... View more
Labels:

Re: while running import-hive.sh script getting be...

by Explorer in Support Questions
‎06-27-2021 11:46 PM
‎06-27-2021 11:46 PM
@Scharan  Below path i am using in hive-env.sh   export HIVE_AUX_JARS_PATH=/mnt/apache-atlas-2.1.0/hook/hive ... View more

Re: while running import-hive.sh script getting be...

by Explorer in Support Questions
‎06-27-2021 10:57 PM
‎06-27-2021 10:57 PM
ls -lrth /mnt/apache-atlas-2.1.0/hook/hive/atlas-hive-plugin-impl/ total 14M -rw-r--r-- 1 root root 53K Jun 18 06:45 jersey-multipart-1.19.jar -rw-r--r-- 1 root root 162K Jun 18 06:45 jersey-json-1.19.jar -rw-r--r-- 1 root root 318K Jun 18 06:45 jackson-core-2.9.9.jar -rw-r--r-- 1 root root 66K Jun 18 06:45 jackson-annotations-2.9.9.jar -rw-r--r-- 1 root root 355K Jun 18 06:45 commons-configuration-1.10.jar -rw-r--r-- 1 root root 546K Jun 18 06:45 atlas-intg-2.1.0.jar -rw-r--r-- 1 root root 79K Jun 18 06:45 atlas-common-2.1.0.jar -rw-r--r-- 1 root root 23K Jun 18 06:45 atlas-client-v2-2.1.0.jar -rw-r--r-- 1 root root 42K Jun 18 06:45 atlas-client-v1-2.1.0.jar -rw-r--r-- 1 root root 37K Jun 18 06:45 atlas-client-common-2.1.0.jar -rw-r--r-- 1 root root 7.0M Jun 18 06:45 kafka_2.11-2.0.0.jar -rw-r--r-- 1 root root 45K Jun 18 06:45 jsr311-api-1.1.jar -rw-r--r-- 1 root root 1.4M Jun 18 06:45 jackson-databind-2.10.0.jar -rw-r--r-- 1 root root 94K Jun 18 06:45 hive-bridge-2.1.0.jar -rw-r--r-- 1 root root 63K Jun 18 06:45 atlas-notification-2.1.0.jar -rw-r--r-- 1 root root 1.9M Jun 18 06:45 kafka-clients-2.0.0.jar -rw-rw-r-- 1 hadoop hadoop 427K Jun 21 11:14 jersey-core-1.19.jar -rw-rw-r-- 1 hadoop hadoop 46K Jun 23 09:12 jsr311-api-1.1.1.jar -rw-rw-r-- 1 hadoop hadoop 1.4M Jun 23 09:12 jersey-bundle-1.9.jar ... View more

while running import-hive.sh script getting below ...

by Explorer in Support Questions
‎06-27-2021 10:26 PM
‎06-27-2021 10:26 PM
Exception in thread "main" java.lang.NoClassDefFoundError: com/sun/jersey/core/util/FeaturesAndProperties at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:756) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:468) at java.net.URLClassLoader.access$100(URLClassLoader.java:74) at java.net.URLClassLoader$1.run(URLClassLoader.java:369) at java.net.URLClassLoader$1.run(URLClassLoader.java:363) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:362) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:134) Caused by: java.lang.ClassNotFoundException: com.sun.jersey.core.util.FeaturesAndProperties at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 13 more Failed to import Hive Meta Data!!!     Could you please help me with this. Thanks in Advance. Regards, Venkataramana  ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎09-03-2021 02:11 AM
Community Statistics
Member Since ‎06-27-2021 10:19 PM
Last Visited ‎09-03-2021 02:11 AM
Posts 8