Member since
03-19-2019
11
Posts
1
Kudos Received
0
Solutions
04-02-2019
08:49 AM
Thank you, indeed it was an internet issue, changing the dns resolver in "/etc/resolv.conf" worked. default was 127.0.0.11, but this kept spitting errors, changing it to 8.8.8.8 worked. not sure why though.
... View more
04-01-2019
08:43 PM
1 Kudo
I found a workaround by installing it locally: I downloaded the JARs from Maven: https://mvnrepository.com/artifact/org.apache.zeppelin/zeppelin-shell/0.8.0 and passed it as argument artifact. This worked: # /usr/hdp/current/zeppelin-server/bin/install-interpreter.sh --name shell --artifact /var/tmp/zeppelin-jar/zeppelin-shell-0.8.0.jar
... View more
04-01-2019
08:43 PM
While trying to install the shell interpreter for zeppelin (v 0.8.0), I fail with this message: # sudo /usr/hdp/current/zeppelin-server/bin/install-interpreter.sh --name shell
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/zeppelin/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/zeppelin/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/zeppelin/lib/slf4j-simple-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Install shell(org.apache.zeppelin:zeppelin-shell:0.8.0) to /usr/hdp/current/zeppelin-server/interpreter/shell ...
org.sonatype.aether.RepositoryException: Cannot fetch dependencies for org.apache.zeppelin:zeppelin-shell:0.8.0
at org.apache.zeppelin.dep.DependencyResolver.getArtifactsWithDep(DependencyResolver.java:179)
at org.apache.zeppelin.dep.DependencyResolver.loadFromMvn(DependencyResolver.java:128)
at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:76)
at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:93)
at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:85)
at org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:170)
at org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:134)
at org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:126)
at org.apache.zeppelin.interpreter.install.InstallInterpreter.main(InstallInterpreter.java:278)
Caused by: java.lang.NullPointerException
at org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:352)
at org.apache.zeppelin.dep.DependencyResolver.getArtifactsWithDep(DependencyResolver.java:176)
... 8 more I use HDP 3.0.1
... View more
Labels:
- Labels:
-
Apache Zeppelin
03-24-2019
12:19 PM
Thank you, indeed it worked with javac -cp `hadoop classpath` -d wordcount_classes WordCount.java
... View more
03-23-2019
07:50 PM
Hi, I'm following Douglas Eadline's tutorial http://www.informit.com/store/hadoop-and-spark-fundamentals-livelessons-9780134770864 and try to compile the WordCount example, but I fail. Eadline suggests to comile it with hadoop-core.jar, which was renamed in newer versions as I understand. I tried with javac -classpath /usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core.jar -d wordcount_classes WordCount.java but I still get a load of errors. Any suggestions? Where can I find the correct jar? WordCount.java:27: error: package org.apache.hadoop.conf does not exist import org.apache.hadoop.conf.Configuration; ^ WordCount.java:28: error: package org.apache.hadoop.conf does not exist import org.apache.hadoop.conf.Configured; ^ WordCount.java:29: error: package org.apache.hadoop.fs does not exist import org.apache.hadoop.fs.Path; ^ WordCount.java:30: error: package org.apache.hadoop.io does not exist import org.apache.hadoop.io.IntWritable; ^ WordCount.java:31: error: package org.apache.hadoop.io does not exist import org.apache.hadoop.io.LongWritable; ^ WordCount.java:32: error: package org.apache.hadoop.io does not exist import org.apache.hadoop.io.Text; ^ WordCount.java:42: error: package org.apache.hadoop.util does not exist import org.apache.hadoop.util.Tool; ^ WordCount.java:43: error: package org.apache.hadoop.util does not exist import org.apache.hadoop.util.ToolRunner; ^ WordCount.java:54: error: cannot find symbol public class WordCount extends Configured implements Tool { ^ symbol: class Configured WordCount.java:54: error: cannot find symbol public class WordCount extends Configured implements Tool { ^ symbol: class Tool WordCount.java:61: error: cannot access Closeable public static class MapClass extends MapReduceBase ^ class file for org.apache.hadoop.io.Closeable not found WordCount.java:64: error: cannot find symbol private final static IntWritable one = new IntWritable(1); ^ symbol: class IntWritable location: class MapClass WordCount.java:65: error: cannot find symbol private Text word = new Text(); ^ symbol: class Text location: class MapClass WordCount.java:67: error: cannot find symbol public void map(LongWritable key, Text value, ^ symbol: class LongWritable location: class MapClass WordCount.java:67: error: cannot find symbol public void map(LongWritable key, Text value, ^ symbol: class Text location: class MapClass WordCount.java:68: error: cannot find symbol OutputCollector<Text, IntWritable> output, ^ symbol: class Text location: class MapClass WordCount.java:68: error: cannot find symbol OutputCollector<Text, IntWritable> output, ^ symbol: class IntWritable location: class MapClass WordCount.java:83: error: cannot find symbol implements Reducer<Text, IntWritable, Text, IntWritable> { ^ symbol: class Text location: class WordCount WordCount.java:83: error: cannot find symbol implements Reducer<Text, IntWritable, Text, IntWritable> { ^ symbol: class IntWritable location: class WordCount WordCount.java:83: error: cannot find symbol implements Reducer<Text, IntWritable, Text, IntWritable> { ^ symbol: class Text location: class WordCount WordCount.java:83: error: cannot find symbol implements Reducer<Text, IntWritable, Text, IntWritable> { ^ symbol: class IntWritable location: class WordCount WordCount.java:85: error: cannot find symbol public void reduce(Text key, Iterator<IntWritable> values, ^ symbol: class Text location: class Reduce WordCount.java:85: error: cannot find symbol public void reduce(Text key, Iterator<IntWritable> values, ^ symbol: class IntWritable location: class Reduce WordCount.java:86: error: cannot find symbol OutputCollector<Text, IntWritable> output, ^ symbol: class Text location: class Reduce WordCount.java:86: error: cannot find symbol OutputCollector<Text, IntWritable> output, ^ symbol: class IntWritable location: class Reduce
... View more
Labels: