Member since
12-05-2016
6
Posts
0
Kudos Received
0
Solutions
12-19-2016
03:46 PM
Hi, did you find a solution? I have the same pb ... Thanks
... View more
12-19-2016
10:51 AM
Hi, I'm using this version of HDP : /usr/hdp/2.5.0.0-1245/ Is this the reason? Should I upgrade my stack?
... View more
12-13-2016
09:07 PM
Okay, but I've the same issue with others imports which are not parts of native libraries. My own jar cannot be included neither.... Is this a problem with Zeppelin notebook?
... View more
12-13-2016
05:17 PM
@Ian Roberts I'm sorry , but I cannot make it work. Here is my error: import org.apache.commons.codec.binary.Base64
import java.time.LocalDateTime.now
import com.mongodb.BasicDBObjectBuilder.start
import org.apache.commons.codec.binary.Base64
import java.time.LocalDateTime.now
<console>:35: error: object mongodb is not a member of package com
import com.mongodb.BasicDBObjectBuilder.start
The jar mongo-java-driver-2.14.3.jar is present in: livy-server/repl-jars hdfs:///user/mgervais/.sparkStaging/application_1481647493263_0001 And the Spark UI show those properties: spark.yarn.secondary.jars : ...mongo-java-driver-2.14.3.jar... spark.jars : ...file:/usr/hdp/current/livy-server/repl-jars/mongo-java-driver-2.14.3.jar... I've the livy interpreter enable in the Zeppelin notebook (It works , I can see the livy sessions...) I've restarted the full Cluster with Ambari... Thanks...
... View more
12-13-2016
04:21 PM
Hi Ian , Thanks for your response, unfortunately it doesn't work. I've added all jars in the /usr/hdp/current/livy-server/repl-jars folder. In Spark environment I can see them with those properties: spark.yarn.secondary.jars spark.jars All jars are present into the container folder : hadoop/yarn/local/usercache/mgervais/appcache/application_1481623014483_0014/container_e24_1481623014483_0014_01_000001
I'm using Zeppelin, Livy & Spark. (Installed with Ambari.) Any idea? Thanks
... View more
12-05-2016
08:18 AM
Hi , did you find a solution to include libraries from internal maven repository? When I inspect log files, I can see that livy tries to resolve dependencies with http://dl.bintray.com/spark-packages, https://repo1.maven.org/, local-m2-cache. Is there a way to add custom maven repository? I'm using Ambari and Zeppelin Thanks
... View more