Member since
12-09-2015
97
Posts
51
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1453 | 05-04-2016 06:00 AM | |
3213 | 04-11-2016 09:57 AM | |
986 | 04-08-2016 11:30 AM |
05-12-2017
04:34 AM
I am trying to run the spark-shell with the following command. Spark shell is under /usr/hdp/current/spark-client/bin # spark-shell but I am getting the following error: /usr/hdp/2.4.0.0-169/spark/bin/spark-class: line 101: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el6_7.x86_64/jre/bin/java: No such file or directory I have checked the JDK path and found that the JDK is installed under /usr/jdk/jdk1.8.0_121 directory my JAVA_HOME is set to /usr/jdk/jdk1.8.0_121 I would like to undestand why spark is not getting the right path to JAVA_HOME
... View more
Labels:
- Labels:
-
Apache Spark
04-04-2017
11:14 AM
Okay. I have fixed it. I have executed the above two commands, but gave /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.131.x86_64 for the openJDK path. Thanks for your help 🙂
... View more
04-04-2017
10:39 AM
the folder that I see in my machine is /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.131.x86_64, which I set it in the export JAVA_HOME command, but i still get the same error,i.e, it cannot find javac
... View more
04-04-2017
09:34 AM
If you read my post again you will see that I had mentioned that I do not see "jvm" folder under /usr/hdp/current. So there is no folder called /usr/hdp/current/jvm/java-1.7.0-openjdk-1.7.0.51.x86_64 in my system.
... View more
04-04-2017
09:18 AM
I have HDP 2.4. I have installed OpenJDK 1.7 as mentioned in the following link. The installation happens without any error. Step 5 in this link mentions the line 'ln -s /usr/hdp/current/jvm/java-1.7.0-openjdk-1.7.0.51.x86_64 /usr/java/default'. I do not see any folder called JVM under /usr/hdp/current. I also executed java -version, but I still see Java RE, but no JDK. What am I doing wrong?. Also, when I execute javac, i get the error -bash: javac: command not found https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.3/bk_installing_manually_book/content/meet-min-system-requirements.html
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
03-10-2017
11:20 AM
@Jay SenSharma Thanks. This is the command I was looking for. I have downloaded 'jdk-8u121-linux-x64.tar.gz' and kept it under /usr/jdk folder in all the hosts. But when I execute the command 'ambari-server setup --java-home=/usr/jdk' I get the eerror ERROR: Exiting with exit code 1.
REASON: Downloading or installing JDK failed: 'Fatal exception: Path to java home /usr/jdk/ or java binary file does not exists, exit code 1'. Exiting. Could you please confirm whether the correct file is jdk-8u121-linux-x64.tar.gz
... View more
03-10-2017
10:10 AM
@Jay SenSharma The proxy server is already mentioned in the ambari-env.sh, so I can confirm you that this is not a proxy issue. Regarding "--Jdk-location" option, I do not understand which command to execute with this argument? Can you please paste the full command with the option "--Jdk-location"?
... View more
03-10-2017
09:35 AM
@Jay SenSharma
I agree that ambari-setup is a better option, but what if I keep getting the error (I have edited the post with the error message). I want to double check, whether installing java manually is okay and that it doesn't cripple the cluster. I love ambari but what I hate is that, any small change might bring more errors and the cluster might stop. I do not see any JDK folder under /var/lib/ambari-server/resources/
... View more
03-10-2017
09:17 AM
I have setup a four node cluster using HDP 2.4. Currently is has Java 1.7 installed. I tried to upgrade to java 1.8 by executing "ambari-server setup". I select Option [1]. This starts the downloading of Java 1.8, but after trying for a few minutes, I see the following error. I have not been able to figure out the issue, but wondering if there is way to manually upgrade the java version from 1.7 to 1.8 without ambari-server setup? I have read the below thread, but I would like to confirm whether it is fine to do so. Thread https://community.hortonworks.com/questions/46432/upgrading-jdk-17-to-18-on-hdp-242.html Error: REASON: Downloading or installing JDK failed: 'Fatal exception: Failed to download JDK: <urlopen error [Errno 110] Connection timed out>. Please check that the JDK is available at http://public-repo-1.hortonworks.com/ARTIFACTS/jdk-8u60-linux-x64.tar.gz. Also you may specify JDK file location in local filesystem using --jdk-location command line argument., exit code 1'. Exiting. The above error message also mentions "Also you may specify JDK file location in local filesystem using --jdk-location command line argument", so can anyone please help me with the steps?
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)