About cokorda_putra

cokorda_putra · ‎02-23-2016

I can fix this issue by set the /home/centos executable "775" @Ian Roberts

cokorda_putra · ‎02-23-2016

here's the permission for the python @Ian Roberts -rwxrwxrwx 1 centos centos 7136 Feb 23 13:22 python

cokorda_putra · ‎02-23-2016

hi @Ian Roberts drwxrwxrwx 4 centos centos 57 Feb 23 13:22 pyspark this is the permission for pyspark venv "777" and i install the pyspark venv on every node manager with the same permission.

cokorda_putra · ‎02-23-2016

Hi, i got this error below Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, ip-internal): java.io.IOException: Cannot run program "/home/centos/apps/pyspark/venv/bin/python": error=13, Permission denied while running $ export HADOOP_USER_NAME=centos $ export PYSPARK_PYTHON=/home/centos/apps/pyspark/venv/bin/python $ pyspark --master yarn-client I add user centos to hadoop as hdfs group i'm using latest HDP 2.3.4 and centos 7.2

cokorda_putra · ‎02-17-2016

thanks for the information @Artem Ervits For now i can run spark 1.6 from /usr/hdp/2.3.4.1-10/spark/bin

cokorda_putra · ‎02-17-2016

Do you know when the estimation release for HDP 2.4? @Artem Ervits

cokorda_putra · ‎02-17-2016

I thinks i already install the spark client @Artem Ervits I install spark 1.5 from ambari first, after that i upgrade the spark version from 1.5 to 1.6 When i try to run the pyspark i got this error. It's possible to upgrade spark from latest HDP version?

cokorda_putra · ‎02-17-2016

hi @Artem Ervits yes i upgrade the HDP to 2.3.4 but i got a litle problem while i try to upgrade spark 1.5 to 1.6 here is my question about that question

cokorda_putra · ‎02-17-2016

hi @Neeraj Sabharwal rpm -qa | grep -i spark -> this is the output spark_2_3_4_0_3485-master-1.5.2.2.3.4.0-3485.el6.noarch spark_2_3_4_1_10-1.6.0.2.3.4.1-10.el6.noarch spark_2_3_4_0_3485-python-1.5.2.2.3.4.0-3485.el6.noarch spark_2_3_4_1_10-master-1.6.0.2.3.4.1-10.el6.noarch spark_2_3_4_0_3485-worker-1.5.2.2.3.4.0-3485.el6.noarch spark_2_3_4_1_10-python-1.6.0.2.3.4.1-10.el6.noarch spark_2_3_4_0_3485-1.5.2.2.3.4.0-3485.el6.noarch Yes i run yum install spark_2_3_4_1_10-master -y as it the tutorial frow the link

cokorda_putra · ‎02-17-2016

Hi all, I just upgrade spark 1.5 to 1.6 on HDP 2.3 I'm following this tutorial here and i got this error while try to run pysprak from terminal /usr/bin/pyspark: line 22: /usr/bin/load-spark-env.sh: No such file or directory /usr/bin/spark-class: line 23: /usr/bin/load-spark-env.sh: No such file or directory ls: cannot access /usr/assembly/target/scala-: No such file or directory Failed to find Spark assembly in /usr/assembly/target/scala-. You need to build Spark before running this program.

Online	Offline
Last Visited	‎06-01-2016 07:09 AM

Member Since	‎12-12-2015 06:29 PM
Last Visited	‎06-01-2016 07:09 AM
Posts	20
Kudos received	20

Cloudera Community

Re: Got permission denied when running pyspark --m...

Re: Got permission denied when running pyspark --m...

Re: Got permission denied when running pyspark --m...

Re: Got permission denied when running pyspark --m...

Got permission denied when running pyspark --maste...

Re: Upgrade spark 1.5 to 1.6 HDP 2.3

Re: Upgrade spark 1.5 to 1.6 HDP 2.3

Re: Upgrade spark 1.5 to 1.6 HDP 2.3

Re: How to upgrade HDP spark version

Re: Upgrade spark 1.5 to 1.6 HDP 2.3

Upgrade spark 1.5 to 1.6 HDP 2.3