About xmorera

xmorera · ‎10-22-2017

I have a cluster with Spark 2.2 on CDH 5.12 with RHEL and I am trying to set up IPython to use with pyspark2. I have installed IPython 5.x LTS (long term support) but I am not able to get it to work. So far yum -y update yum install epel-release yum -y install python-pip yum groupinstall 'Development Tools' yum install python-devel pip install IPython==5.0 --user Now how should I launch? Anyone with a link to installation instructions?

xmorera · ‎04-08-2017

Thank you Romain. As usual, very helpful

xmorera · ‎03-31-2017

This is more of a road map question, but does anyone from around here knows what is the state of development of the Spark notebook? I heard that it is not being actively developed because of other Spark related efforts, namely Workbench. But still would like to ask if the Spark notebook is something that we will see as an integral part of HUE or if it is just going to remain as is. Any help is appreciated.

xmorera · ‎03-30-2017

I had the same issue when executing spark-submit. The issue was that I did not have all my paths set and there is an easy way to fix if you know which jars you want to include, simply use the --jars parameter, like this: spark-submit ... --jars /opt/cloudera/parcels/CDH-5.10.0-1.cdh5.10.0.p0.41/jars/hadoop-common-2.6.0-cdh5.10.0.jar ...

xmorera · ‎03-30-2017

I had the same error. The solution was simple, I was pointing to a Follower Zookeeper node instead of the Leader. When I pointed to the Leader it worked out fine.

Online	Offline
Last Visited	‎10-22-2017 08:43 AM

Date Registered	‎08-30-2016 06:26 AM
Last Visited	‎10-22-2017 08:43 AM
Total Messages Posted	7
Total Kudos Received	2

IPython Installation with Spark 2.2 on CDH 5.12

Re: Future of Spark Notebook

Future of Spark Notebook

Re: CDH 5.5 pyspark java.lang.NoClassDefFoundError...

Re: Getting error while uploading the sample confi...