@Roberto Sancho You have to follow the tutorial step by step to make it work http://hortonworks.com/hadoop-tutorial/apache-spark-1-6-technical-preview-with-hdp-2-3 Also, you can follow https://gist.github.com/nsabharwal/9163e0adfc66af080145 but I suggest to stick with the tutorial Please see the output that I posted. In your case, there is no R package with in spark ... View more

@Roberto Sancho You don't have correct version..See the entry in bold [root@phdns01 spark]# ls -l total 92 drwxr-xr-x. 2 root root 4096 Feb 14 20:29 bin lrwxrwxrwx. 1 root root 25 Feb 14 20:29 conf -> /etc/spark/2.3.4.0-3485/0 drwxr-xr-x. 3 root root 4096 Feb 14 20:29 data drwxr-xr-x. 2 root root 4096 Dec 15 23:18 doc drwxr-xr-x. 3 root root 4096 Feb 14 20:29 ec2 drwxr-xr-x. 3 root root 4096 Feb 14 20:29 examples drwxr-xr-x. 2 root root 4096 Feb 14 20:29 lib -rw-r--r--. 1 root root 17356 Dec 15 22:17 LICENSE -rw-r--r--. 1 root root 23158 Dec 15 22:17 NOTICE drwxr-xr-x. 6 root root 4096 Feb 14 20:29 python drwxr-xr-x. 3 root root 4096 Feb 14 20:29 R ---> SparkR package -rw-r--r--. 1 root root 507 Dec 15 22:17 README -rw-r--r--. 1 root root 3593 Dec 15 22:17 README.md -rw-r--r--. 1 root root 61 Dec 15 23:18 RELEASE drwxr-xr-x. 2 root root 4096 Feb 14 20:29 sbin lrwxrwxrwx. 1 root root 19 Feb 14 20:29 work -> /var/run/spark/work ... View more

@Xi Sanderson Take a look on DNS entries and network timeout settings. Tagging @Jeff Groves as I know he has done lot of work on alerts. ... View more

@Sunile Manjee See this https://parquet.apache.org/downloads/ On internal note: Search in wiki and you will find lot of information on it. ... View more

@Ram D It's no different in EC2..See this old thread started by you https://community.hortonworks.com/questions/15328/os-patch-updates-what-are-the-precautions-to-take.html ... View more

@Kiran Bollam Ok. Please do close the thread by accepting one of the answers ... View more

@Ram D See this https://community.hortonworks.com/questions/4940/hdp-os-upgradepatching-best-practices.html ... View more

@Smart Solutions Take a look on this http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_installing_manually_book/content/ch_installing_spark_chapter.html You can pick nodes where you want your clients. When you install Spark, the following directories will be created: /usr/hdp/current/spark-client for submitting Spark jobs /usr/hdp/current/spark-history for launching Spark master processes, such as the Spark History Server /usr/hdp/current/spark-thriftserver for the Spark Thrift Server ... View more

@Kunal Gaikwad that's why you have to be careful about giving mounts during the install. If possible then add new nodes and make sure to add new disk mounts in the configs. or extend the existing LUNS ... View more