About lgeorge

lgeorge · ‎11-16-2016

Thanks @Satish Duggana! For reference, this and related windowing articles have been incorporated into the Storm Component Guide; see http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_storm-component-guide/content/storm-windowing.html

lgeorge · ‎11-15-2016

The HDP Spark Component Guide (versions 2.5.0+) has been updated per Bikas's clarification, http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/spark-encryption.html

lgeorge · ‎10-12-2016

@Smart Solutions there is also some related info for Apache Spark version 1.6.2 (shipped with HDP 2.5) at https://spark.apache.org/docs/1.6.2/security.html#encryption.

lgeorge · ‎10-07-2016

Also the HDP 2.5 documentation library has instructions for installing the HDP Search management pack (including Solr): http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_solr-search-installation/content/ch_hdp-search-install-ambari.html

lgeorge · ‎10-04-2016

@Han Jeongphill, while Spark standalone is not officially supported by Hortonworks at this time, dynamic resource allocation is available for standalone mode at the community level. For prerequisites, configuration info, and how to start dynamic allocation on a standalone cluster, see https://spark.apache.org/docs/1.6.1/job-scheduling.html#dynamic-resource-allocation.

lgeorge · ‎09-29-2016

@Sami Ahmad glad it's working! That's interesting. & thanks for clarifying; I wasn't sure if the EV was set in the spark2 directory (vs. spark1).

lgeorge · ‎09-29-2016

@Sami Ahmad, not sure if this'll help, but did you set the env variable within the spark2 directory? (See http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/spark-choose-version.html.)

lgeorge · ‎09-29-2016

@mayki wogno, regarding your last question--I believe you need to install R separately before using it with Spark/SparkR. There is additional info in our HDP 2.5.0 documentation (SparkR is in tech preview until HDP 2.5); see http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/ch_spark-r.html.

lgeorge · ‎09-29-2016

@Robbert Naastepad, could it be the case that the interpreter is not enabled/selected for use in the notebook? See "Configuring a Zeppelin Interpreter" at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/using-interp.html.

lgeorge · ‎09-28-2016

@Sami Ahmad, in terms of supported configurations, Spark versions 1.6.2 and 2.0 (in technical preview) can be installed together on HDP 2.5.0. See the following for more info: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/install-spark-over-ambari.html.

Online	Offline
Last Visited	‎08-08-2019 07:47 PM

Member Since	‎09-10-2015 08:46 PM
Last Visited	‎08-08-2019 07:47 PM
Posts	93
Kudos received	31

Cloudera Community

Re: how to install Solr using Ambari view?

Re: Dynamic allocation on Spark Standalone cluster

Re: spark2 not accessable

Re: apache spark 2.0

Re: Zeppelin: %hive and %phoenix interpreters in 2...

Re: Windowing in Apache Storm trident.

Re: Confusion in documentation : Configuring Spark...

Re: Confusion in documentation : Configuring Spark...

Re: how to install Solr using Ambari view?

Re: Dynamic allocation on Spark Standalone cluster

Re: spark2 not accessable

Re: spark2 not accessable

Re: SPARK PYSPARK SPARKR : Question Versionning

Re: %jdbc(hive) prefix not found in Zeppelin

Re: apache spark 2.0